2023-12-08T20:33:50.442 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-08T20:33:50.442 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} --archive /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218 --owner scheduled_yuriw@teuthology --verbose --name yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218/orig.config.yaml 2023-12-08T20:33:50.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T20:33:50.568 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218 branch: main description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7484218' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 3721 sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLmzGf8xlQcY+xSSHpacug3HfG5FA11wlSf4yTCF8X5ZvnF4jFbfZq6bM04t26vEes7oJ4pGuy2MG/0rDZu/sIA= smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCn5oXHiNIgqK8w2G01xEDfyPiEwwAF7BNao5zji20NzvVMxgvQ9zvWO97+kRZC6uewa+UdCb5B52A6aSEhpJD4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-08_19:31:32 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-08T20:33:50.569 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa; will attempt to use it 2023-12-08T20:33:50.569 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks 2023-12-08T20:33:50.569 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-08T20:33:50.571 INFO:teuthology.task.internal:Checking packages... 2023-12-08T20:33:50.595 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9dcc13bb80dcc1cdea72b04d80505b4649a2b882' 2023-12-08T20:33:50.595 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-08T20:33:50.596 INFO:teuthology.packaging:ref: None 2023-12-08T20:33:50.596 INFO:teuthology.packaging:tag: None 2023-12-08T20:33:50.596 INFO:teuthology.packaging:branch: main 2023-12-08T20:33:50.596 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:33:50.596 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2023-12-08T20:33:51.004 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-44-g9dcc13bb-1jammy 2023-12-08T20:33:51.004 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-08T20:33:51.013 INFO:teuthology.task.internal:no buildpackages task found 2023-12-08T20:33:51.013 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-08T20:33:51.020 INFO:teuthology.task.internal:Saving configuration 2023-12-08T20:33:51.038 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-08T20:33:51.044 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T20:33:51.066 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 20:27:52.126276', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIINt5fmi77Tzm4RAFrs722uSEGanppybncddDs1+j/Ls'} 2023-12-08T20:33:51.095 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 20:27:52.128229', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIFI0qepmYKqfdscs66jjzLr7ZX6VkveTHVD7op5BgXP'} 2023-12-08T20:33:51.096 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-08T20:33:51.101 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-08T20:33:51.101 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-12-08T20:33:51.101 INFO:teuthology.run_tasks:Running task console_log... 2023-12-08T20:33:51.169 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcfba7f6040>, signals=[15]) 2023-12-08T20:33:51.170 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-08T20:33:51.175 INFO:teuthology.task.internal:Opening connections... 2023-12-08T20:33:51.175 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T20:33:51.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:33:51.256 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2023-12-08T20:33:51.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:33:51.334 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-08T20:33:51.340 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-12-08T20:33:51.346 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-12-08T20:33:51.346 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-12-08T20:33:51.393 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-08T20:33:51.393 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Ubuntu" 2023-12-08T20:33:51.393 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="22.04" 2023-12-08T20:33:51.393 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-08T20:33:51.393 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_CODENAME=jammy 2023-12-08T20:33:51.393 INFO:teuthology.orchestra.run.smithi053.stdout:ID=ubuntu 2023-12-08T20:33:51.393 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE=debian 2023-12-08T20:33:51.394 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-08T20:33:51.394 INFO:teuthology.orchestra.run.smithi053.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-08T20:33:51.394 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-08T20:33:51.394 INFO:teuthology.orchestra.run.smithi053.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-08T20:33:51.394 INFO:teuthology.orchestra.run.smithi053.stdout:UBUNTU_CODENAME=jammy 2023-12-08T20:33:51.395 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-12-08T20:33:51.417 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-12-08T20:33:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-12-08T20:33:51.422 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-12-08T20:33:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-08T20:33:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Ubuntu" 2023-12-08T20:33:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="22.04" 2023-12-08T20:33:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-08T20:33:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_CODENAME=jammy 2023-12-08T20:33:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ID=ubuntu 2023-12-08T20:33:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE=debian 2023-12-08T20:33:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-08T20:33:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-08T20:33:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-08T20:33:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-08T20:33:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:UBUNTU_CODENAME=jammy 2023-12-08T20:33:51.468 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-12-08T20:33:51.492 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-08T20:33:51.501 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-08T20:33:51.507 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-08T20:33:51.507 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2023-12-08T20:33:51.510 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2023-12-08T20:33:51.515 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-08T20:33:51.521 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-08T20:33:51.522 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2023-12-08T20:33:51.558 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2023-12-08T20:33:51.577 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-08T20:33:51.628 INFO:teuthology.run_tasks:Running task kernel... 2023-12-08T20:33:51.645 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-08T20:33:51.645 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-08T20:33:51.646 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-08T20:33:51.646 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-08T20:33:51.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:33:51.651 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2023-12-08T20:33:51.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:33:51.652 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-12-08T20:33:51.697 INFO:teuthology.orchestra.run.smithi053.stdout:5.15.0-56-generic 2023-12-08T20:33:51.697 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.15.0-56-generic 2023-12-08T20:33:51.698 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get clean 2023-12-08T20:33:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:5.15.0-56-generic 2023-12-08T20:33:51.699 INFO:teuthology.task.kernel:Running kernel on smithi146: 5.15.0-56-generic 2023-12-08T20:33:51.699 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get clean 2023-12-08T20:33:51.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2023-12-08T20:33:51.831 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2023-12-08T20:33:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-12-08T20:33:51.965 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-08T20:33:51.967 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-12-08T20:33:51.967 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-12-08T20:33:52.041 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-12-08T20:33:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-08T20:33:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-12-08T20:33:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [376 kB] 2023-12-08T20:33:52.190 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [376 kB] 2023-12-08T20:33:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,016 kB] 2023-12-08T20:33:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [195 kB] 2023-12-08T20:33:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-12-08T20:33:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.4 kB] 2023-12-08T20:33:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,179 kB] 2023-12-08T20:33:52.267 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,244 kB] 2023-12-08T20:33:52.268 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,016 kB] 2023-12-08T20:33:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [191 kB] 2023-12-08T20:33:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2023-12-08T20:33:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [815 kB] 2023-12-08T20:33:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [577 kB] 2023-12-08T20:33:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [152 kB] 2023-12-08T20:33:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-12-08T20:33:52.300 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [195 kB] 2023-12-08T20:33:52.303 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-12-08T20:33:52.304 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,179 kB] 2023-12-08T20:33:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-12-08T20:33:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-12-08T20:33:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-12-08T20:33:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-12-08T20:33:52.322 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.4 kB] 2023-12-08T20:33:52.322 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [191 kB] 2023-12-08T20:33:52.322 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2023-12-08T20:33:52.322 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [577 kB] 2023-12-08T20:33:52.328 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [815 kB] 2023-12-08T20:33:52.335 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [152 kB] 2023-12-08T20:33:52.337 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-12-08T20:33:52.350 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-12-08T20:33:52.350 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [543 kB] 2023-12-08T20:33:52.350 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-12-08T20:33:52.351 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-12-08T20:33:52.352 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-12-08T20:33:52.353 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [257 kB] 2023-12-08T20:33:52.355 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2023-12-08T20:33:52.355 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,226 kB] 2023-12-08T20:33:52.366 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.8 kB] 2023-12-08T20:33:52.367 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [199 kB] 2023-12-08T20:33:52.368 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2023-12-08T20:33:52.368 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [675 kB] 2023-12-08T20:33:52.374 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,018 kB] 2023-12-08T20:33:52.382 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [226 kB] 2023-12-08T20:33:52.383 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2023-12-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-12-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-12-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-12-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-12-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.2 kB] 2023-12-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.3 kB] 2023-12-08T20:33:52.405 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-12-08T20:33:52.405 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-12-08T20:33:52.405 INFO:teuthology.orchestra.run.smithi053.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2023-12-08T20:33:52.406 INFO:teuthology.orchestra.run.smithi053.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.8 kB] 2023-12-08T20:33:52.406 INFO:teuthology.orchestra.run.smithi053.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2023-12-08T20:33:52.406 INFO:teuthology.orchestra.run.smithi053.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-12-08T20:33:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-12-08T20:33:52.651 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [543 kB] 2023-12-08T20:33:52.839 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,244 kB] 2023-12-08T20:33:52.974 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [257 kB] 2023-12-08T20:33:52.990 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2023-12-08T20:33:52.991 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.8 kB] 2023-12-08T20:33:52.993 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,226 kB] 2023-12-08T20:33:53.048 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [199 kB] 2023-12-08T20:33:53.053 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2023-12-08T20:33:53.218 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [675 kB] 2023-12-08T20:33:53.797 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,018 kB] 2023-12-08T20:33:53.907 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [226 kB] 2023-12-08T20:33:53.927 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2023-12-08T20:33:53.928 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-12-08T20:33:53.928 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-12-08T20:33:53.932 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-12-08T20:33:53.933 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-12-08T20:33:53.933 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.2 kB] 2023-12-08T20:33:53.937 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.3 kB] 2023-12-08T20:33:53.941 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-12-08T20:33:54.106 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-12-08T20:33:54.188 INFO:teuthology.orchestra.run.smithi146.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2023-12-08T20:33:54.290 INFO:teuthology.orchestra.run.smithi146.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.8 kB] 2023-12-08T20:33:54.324 INFO:teuthology.orchestra.run.smithi146.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2023-12-08T20:33:54.381 INFO:teuthology.orchestra.run.smithi146.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-12-08T20:33:57.934 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 10.7 MB in 2s (6,734 kB/s) 2023-12-08T20:33:58.692 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 10.7 MB in 2s (4,275 kB/s) 2023-12-08T20:33:59.275 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-12-08T20:33:59.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-08T20:33:59.346 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-12-08T20:33:59.525 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2023-12-08T20:33:59.526 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2023-12-08T20:33:59.677 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2023-12-08T20:33:59.677 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-08T20:33:59.677 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-08T20:33:59.677 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-08T20:33:59.678 INFO:teuthology.orchestra.run.smithi053.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-12-08T20:33:59.678 INFO:teuthology.orchestra.run.smithi053.stdout: python2.7-minimal 2023-12-08T20:33:59.678 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-08T20:33:59.678 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2023-12-08T20:33:59.679 INFO:teuthology.orchestra.run.smithi053.stdout: linux-generic linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2023-12-08T20:33:59.679 INFO:teuthology.orchestra.run.smithi053.stdout: linux-headers-generic linux-image-5.15.0-91-generic 2023-12-08T20:33:59.679 INFO:teuthology.orchestra.run.smithi053.stdout: linux-modules-5.15.0-91-generic linux-modules-extra-5.15.0-91-generic 2023-12-08T20:33:59.680 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2023-12-08T20:33:59.680 INFO:teuthology.orchestra.run.smithi053.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-12-08T20:33:59.680 INFO:teuthology.orchestra.run.smithi053.stdout:Recommended packages: 2023-12-08T20:33:59.680 INFO:teuthology.orchestra.run.smithi053.stdout: thermald 2023-12-08T20:33:59.717 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2023-12-08T20:33:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2023-12-08T20:33:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.15.0-91-generic linux-modules-5.15.0-91-generic 2023-12-08T20:33:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: linux-modules-extra-5.15.0-91-generic 2023-12-08T20:33:59.719 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages will be upgraded: 2023-12-08T20:33:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: linux-generic linux-headers-generic linux-image-generic 2023-12-08T20:33:59.769 INFO:teuthology.orchestra.run.smithi053.stdout:3 upgraded, 5 newly installed, 0 to remove and 275 not upgraded. 2023-12-08T20:33:59.769 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 113 MB of archives. 2023-12-08T20:33:59.769 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 582 MB of additional disk space will be used. 2023-12-08T20:33:59.769 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-91-generic amd64 5.15.0-91.101 [22.5 MB] 2023-12-08T20:34:00.008 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-08T20:34:00.025 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-08T20:34:00.084 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-08T20:34:00.251 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-91-generic amd64 5.15.0-91.101 [11.5 MB] 2023-12-08T20:34:00.283 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-08T20:34:00.284 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-08T20:34:00.401 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-91-generic amd64 5.15.0-91.101 [63.8 MB] 2023-12-08T20:34:00.449 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-08T20:34:00.449 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-08T20:34:00.449 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-08T20:34:00.450 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-08T20:34:00.450 INFO:teuthology.orchestra.run.smithi146.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-12-08T20:34:00.450 INFO:teuthology.orchestra.run.smithi146.stdout: python2.7-minimal 2023-12-08T20:34:00.450 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-08T20:34:00.451 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2023-12-08T20:34:00.451 INFO:teuthology.orchestra.run.smithi146.stdout: linux-generic linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2023-12-08T20:34:00.451 INFO:teuthology.orchestra.run.smithi146.stdout: linux-headers-generic linux-image-5.15.0-91-generic 2023-12-08T20:34:00.452 INFO:teuthology.orchestra.run.smithi146.stdout: linux-modules-5.15.0-91-generic linux-modules-extra-5.15.0-91-generic 2023-12-08T20:34:00.453 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2023-12-08T20:34:00.453 INFO:teuthology.orchestra.run.smithi146.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-12-08T20:34:00.453 INFO:teuthology.orchestra.run.smithi146.stdout:Recommended packages: 2023-12-08T20:34:00.453 INFO:teuthology.orchestra.run.smithi146.stdout: thermald 2023-12-08T20:34:00.496 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2023-12-08T20:34:00.496 INFO:teuthology.orchestra.run.smithi146.stdout: linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2023-12-08T20:34:00.496 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.15.0-91-generic linux-modules-5.15.0-91-generic 2023-12-08T20:34:00.496 INFO:teuthology.orchestra.run.smithi146.stdout: linux-modules-extra-5.15.0-91-generic 2023-12-08T20:34:00.497 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be upgraded: 2023-12-08T20:34:00.498 INFO:teuthology.orchestra.run.smithi146.stdout: linux-generic linux-headers-generic linux-image-generic 2023-12-08T20:34:00.549 INFO:teuthology.orchestra.run.smithi146.stdout:3 upgraded, 5 newly installed, 0 to remove and 275 not upgraded. 2023-12-08T20:34:00.549 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 113 MB of archives. 2023-12-08T20:34:00.549 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 582 MB of additional disk space will be used. 2023-12-08T20:34:00.549 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-91-generic amd64 5.15.0-91.101 [22.5 MB] 2023-12-08T20:34:00.997 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-91-generic amd64 5.15.0-91.101 [11.5 MB] 2023-12-08T20:34:01.148 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-91-generic amd64 5.15.0-91.101 [63.8 MB] 2023-12-08T20:34:01.213 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.91.88 [1,700 B] 2023-12-08T20:34:01.213 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.91.88 [2,488 B] 2023-12-08T20:34:01.213 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91 all 5.15.0-91.101 [12.3 MB] 2023-12-08T20:34:01.343 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91-generic amd64 5.15.0-91.101 [2,860 kB] 2023-12-08T20:34:01.365 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.91.88 [2,342 B] 2023-12-08T20:34:01.842 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 113 MB in 2s (66.3 MB/s) 2023-12-08T20:34:01.941 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.91.88 [1,700 B] 2023-12-08T20:34:01.941 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.91.88 [2,488 B] 2023-12-08T20:34:01.941 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91 all 5.15.0-91.101 [12.3 MB] 2023-12-08T20:34:02.041 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-modules-5.15.0-91-generic. 2023-12-08T20:34:02.061 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91-generic amd64 5.15.0-91.101 [2,860 kB] 2023-12-08T20:34:02.156 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.91.88 [2,342 B] 2023-12-08T20:34:02.548 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 113 MB in 2s (68.4 MB/s) 2023-12-08T20:34:02.732 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-modules-5.15.0-91-generic. 2023-12-08T20:34:04.176 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-12-08T20:34:04.180 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../0-linux-modules-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-08T20:34:04.306 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:04.908 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-12-08T20:34:04.912 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../0-linux-modules-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-08T20:34:05.212 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:06.374 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-image-5.15.0-91-generic. 2023-12-08T20:34:06.396 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../1-linux-image-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-08T20:34:06.491 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:06.928 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-91-generic. 2023-12-08T20:34:06.937 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-08T20:34:06.969 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:07.573 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-image-5.15.0-91-generic. 2023-12-08T20:34:07.594 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../1-linux-image-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-08T20:34:07.698 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:08.160 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-91-generic. 2023-12-08T20:34:08.171 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-08T20:34:08.201 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:13.817 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../3-linux-generic_5.15.0.91.88_amd64.deb ... 2023-12-08T20:34:13.941 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2023-12-08T20:34:14.241 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.91.88_amd64.deb ... 2023-12-08T20:34:14.336 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-image-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2023-12-08T20:34:14.631 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-headers-5.15.0-91. 2023-12-08T20:34:14.654 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../5-linux-headers-5.15.0-91_5.15.0-91.101_all.deb ... 2023-12-08T20:34:14.698 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-5.15.0-91 (5.15.0-91.101) ... 2023-12-08T20:34:15.331 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../3-linux-generic_5.15.0.91.88_amd64.deb ... 2023-12-08T20:34:15.459 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2023-12-08T20:34:15.818 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.91.88_amd64.deb ... 2023-12-08T20:34:15.920 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-image-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2023-12-08T20:34:16.215 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-headers-5.15.0-91. 2023-12-08T20:34:16.237 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../5-linux-headers-5.15.0-91_5.15.0-91.101_all.deb ... 2023-12-08T20:34:16.281 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-headers-5.15.0-91 (5.15.0-91.101) ... 2023-12-08T20:34:20.563 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-headers-5.15.0-91-generic. 2023-12-08T20:34:20.599 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../6-linux-headers-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-08T20:34:20.629 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:22.017 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-headers-5.15.0-91-generic. 2023-12-08T20:34:22.054 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../6-linux-headers-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-08T20:34:22.092 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:23.368 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.91.88_amd64.deb ... 2023-12-08T20:34:23.463 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2023-12-08T20:34:23.797 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-5.15.0-91 (5.15.0-91.101) ... 2023-12-08T20:34:23.901 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:24.019 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-generic (5.15.0.91.88) ... 2023-12-08T20:34:24.148 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:24.786 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.91.88_amd64.deb ... 2023-12-08T20:34:24.927 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-headers-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2023-12-08T20:34:25.260 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-headers-5.15.0-91 (5.15.0-91.101) ... 2023-12-08T20:34:25.415 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:25.501 INFO:teuthology.orchestra.run.smithi053.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-12-08T20:34:25.501 INFO:teuthology.orchestra.run.smithi053.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-12-08T20:34:25.501 INFO:teuthology.orchestra.run.smithi053.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-91-generic 2023-12-08T20:34:25.501 INFO:teuthology.orchestra.run.smithi053.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-91-generic 2023-12-08T20:34:25.541 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-headers-generic (5.15.0.91.88) ... 2023-12-08T20:34:25.650 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:25.670 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:27.046 INFO:teuthology.orchestra.run.smithi146.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-12-08T20:34:27.046 INFO:teuthology.orchestra.run.smithi146.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-12-08T20:34:27.046 INFO:teuthology.orchestra.run.smithi146.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-91-generic 2023-12-08T20:34:27.046 INFO:teuthology.orchestra.run.smithi146.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-91-generic 2023-12-08T20:34:27.051 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-image-generic (5.15.0.91.88) ... 2023-12-08T20:34:27.161 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:27.204 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:28.621 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-generic (5.15.0.91.88) ... 2023-12-08T20:34:28.672 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-image-generic (5.15.0.91.88) ... 2023-12-08T20:34:28.747 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:28.806 INFO:teuthology.orchestra.run.smithi053.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-12-08T20:34:28.806 INFO:teuthology.orchestra.run.smithi053.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-91-generic 2023-12-08T20:34:28.823 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:30.266 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-generic (5.15.0.91.88) ... 2023-12-08T20:34:30.401 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-08T20:34:30.470 INFO:teuthology.orchestra.run.smithi146.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-12-08T20:34:30.470 INFO:teuthology.orchestra.run.smithi146.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-91-generic 2023-12-08T20:34:44.395 INFO:teuthology.orchestra.run.smithi053.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-12-08T20:34:44.396 INFO:teuthology.orchestra.run.smithi053.stdout:Sourcing file `/etc/default/grub' 2023-12-08T20:34:44.407 INFO:teuthology.orchestra.run.smithi053.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-08T20:34:44.435 INFO:teuthology.orchestra.run.smithi053.stdout:Generating grub configuration file ... 2023-12-08T20:34:44.679 INFO:teuthology.orchestra.run.smithi146.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-12-08T20:34:44.679 INFO:teuthology.orchestra.run.smithi146.stdout:Sourcing file `/etc/default/grub' 2023-12-08T20:34:44.712 INFO:teuthology.orchestra.run.smithi146.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-08T20:34:44.715 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2023-12-08T20:34:44.732 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2023-12-08T20:34:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:Generating grub configuration file ... 2023-12-08T20:34:45.015 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-08T20:34:45.020 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-08T20:34:45.031 INFO:teuthology.orchestra.run.smithi146.stdout:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2023-12-08T20:34:45.046 INFO:teuthology.orchestra.run.smithi146.stdout:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2023-12-08T20:34:45.086 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-08T20:34:45.091 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-08T20:34:45.247 INFO:teuthology.orchestra.run.smithi053.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-08T20:34:45.247 INFO:teuthology.orchestra.run.smithi053.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-12-08T20:34:45.247 INFO:teuthology.orchestra.run.smithi053.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-08T20:34:45.291 INFO:teuthology.orchestra.run.smithi053.stdout:done 2023-12-08T20:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-08T20:34:45.348 INFO:teuthology.orchestra.run.smithi146.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-08T20:34:45.422 INFO:teuthology.orchestra.run.smithi146.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-08T20:34:45.427 INFO:teuthology.orchestra.run.smithi146.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-08T20:34:45.577 INFO:teuthology.orchestra.run.smithi146.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-08T20:34:45.577 INFO:teuthology.orchestra.run.smithi146.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-12-08T20:34:45.577 INFO:teuthology.orchestra.run.smithi146.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-08T20:34:45.631 INFO:teuthology.orchestra.run.smithi146.stdout:done 2023-12-08T20:34:45.773 DEBUG:teuthology.orchestra.run.smithi053:> dpkg -s linux-image-generic 2023-12-08T20:34:45.800 INFO:teuthology.orchestra.run.smithi053.stdout:Package: linux-image-generic 2023-12-08T20:34:45.800 INFO:teuthology.orchestra.run.smithi053.stdout:Status: install ok installed 2023-12-08T20:34:45.800 INFO:teuthology.orchestra.run.smithi053.stdout:Priority: optional 2023-12-08T20:34:45.801 INFO:teuthology.orchestra.run.smithi053.stdout:Section: kernel 2023-12-08T20:34:45.801 INFO:teuthology.orchestra.run.smithi053.stdout:Installed-Size: 20 2023-12-08T20:34:45.801 INFO:teuthology.orchestra.run.smithi053.stdout:Maintainer: Ubuntu Kernel Team 2023-12-08T20:34:45.801 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: amd64 2023-12-08T20:34:45.801 INFO:teuthology.orchestra.run.smithi053.stdout:Source: linux-meta 2023-12-08T20:34:45.801 INFO:teuthology.orchestra.run.smithi053.stdout:Version: 5.15.0.91.88 2023-12-08T20:34:45.801 INFO:teuthology.orchestra.run.smithi053.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-12-08T20:34:45.801 INFO:teuthology.orchestra.run.smithi053.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-08T20:34:45.801 INFO:teuthology.orchestra.run.smithi053.stdout:Recommends: thermald 2023-12-08T20:34:45.801 INFO:teuthology.orchestra.run.smithi053.stdout:Description: Generic Linux kernel image 2023-12-08T20:34:45.801 INFO:teuthology.orchestra.run.smithi053.stdout: This package will always depend on the latest generic kernel image 2023-12-08T20:34:45.801 INFO:teuthology.orchestra.run.smithi053.stdout: available. 2023-12-08T20:34:45.801 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-91-generic 2023-12-08T20:34:45.802 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-08T20:34:45.802 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-08T20:34:45.802 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-08T20:34:45.802 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=None, version=distro) 2023-12-08T20:34:45.802 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get clean 2023-12-08T20:34:45.962 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2023-12-08T20:34:46.092 DEBUG:teuthology.orchestra.run.smithi146:> dpkg -s linux-image-generic 2023-12-08T20:34:46.118 INFO:teuthology.orchestra.run.smithi146.stdout:Package: linux-image-generic 2023-12-08T20:34:46.118 INFO:teuthology.orchestra.run.smithi146.stdout:Status: install ok installed 2023-12-08T20:34:46.118 INFO:teuthology.orchestra.run.smithi146.stdout:Priority: optional 2023-12-08T20:34:46.118 INFO:teuthology.orchestra.run.smithi146.stdout:Section: kernel 2023-12-08T20:34:46.118 INFO:teuthology.orchestra.run.smithi146.stdout:Installed-Size: 20 2023-12-08T20:34:46.118 INFO:teuthology.orchestra.run.smithi146.stdout:Maintainer: Ubuntu Kernel Team 2023-12-08T20:34:46.118 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: amd64 2023-12-08T20:34:46.119 INFO:teuthology.orchestra.run.smithi146.stdout:Source: linux-meta 2023-12-08T20:34:46.119 INFO:teuthology.orchestra.run.smithi146.stdout:Version: 5.15.0.91.88 2023-12-08T20:34:46.119 INFO:teuthology.orchestra.run.smithi146.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-12-08T20:34:46.119 INFO:teuthology.orchestra.run.smithi146.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-08T20:34:46.119 INFO:teuthology.orchestra.run.smithi146.stdout:Recommends: thermald 2023-12-08T20:34:46.119 INFO:teuthology.orchestra.run.smithi146.stdout:Description: Generic Linux kernel image 2023-12-08T20:34:46.119 INFO:teuthology.orchestra.run.smithi146.stdout: This package will always depend on the latest generic kernel image 2023-12-08T20:34:46.119 INFO:teuthology.orchestra.run.smithi146.stdout: available. 2023-12-08T20:34:46.119 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-91-generic 2023-12-08T20:34:46.119 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-08T20:34:46.119 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-08T20:34:46.120 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-08T20:34:46.120 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=None, version=distro) 2023-12-08T20:34:46.120 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get clean 2023-12-08T20:34:46.204 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-08T20:34:46.204 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-08T20:34:46.275 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-08T20:34:46.283 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2023-12-08T20:34:46.358 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-08T20:34:46.394 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-08T20:34:46.401 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-08T20:34:46.418 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-08T20:34:46.515 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-08T20:34:47.587 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-12-08T20:34:47.604 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-08T20:34:47.668 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-12-08T20:34:47.703 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-08T20:34:47.721 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-08T20:34:47.772 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-08T20:34:47.860 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2023-12-08T20:34:47.860 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2023-12-08T20:34:47.941 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-08T20:34:47.941 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-08T20:34:48.030 INFO:teuthology.orchestra.run.smithi053.stdout:linux-image-generic is already the newest version (5.15.0.91.88). 2023-12-08T20:34:48.030 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2023-12-08T20:34:48.030 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-08T20:34:48.030 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-08T20:34:48.030 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-08T20:34:48.031 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-08T20:34:48.031 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-08T20:34:48.031 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-08T20:34:48.069 INFO:teuthology.orchestra.run.smithi053.stdout:0 upgraded, 0 newly installed, 0 to remove and 275 not upgraded. 2023-12-08T20:34:48.071 DEBUG:teuthology.orchestra.run.smithi053:> dpkg -s linux-image-generic 2023-12-08T20:34:48.084 INFO:teuthology.orchestra.run.smithi053.stdout:Package: linux-image-generic 2023-12-08T20:34:48.084 INFO:teuthology.orchestra.run.smithi053.stdout:Status: install ok installed 2023-12-08T20:34:48.084 INFO:teuthology.orchestra.run.smithi053.stdout:Priority: optional 2023-12-08T20:34:48.084 INFO:teuthology.orchestra.run.smithi053.stdout:Section: kernel 2023-12-08T20:34:48.084 INFO:teuthology.orchestra.run.smithi053.stdout:Installed-Size: 20 2023-12-08T20:34:48.084 INFO:teuthology.orchestra.run.smithi053.stdout:Maintainer: Ubuntu Kernel Team 2023-12-08T20:34:48.084 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: amd64 2023-12-08T20:34:48.085 INFO:teuthology.orchestra.run.smithi053.stdout:Source: linux-meta 2023-12-08T20:34:48.085 INFO:teuthology.orchestra.run.smithi053.stdout:Version: 5.15.0.91.88 2023-12-08T20:34:48.085 INFO:teuthology.orchestra.run.smithi053.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-12-08T20:34:48.085 INFO:teuthology.orchestra.run.smithi053.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-08T20:34:48.085 INFO:teuthology.orchestra.run.smithi053.stdout:Recommends: thermald 2023-12-08T20:34:48.085 INFO:teuthology.orchestra.run.smithi053.stdout:Description: Generic Linux kernel image 2023-12-08T20:34:48.085 INFO:teuthology.orchestra.run.smithi053.stdout: This package will always depend on the latest generic kernel image 2023-12-08T20:34:48.085 INFO:teuthology.orchestra.run.smithi053.stdout: available. 2023-12-08T20:34:48.085 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2023-12-08T20:34:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:linux-image-generic is already the newest version (5.15.0.91.88). 2023-12-08T20:34:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-08T20:34:48.087 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-08T20:34:48.087 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-08T20:34:48.087 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-08T20:34:48.087 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-08T20:34:48.091 INFO:teuthology.orchestra.run.smithi146.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-08T20:34:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-08T20:34:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 0 to remove and 275 not upgraded. 2023-12-08T20:34:48.125 DEBUG:teuthology.orchestra.run.smithi146:> dpkg -s linux-image-generic 2023-12-08T20:34:48.133 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.GhsSrKkmgw 2023-12-08T20:34:48.133 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GhsSrKkmgw 2023-12-08T20:34:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:Package: linux-image-generic 2023-12-08T20:34:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:Status: install ok installed 2023-12-08T20:34:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:Priority: optional 2023-12-08T20:34:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:Section: kernel 2023-12-08T20:34:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:Installed-Size: 20 2023-12-08T20:34:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:Maintainer: Ubuntu Kernel Team 2023-12-08T20:34:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: amd64 2023-12-08T20:34:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:Source: linux-meta 2023-12-08T20:34:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:Version: 5.15.0.91.88 2023-12-08T20:34:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-12-08T20:34:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-08T20:34:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:Recommends: thermald 2023-12-08T20:34:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:Description: Generic Linux kernel image 2023-12-08T20:34:48.184 INFO:teuthology.orchestra.run.smithi146.stdout: This package will always depend on the latest generic kernel image 2023-12-08T20:34:48.184 INFO:teuthology.orchestra.run.smithi146.stdout: available. 2023-12-08T20:34:48.184 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-12-08T20:34:48.189 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.GhsSrKkmgw 2023-12-08T20:34:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.ZOieKERWbZ 2023-12-08T20:34:48.233 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ZOieKERWbZ 2023-12-08T20:34:48.302 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.ZOieKERWbZ 2023-12-08T20:34:48.310 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.GhsSrKkmgw is 10KB 2023-12-08T20:34:48.324 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.GhsSrKkmgw 2023-12-08T20:34:48.329 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-12-08T20:34:48.384 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:34:48.385 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-12-08T20:34:48.385 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-12-08T20:34:48.424 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.ZOieKERWbZ is 10KB 2023-12-08T20:34:48.437 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.ZOieKERWbZ 2023-12-08T20:34:48.442 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-12-08T20:34:48.453 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-91-generic 2023-12-08T20:34:48.453 DEBUG:teuthology.orchestra.run.smithi053:> sudo update-grub 2023-12-08T20:34:48.496 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:34:48.496 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-12-08T20:34:48.496 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-12-08T20:34:48.581 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-91-generic 2023-12-08T20:34:48.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo update-grub 2023-12-08T20:34:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:Sourcing file `/etc/default/grub' 2023-12-08T20:34:49.631 INFO:teuthology.orchestra.run.smithi053.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-08T20:34:49.636 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2023-12-08T20:34:49.809 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2023-12-08T20:34:49.815 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2023-12-08T20:34:49.833 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub' 2023-12-08T20:34:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-08T20:34:49.836 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2023-12-08T20:34:50.052 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-08T20:34:50.057 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-08T20:34:50.078 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2023-12-08T20:34:50.084 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2023-12-08T20:34:50.098 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-08T20:34:50.103 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-08T20:34:50.217 INFO:teuthology.orchestra.run.smithi053.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-08T20:34:50.217 INFO:teuthology.orchestra.run.smithi053.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-08T20:34:50.217 INFO:teuthology.orchestra.run.smithi053.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-08T20:34:50.236 INFO:teuthology.orchestra.run.smithi053.stderr:done 2023-12-08T20:34:50.244 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2023-12-08T20:34:50.325 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-08T20:34:50.330 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-08T20:34:50.372 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-08T20:34:50.377 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-08T20:34:50.494 INFO:teuthology.orchestra.run.smithi146.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-08T20:34:50.494 INFO:teuthology.orchestra.run.smithi146.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-08T20:34:50.494 INFO:teuthology.orchestra.run.smithi146.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-08T20:34:50.520 INFO:teuthology.orchestra.run.smithi146.stderr:done 2023-12-08T20:34:50.522 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2023-12-08T20:35:20.274 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-08T20:35:20.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-08T20:35:20.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:35:20.525 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-08T20:35:20.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-08T20:35:20.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:35:38.723 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-08T20:35:38.982 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-12-08T20:35:47.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-08T20:35:47.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:35:47.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-08T20:35:47.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:35:51.042 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-12-08T20:36:03.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-08T20:36:03.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:36:06.114 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-12-08T20:36:06.114 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-08T20:36:18.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-08T20:36:18.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:36:21.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-08T20:36:21.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:36:21.190 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-08T20:36:36.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-08T20:36:36.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:36:36.423 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-12-08T20:36:37.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-08T20:36:37.048 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-91-generic"... 2023-12-08T20:36:37.048 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2023-12-08T20:36:37.093 INFO:teuthology.orchestra.run.smithi053.stdout:5.15.0-91-generic 2023-12-08T20:36:37.094 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-91-generic vs 5.15.0-91-generic 2023-12-08T20:36:37.094 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-08T20:36:37.094 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-08T20:36:38.095 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-08T20:36:38.095 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-08T20:36:38.163 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2023-12-08T20:36:38.191 DEBUG:teuthology.parallel:result is None 2023-12-08T20:36:52.934 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-12-08T20:36:53.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-08T20:36:53.527 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-91-generic"... 2023-12-08T20:36:53.527 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-12-08T20:36:53.575 INFO:teuthology.orchestra.run.smithi146.stdout:5.15.0-91-generic 2023-12-08T20:36:53.579 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-91-generic vs 5.15.0-91-generic 2023-12-08T20:36:53.580 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-08T20:36:53.580 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-08T20:36:54.580 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-08T20:36:54.580 DEBUG:teuthology.orchestra.run.smithi146:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-08T20:36:54.649 INFO:teuthology.orchestra.run.smithi146.stdout:ttyS1 2023-12-08T20:36:54.676 DEBUG:teuthology.parallel:result is None 2023-12-08T20:36:54.677 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-08T20:36:54.686 INFO:teuthology.task.internal:Creating test directory... 2023-12-08T20:36:54.686 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-08T20:36:54.688 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-08T20:36:54.694 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-08T20:36:54.701 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-08T20:36:54.725 INFO:teuthology.task.internal:Creating archive directory... 2023-12-08T20:36:54.726 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-08T20:36:54.735 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-08T20:36:54.754 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-08T20:36:54.762 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-08T20:36:54.762 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-08T20:36:54.791 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-08T20:36:54.813 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T20:36:54.818 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T20:36:54.823 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T20:36:54.827 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T20:36:54.829 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-08T20:36:54.836 INFO:teuthology.task.internal:Configuring sudo... 2023-12-08T20:36:54.837 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-08T20:36:54.866 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-08T20:36:54.895 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-08T20:36:54.905 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-08T20:36:54.906 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-08T20:36:54.939 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-08T20:36:54.945 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T20:36:54.990 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T20:36:55.039 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:36:55.039 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-08T20:36:55.102 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T20:36:55.107 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T20:36:55.156 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:36:55.156 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-08T20:36:55.222 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2023-12-08T20:36:55.225 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2023-12-08T20:36:55.291 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-08T20:36:55.300 INFO:teuthology.task.internal:Starting timer... 2023-12-08T20:36:55.300 INFO:teuthology.run_tasks:Running task pcp... 2023-12-08T20:36:55.312 INFO:teuthology.run_tasks:Running task selinux... 2023-12-08T20:36:55.320 DEBUG:teuthology.task.selinux:Excluding smithi053: OS 'ubuntu' does not support SELinux 2023-12-08T20:36:55.320 DEBUG:teuthology.task.selinux:Excluding smithi146: OS 'ubuntu' does not support SELinux 2023-12-08T20:36:55.321 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-08T20:36:55.321 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-08T20:36:55.321 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-08T20:36:55.321 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-08T20:36:55.330 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-08T20:36:55.336 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-08T20:36:55.464 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-08T20:36:55.480 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-08T20:36:55.482 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi146.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-08T20:44:53.984 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com')] 2023-12-08T20:44:53.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-08T20:44:53.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:44:54.066 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-12-08T20:44:54.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-08T20:44:54.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-08T20:44:54.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:44:54.226 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-12-08T20:44:54.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-12-08T20:44:54.303 INFO:teuthology.run_tasks:Running task clock... 2023-12-08T20:44:54.313 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-08T20:44:54.313 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-08T20:44:54.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T20:44:54.316 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-08T20:44:54.317 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T20:44:54.348 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-08T20:44:54.348 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: Command line: ntpd -gq 2023-12-08T20:44:54.348 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: ---------------------------------------------------- 2023-12-08T20:44:54.348 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: ntp-4 is maintained by Network Time Foundation, 2023-12-08T20:44:54.348 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-08T20:44:54.348 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: corporation. Support and training for ntp-4 are 2023-12-08T20:44:54.348 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: available at https://www.nwtime.org/support 2023-12-08T20:44:54.348 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: ---------------------------------------------------- 2023-12-08T20:44:54.348 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: proto: precision = 0.045 usec (-24) 2023-12-08T20:44:54.348 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: basedate set to 2022-02-04 2023-12-08T20:44:54.348 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: gps base set to 2022-02-06 (week 2196) 2023-12-08T20:44:54.348 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-08T20:44:54.349 INFO:teuthology.orchestra.run.smithi053.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-08T20:44:54.349 INFO:teuthology.orchestra.run.smithi053.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-08T20:44:54.350 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: restrict ::: KOD does nothing without LIMITED. 2023-12-08T20:44:54.350 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: Listen and drop on 0 v6wildcard [::]:123 2023-12-08T20:44:54.350 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-08T20:44:54.350 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: Listen normally on 2 lo 127.0.0.1:123 2023-12-08T20:44:54.350 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: Listen normally on 3 ens1f0 172.21.15.53:123 2023-12-08T20:44:54.350 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: Listen normally on 4 lo [::1]:123 2023-12-08T20:44:54.350 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:3718%4]:123 2023-12-08T20:44:54.350 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:44:54 ntpd[27870]: Listening on routing socket on fd #22 for interface updates 2023-12-08T20:44:54.373 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-08T20:44:54.373 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: Command line: ntpd -gq 2023-12-08T20:44:54.373 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: ---------------------------------------------------- 2023-12-08T20:44:54.373 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: ntp-4 is maintained by Network Time Foundation, 2023-12-08T20:44:54.374 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-08T20:44:54.374 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: corporation. Support and training for ntp-4 are 2023-12-08T20:44:54.374 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: available at https://www.nwtime.org/support 2023-12-08T20:44:54.374 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: ---------------------------------------------------- 2023-12-08T20:44:54.374 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: proto: precision = 0.046 usec (-24) 2023-12-08T20:44:54.374 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: basedate set to 2022-02-04 2023-12-08T20:44:54.374 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: gps base set to 2022-02-06 (week 2196) 2023-12-08T20:44:54.374 INFO:teuthology.orchestra.run.smithi146.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-08T20:44:54.375 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-08T20:44:54.375 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: restrict ::: KOD does nothing without LIMITED. 2023-12-08T20:44:54.375 INFO:teuthology.orchestra.run.smithi146.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-08T20:44:54.376 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: Listen and drop on 0 v6wildcard [::]:123 2023-12-08T20:44:54.376 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-08T20:44:54.376 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: Listen normally on 2 lo 127.0.0.1:123 2023-12-08T20:44:54.376 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: Listen normally on 3 enp3s0f1 172.21.15.146:123 2023-12-08T20:44:54.376 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: Listen normally on 4 lo [::1]:123 2023-12-08T20:44:54.376 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:76fd%5]:123 2023-12-08T20:44:54.376 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:44:54 ntpd[28013]: Listening on routing socket on fd #22 for interface updates 2023-12-08T20:44:55.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:55 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:55.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:55 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:55.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:55 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:55.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:55 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:55.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:55 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:55.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:55 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:55.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:55 ntpd[27870]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:44:55.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:55 ntpd[27870]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:44:55.373 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:55 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:55.373 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:55 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:56.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:56 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:56.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:56 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:56.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:56 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:56.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:56 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:56.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:56 ntpd[28013]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:44:56.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:56 ntpd[28013]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:44:57.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:57 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:57.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:57 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:57.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:57 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:57.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:57 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:57.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:57 ntpd[27870]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:44:57.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:57 ntpd[27870]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:44:58.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:58 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:58.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:58 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:58.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:58 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:58.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:58 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:58.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:58 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:58.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:58 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:58.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:58 ntpd[27870]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:44:58.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:58 ntpd[27870]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:44:58.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:58 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:58.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:58 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:58.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:58 ntpd[27870]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:44:58.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:58 ntpd[27870]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:44:58.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:58 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:58.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:58 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:58.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:58 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:58.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:58 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:58.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:58 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:58.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:58 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:58.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:58 ntpd[28013]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:44:58.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:58 ntpd[28013]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:44:58.375 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:58 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:58.375 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:58 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:58.375 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:58 ntpd[28013]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:44:58.375 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:58 ntpd[28013]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:44:59.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:59 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:59.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:59 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:59.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:59 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:59.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:59 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:59.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:59 ntpd[27870]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:44:59.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:44:59 ntpd[27870]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:44:59.373 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:59 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:59.373 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:59 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:59.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:59 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:44:59.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:59 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:44:59.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:59 ntpd[28013]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:44:59.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:44:59 ntpd[28013]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:45:00.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:00 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:00.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:00 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:00.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:00 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:00.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:00 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:00.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:00 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:00.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:00 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:00.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:00 ntpd[27870]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:45:00.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:00 ntpd[27870]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:45:00.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:00 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:00.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:00 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:00.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:00 ntpd[27870]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:45:00.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:00 ntpd[27870]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:45:00.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:00 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:00.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:00 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:00.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:00 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:00.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:00 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:00.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:00 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:00.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:00 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:00.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:00 ntpd[28013]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:45:00.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:00 ntpd[28013]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:45:00.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:00 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:00.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:00 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:00.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:00 ntpd[28013]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:45:00.375 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:00 ntpd[28013]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:45:01.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:01 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:01.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:01 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:01.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:01 ntpd[27870]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:01.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:01 ntpd[27870]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:01.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:01 ntpd[27870]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:45:01.348 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:01 ntpd[27870]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:45:01.349 INFO:teuthology.orchestra.run.smithi053.stdout: 8 Dec 20:45:01 ntpd[27870]: ntpd: time slew -0.005287 s 2023-12-08T20:45:01.349 INFO:teuthology.orchestra.run.smithi053.stdout:ntpd: time slew -0.005287s 2023-12-08T20:45:01.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:01 ntpd[27870]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-08T20:45:01.349 INFO:teuthology.orchestra.run.smithi053.stderr: 8 Dec 20:45:01 ntpd[27870]: can't open /var/log/ntpstats/loopstats.20231208: Permission denied 2023-12-08T20:45:01.373 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:01 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:01.373 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:01 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:01.373 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:01 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:01.373 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:01 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:01.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:01 ntpd[28013]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:45:01.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:01 ntpd[28013]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:45:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: remote refid st t when poll reach delay offset jitter 2023-12-08T20:45:01.403 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================== 2023-12-08T20:45:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T20:45:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T20:45:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T20:45:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T20:45:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:45:02.375 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:45:02.375 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T20:45:02.375 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T20:45:02.375 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T20:45:02.375 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T20:45:02.375 INFO:teuthology.orchestra.run.smithi146.stdout: 8 Dec 20:45:02 ntpd[28013]: ntpd: time slew -0.002949 s 2023-12-08T20:45:02.375 INFO:teuthology.orchestra.run.smithi146.stdout:ntpd: time slew -0.002949s 2023-12-08T20:45:02.376 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-08T20:45:02.376 INFO:teuthology.orchestra.run.smithi146.stderr: 8 Dec 20:45:02 ntpd[28013]: can't open /var/log/ntpstats/loopstats.20231208: Permission denied 2023-12-08T20:45:02.426 INFO:teuthology.orchestra.run.smithi146.stdout: remote refid st t when poll reach delay offset jitter 2023-12-08T20:45:02.427 INFO:teuthology.orchestra.run.smithi146.stdout:============================================================================== 2023-12-08T20:45:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T20:45:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T20:45:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T20:45:02.427 INFO:teuthology.orchestra.run.smithi146.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T20:45:02.428 INFO:teuthology.run_tasks:Running task install... 2023-12-08T20:45:02.439 DEBUG:teuthology.task.install:project ceph 2023-12-08T20:45:02.439 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'}} 2023-12-08T20:45:02.440 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'} 2023-12-08T20:45:02.440 INFO:teuthology.task.install:Using flavor: default 2023-12-08T20:45:02.446 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-12-08T20:45:02.446 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-08T20:45:02.446 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-key list | grep Ceph 2023-12-08T20:45:02.447 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-key list | grep Ceph 2023-12-08T20:45:02.512 INFO:teuthology.orchestra.run.smithi053.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-08T20:45:02.525 INFO:teuthology.orchestra.run.smithi146.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-08T20:45:02.542 INFO:teuthology.orchestra.run.smithi053.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-08T20:45:02.542 INFO:teuthology.orchestra.run.smithi053.stdout:uid [ unknown] Ceph.com (release key) 2023-12-08T20:45:02.543 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-08T20:45:02.543 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-08T20:45:02.543 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:45:02.553 INFO:teuthology.orchestra.run.smithi146.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-08T20:45:02.553 INFO:teuthology.orchestra.run.smithi146.stdout:uid [ unknown] Ceph.com (release key) 2023-12-08T20:45:02.553 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-08T20:45:02.553 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-08T20:45:02.554 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:45:02.702 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default/ 2023-12-08T20:45:02.702 INFO:teuthology.task.install.deb:Package version is 19.0.0-44-g9dcc13bb-1jammy 2023-12-08T20:45:02.769 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default/ 2023-12-08T20:45:02.769 INFO:teuthology.task.install.deb:Package version is 19.0.0-44-g9dcc13bb-1jammy 2023-12-08T20:45:02.877 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:45:02.877 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-08T20:45:02.891 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2023-12-08T20:45:02.933 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:45:02.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-08T20:45:02.948 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2023-12-08T20:45:03.115 INFO:teuthology.orchestra.run.smithi146.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy InRelease 2023-12-08T20:45:03.117 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-08T20:45:03.117 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-08T20:45:03.127 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-08T20:45:03.136 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-08T20:45:03.143 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-08T20:45:03.160 INFO:teuthology.orchestra.run.smithi146.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-08T20:45:03.172 INFO:teuthology.orchestra.run.smithi053.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy InRelease 2023-12-08T20:45:03.181 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-12-08T20:45:03.193 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-08T20:45:03.212 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,401 B] 2023-12-08T20:45:03.215 INFO:teuthology.orchestra.run.smithi053.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-08T20:45:03.235 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,401 B] 2023-12-08T20:45:03.262 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-12-08T20:45:03.290 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-08T20:45:03.361 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-08T20:45:03.444 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-08T20:45:03.472 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 28.5 kB in 0s (83.8 kB/s) 2023-12-08T20:45:03.555 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-08T20:45:03.709 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 28.5 kB in 1s (45.4 kB/s) 2023-12-08T20:45:04.383 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-12-08T20:45:04.399 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-44-g9dcc13bb-1jammy cephadm=19.0.0-44-g9dcc13bb-1jammy ceph-mds=19.0.0-44-g9dcc13bb-1jammy ceph-mgr=19.0.0-44-g9dcc13bb-1jammy ceph-common=19.0.0-44-g9dcc13bb-1jammy ceph-fuse=19.0.0-44-g9dcc13bb-1jammy ceph-test=19.0.0-44-g9dcc13bb-1jammy ceph-volume=19.0.0-44-g9dcc13bb-1jammy radosgw=19.0.0-44-g9dcc13bb-1jammy python3-rados=19.0.0-44-g9dcc13bb-1jammy python3-rgw=19.0.0-44-g9dcc13bb-1jammy python3-cephfs=19.0.0-44-g9dcc13bb-1jammy python3-rbd=19.0.0-44-g9dcc13bb-1jammy libcephfs2=19.0.0-44-g9dcc13bb-1jammy libcephfs-dev=19.0.0-44-g9dcc13bb-1jammy librados2=19.0.0-44-g9dcc13bb-1jammy librbd1=19.0.0-44-g9dcc13bb-1jammy rbd-fuse=19.0.0-44-g9dcc13bb-1jammy ceph-common-dbg=19.0.0-44-g9dcc13bb-1jammy ceph-fuse-dbg=19.0.0-44-g9dcc13bb-1jammy ceph-mds-dbg=19.0.0-44-g9dcc13bb-1jammy ceph-mgr-dbg=19.0.0-44-g9dcc13bb-1jammy ceph-mon-dbg=19.0.0-44-g9dcc13bb-1jammy ceph-osd-dbg=19.0.0-44-g9dcc13bb-1jammy ceph-test-dbg=19.0.0-44-g9dcc13bb-1jammy libcephfs2-dbg=19.0.0-44-g9dcc13bb-1jammy librados2-dbg=19.0.0-44-g9dcc13bb-1jammy libradosstriper1-dbg=19.0.0-44-g9dcc13bb-1jammy librbd1-dbg=19.0.0-44-g9dcc13bb-1jammy librgw2-dbg=19.0.0-44-g9dcc13bb-1jammy radosgw-dbg=19.0.0-44-g9dcc13bb-1jammy rbd-fuse-dbg=19.0.0-44-g9dcc13bb-1jammy rbd-mirror-dbg=19.0.0-44-g9dcc13bb-1jammy rbd-nbd-dbg=19.0.0-44-g9dcc13bb-1jammy python3-cephfs=19.0.0-44-g9dcc13bb-1jammy cephfs-shell=19.0.0-44-g9dcc13bb-1jammy cephfs-top=19.0.0-44-g9dcc13bb-1jammy cephfs-mirror=19.0.0-44-g9dcc13bb-1jammy 2023-12-08T20:45:04.461 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-12-08T20:45:04.633 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-08T20:45:04.649 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-44-g9dcc13bb-1jammy cephadm=19.0.0-44-g9dcc13bb-1jammy ceph-mds=19.0.0-44-g9dcc13bb-1jammy ceph-mgr=19.0.0-44-g9dcc13bb-1jammy ceph-common=19.0.0-44-g9dcc13bb-1jammy ceph-fuse=19.0.0-44-g9dcc13bb-1jammy ceph-test=19.0.0-44-g9dcc13bb-1jammy ceph-volume=19.0.0-44-g9dcc13bb-1jammy radosgw=19.0.0-44-g9dcc13bb-1jammy python3-rados=19.0.0-44-g9dcc13bb-1jammy python3-rgw=19.0.0-44-g9dcc13bb-1jammy python3-cephfs=19.0.0-44-g9dcc13bb-1jammy python3-rbd=19.0.0-44-g9dcc13bb-1jammy libcephfs2=19.0.0-44-g9dcc13bb-1jammy libcephfs-dev=19.0.0-44-g9dcc13bb-1jammy librados2=19.0.0-44-g9dcc13bb-1jammy librbd1=19.0.0-44-g9dcc13bb-1jammy rbd-fuse=19.0.0-44-g9dcc13bb-1jammy ceph-common-dbg=19.0.0-44-g9dcc13bb-1jammy ceph-fuse-dbg=19.0.0-44-g9dcc13bb-1jammy ceph-mds-dbg=19.0.0-44-g9dcc13bb-1jammy ceph-mgr-dbg=19.0.0-44-g9dcc13bb-1jammy ceph-mon-dbg=19.0.0-44-g9dcc13bb-1jammy ceph-osd-dbg=19.0.0-44-g9dcc13bb-1jammy ceph-test-dbg=19.0.0-44-g9dcc13bb-1jammy libcephfs2-dbg=19.0.0-44-g9dcc13bb-1jammy librados2-dbg=19.0.0-44-g9dcc13bb-1jammy libradosstriper1-dbg=19.0.0-44-g9dcc13bb-1jammy librbd1-dbg=19.0.0-44-g9dcc13bb-1jammy librgw2-dbg=19.0.0-44-g9dcc13bb-1jammy radosgw-dbg=19.0.0-44-g9dcc13bb-1jammy rbd-fuse-dbg=19.0.0-44-g9dcc13bb-1jammy rbd-mirror-dbg=19.0.0-44-g9dcc13bb-1jammy rbd-nbd-dbg=19.0.0-44-g9dcc13bb-1jammy python3-cephfs=19.0.0-44-g9dcc13bb-1jammy cephfs-shell=19.0.0-44-g9dcc13bb-1jammy cephfs-top=19.0.0-44-g9dcc13bb-1jammy cephfs-mirror=19.0.0-44-g9dcc13bb-1jammy 2023-12-08T20:45:04.654 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2023-12-08T20:45:04.654 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2023-12-08T20:45:04.700 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-08T20:45:04.835 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2023-12-08T20:45:04.835 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-08T20:45:04.835 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-08T20:45:04.835 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-08T20:45:04.836 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-08T20:45:04.836 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-08T20:45:04.836 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-08T20:45:04.837 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2023-12-08T20:45:04.837 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-08T20:45:04.837 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-08T20:45:04.837 INFO:teuthology.orchestra.run.smithi053.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-08T20:45:04.837 INFO:teuthology.orchestra.run.smithi053.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-08T20:45:04.838 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-12-08T20:45:04.838 INFO:teuthology.orchestra.run.smithi053.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-12-08T20:45:04.838 INFO:teuthology.orchestra.run.smithi053.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-08T20:45:04.838 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-08T20:45:04.838 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-08T20:45:04.838 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-08T20:45:04.838 INFO:teuthology.orchestra.run.smithi053.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-08T20:45:04.838 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-08T20:45:04.838 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-08T20:45:04.839 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-08T20:45:04.839 INFO:teuthology.orchestra.run.smithi053.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-08T20:45:04.839 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-08T20:45:04.839 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-08T20:45:04.839 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-08T20:45:04.839 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-08T20:45:04.839 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-08T20:45:04.839 INFO:teuthology.orchestra.run.smithi053.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-08T20:45:04.839 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-08T20:45:04.839 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-08T20:45:04.839 INFO:teuthology.orchestra.run.smithi053.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2023-12-08T20:45:04.840 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2023-12-08T20:45:04.840 INFO:teuthology.orchestra.run.smithi053.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-12-08T20:45:04.840 INFO:teuthology.orchestra.run.smithi053.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-12-08T20:45:04.840 INFO:teuthology.orchestra.run.smithi053.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-12-08T20:45:04.840 INFO:teuthology.orchestra.run.smithi053.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-12-08T20:45:04.840 INFO:teuthology.orchestra.run.smithi053.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-12-08T20:45:04.840 INFO:teuthology.orchestra.run.smithi053.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-08T20:45:04.840 INFO:teuthology.orchestra.run.smithi053.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-12-08T20:45:04.840 INFO:teuthology.orchestra.run.smithi053.stdout:Recommended packages: 2023-12-08T20:45:04.840 INFO:teuthology.orchestra.run.smithi053.stdout: btrfs-tools 2023-12-08T20:45:04.875 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-08T20:45:04.876 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-08T20:45:04.978 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2023-12-08T20:45:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2023-12-08T20:45:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2023-12-08T20:45:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2023-12-08T20:45:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2023-12-08T20:45:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2023-12-08T20:45:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2023-12-08T20:45:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-12-08T20:45:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2023-12-08T20:45:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2023-12-08T20:45:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-12-08T20:45:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-08T20:45:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-08T20:45:04.980 INFO:teuthology.orchestra.run.smithi053.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-08T20:45:04.980 INFO:teuthology.orchestra.run.smithi053.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-08T20:45:04.980 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2023-12-08T20:45:04.980 INFO:teuthology.orchestra.run.smithi053.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2023-12-08T20:45:04.980 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2023-12-08T20:45:05.029 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-08T20:45:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-08T20:45:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-08T20:45:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-08T20:45:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-08T20:45:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-08T20:45:05.031 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-08T20:45:05.031 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2023-12-08T20:45:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-08T20:45:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-08T20:45:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-08T20:45:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-08T20:45:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-08T20:45:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-08T20:45:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-08T20:45:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-08T20:45:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-08T20:45:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2023-12-08T20:45:05.033 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2023-12-08T20:45:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-12-08T20:45:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-12-08T20:45:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-12-08T20:45:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-12-08T20:45:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-12-08T20:45:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-08T20:45:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-12-08T20:45:05.034 INFO:teuthology.orchestra.run.smithi146.stdout:Recommended packages: 2023-12-08T20:45:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: btrfs-tools 2023-12-08T20:45:05.160 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2023-12-08T20:45:05.160 INFO:teuthology.orchestra.run.smithi146.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2023-12-08T20:45:05.160 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2023-12-08T20:45:05.160 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2023-12-08T20:45:05.160 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2023-12-08T20:45:05.160 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2023-12-08T20:45:05.161 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2023-12-08T20:45:05.161 INFO:teuthology.orchestra.run.smithi146.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-12-08T20:45:05.161 INFO:teuthology.orchestra.run.smithi146.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2023-12-08T20:45:05.161 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2023-12-08T20:45:05.161 INFO:teuthology.orchestra.run.smithi146.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-12-08T20:45:05.162 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-12-08T20:45:05.162 INFO:teuthology.orchestra.run.smithi146.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-08T20:45:05.162 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-08T20:45:05.162 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-08T20:45:05.162 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-08T20:45:05.162 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-08T20:45:05.162 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-08T20:45:05.162 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-08T20:45:05.162 INFO:teuthology.orchestra.run.smithi146.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-08T20:45:05.162 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-08T20:45:05.163 INFO:teuthology.orchestra.run.smithi146.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-08T20:45:05.163 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-08T20:45:05.163 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-08T20:45:05.163 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-08T20:45:05.163 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-08T20:45:05.163 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-08T20:45:05.163 INFO:teuthology.orchestra.run.smithi146.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-08T20:45:05.163 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-08T20:45:05.163 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2023-12-08T20:45:05.163 INFO:teuthology.orchestra.run.smithi146.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2023-12-08T20:45:05.163 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2023-12-08T20:45:05.198 INFO:teuthology.orchestra.run.smithi053.stdout:0 upgraded, 142 newly installed, 0 to remove and 263 not upgraded. 2023-12-08T20:45:05.199 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 3,015 MB of archives. 2023-12-08T20:45:05.199 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 3,958 MB of additional disk space will be used. 2023-12-08T20:45:05.199 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-44-g9dcc13bb-1jammy [3,468 kB] 2023-12-08T20:45:05.306 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 142 newly installed, 0 to remove and 263 not upgraded. 2023-12-08T20:45:05.306 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 3,015 MB of archives. 2023-12-08T20:45:05.306 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 3,958 MB of additional disk space will be used. 2023-12-08T20:45:05.306 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-44-g9dcc13bb-1jammy [3,468 kB] 2023-12-08T20:45:05.522 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-44-g9dcc13bb-1jammy [3,110 kB] 2023-12-08T20:45:05.644 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-44-g9dcc13bb-1jammy [690 kB] 2023-12-08T20:45:05.667 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-08T20:45:05.675 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-44-g9dcc13bb-1jammy [356 kB] 2023-12-08T20:45:05.690 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-44-g9dcc13bb-1jammy [32.8 kB] 2023-12-08T20:45:05.691 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-44-g9dcc13bb-1jammy [180 kB] 2023-12-08T20:45:05.699 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-44-g9dcc13bb-1jammy [63.5 kB] 2023-12-08T20:45:05.702 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-44-g9dcc13bb-1jammy [330 kB] 2023-12-08T20:45:05.717 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-44-g9dcc13bb-1jammy [6,214 kB] 2023-12-08T20:45:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-08T20:45:05.796 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-08T20:45:05.810 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-44-g9dcc13bb-1jammy [3,110 kB] 2023-12-08T20:45:05.913 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-08T20:45:05.934 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-08T20:45:05.944 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-08T20:45:05.986 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-44-g9dcc13bb-1jammy [112 kB] 2023-12-08T20:45:05.990 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-44-g9dcc13bb-1jammy [439 kB] 2023-12-08T20:45:05.992 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-08T20:45:05.998 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-08T20:45:06.015 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-44-g9dcc13bb-1jammy [22.5 MB] 2023-12-08T20:45:06.019 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-08T20:45:06.020 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-08T20:45:06.036 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-08T20:45:06.093 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-08T20:45:06.094 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-08T20:45:06.098 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-08T20:45:06.106 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-08T20:45:06.110 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-08T20:45:06.115 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-08T20:45:06.115 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-08T20:45:06.124 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-12-08T20:45:06.126 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-12-08T20:45:06.129 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-12-08T20:45:06.130 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-12-08T20:45:06.130 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-12-08T20:45:06.137 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-12-08T20:45:06.139 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-12-08T20:45:06.141 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-08T20:45:06.157 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-08T20:45:06.157 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-08T20:45:06.158 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-08T20:45:06.158 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-08T20:45:06.158 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-08T20:45:06.159 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-08T20:45:06.159 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-08T20:45:06.159 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-08T20:45:06.176 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-08T20:45:06.177 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-08T20:45:06.179 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-08T20:45:06.186 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-44-g9dcc13bb-1jammy [690 kB] 2023-12-08T20:45:06.196 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-08T20:45:06.196 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-08T20:45:06.197 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-08T20:45:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-08T20:45:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-08T20:45:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-08T20:45:06.199 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-08T20:45:06.215 INFO:teuthology.orchestra.run.smithi146.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-08T20:45:06.216 INFO:teuthology.orchestra.run.smithi146.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-08T20:45:06.221 INFO:teuthology.orchestra.run.smithi146.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-08T20:45:06.235 INFO:teuthology.orchestra.run.smithi146.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-08T20:45:06.235 INFO:teuthology.orchestra.run.smithi146.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-08T20:45:06.236 INFO:teuthology.orchestra.run.smithi146.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-08T20:45:06.237 INFO:teuthology.orchestra.run.smithi146.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-08T20:45:06.239 INFO:teuthology.orchestra.run.smithi146.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-08T20:45:06.240 INFO:teuthology.orchestra.run.smithi146.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-08T20:45:06.241 INFO:teuthology.orchestra.run.smithi146.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-08T20:45:06.255 INFO:teuthology.orchestra.run.smithi146.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-08T20:45:06.257 INFO:teuthology.orchestra.run.smithi146.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-08T20:45:06.257 INFO:teuthology.orchestra.run.smithi146.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-08T20:45:06.275 INFO:teuthology.orchestra.run.smithi146.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-08T20:45:06.275 INFO:teuthology.orchestra.run.smithi146.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-44-g9dcc13bb-1jammy [356 kB] 2023-12-08T20:45:06.277 INFO:teuthology.orchestra.run.smithi146.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-08T20:45:06.318 INFO:teuthology.orchestra.run.smithi146.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-44-g9dcc13bb-1jammy [32.8 kB] 2023-12-08T20:45:06.320 INFO:teuthology.orchestra.run.smithi146.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-44-g9dcc13bb-1jammy [180 kB] 2023-12-08T20:45:06.331 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-08T20:45:06.331 INFO:teuthology.orchestra.run.smithi146.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-08T20:45:06.333 INFO:teuthology.orchestra.run.smithi146.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-08T20:45:06.334 INFO:teuthology.orchestra.run.smithi146.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-08T20:45:06.335 INFO:teuthology.orchestra.run.smithi146.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-08T20:45:06.336 INFO:teuthology.orchestra.run.smithi146.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-08T20:45:06.340 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-08T20:45:06.345 INFO:teuthology.orchestra.run.smithi146.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-44-g9dcc13bb-1jammy [63.5 kB] 2023-12-08T20:45:06.351 INFO:teuthology.orchestra.run.smithi146.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-44-g9dcc13bb-1jammy [330 kB] 2023-12-08T20:45:06.359 INFO:teuthology.orchestra.run.smithi146.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-08T20:45:06.361 INFO:teuthology.orchestra.run.smithi146.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-08T20:45:06.362 INFO:teuthology.orchestra.run.smithi146.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-08T20:45:06.368 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-08T20:45:06.375 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-08T20:45:06.382 INFO:teuthology.orchestra.run.smithi146.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-08T20:45:06.383 INFO:teuthology.orchestra.run.smithi146.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-08T20:45:06.383 INFO:teuthology.orchestra.run.smithi146.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-08T20:45:06.383 INFO:teuthology.orchestra.run.smithi146.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-08T20:45:06.384 INFO:teuthology.orchestra.run.smithi146.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-08T20:45:06.384 INFO:teuthology.orchestra.run.smithi146.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-44-g9dcc13bb-1jammy [6,214 kB] 2023-12-08T20:45:06.384 INFO:teuthology.orchestra.run.smithi146.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-08T20:45:06.397 INFO:teuthology.orchestra.run.smithi146.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-08T20:45:06.397 INFO:teuthology.orchestra.run.smithi146.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-08T20:45:06.400 INFO:teuthology.orchestra.run.smithi146.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-08T20:45:06.417 INFO:teuthology.orchestra.run.smithi146.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-08T20:45:06.418 INFO:teuthology.orchestra.run.smithi146.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-08T20:45:06.418 INFO:teuthology.orchestra.run.smithi146.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-08T20:45:06.422 INFO:teuthology.orchestra.run.smithi146.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-08T20:45:06.424 INFO:teuthology.orchestra.run.smithi146.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-08T20:45:06.425 INFO:teuthology.orchestra.run.smithi146.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-12-08T20:45:06.425 INFO:teuthology.orchestra.run.smithi146.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-12-08T20:45:06.436 INFO:teuthology.orchestra.run.smithi146.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-08T20:45:06.441 INFO:teuthology.orchestra.run.smithi146.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-12-08T20:45:06.441 INFO:teuthology.orchestra.run.smithi146.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-08T20:45:06.456 INFO:teuthology.orchestra.run.smithi146.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-08T20:45:06.456 INFO:teuthology.orchestra.run.smithi146.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-08T20:45:06.457 INFO:teuthology.orchestra.run.smithi146.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-08T20:45:06.457 INFO:teuthology.orchestra.run.smithi146.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-08T20:45:06.459 INFO:teuthology.orchestra.run.smithi146.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-08T20:45:06.461 INFO:teuthology.orchestra.run.smithi146.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-08T20:45:06.466 INFO:teuthology.orchestra.run.smithi146.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-08T20:45:06.475 INFO:teuthology.orchestra.run.smithi146.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-08T20:45:06.475 INFO:teuthology.orchestra.run.smithi146.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-08T20:45:06.478 INFO:teuthology.orchestra.run.smithi146.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-08T20:45:06.494 INFO:teuthology.orchestra.run.smithi146.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-08T20:45:06.540 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-08T20:45:07.021 INFO:teuthology.orchestra.run.smithi146.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-44-g9dcc13bb-1jammy [112 kB] 2023-12-08T20:45:07.032 INFO:teuthology.orchestra.run.smithi146.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-44-g9dcc13bb-1jammy [439 kB] 2023-12-08T20:45:07.072 INFO:teuthology.orchestra.run.smithi146.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-44-g9dcc13bb-1jammy [22.5 MB] 2023-12-08T20:45:07.112 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-12-08T20:45:07.133 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-12-08T20:45:07.195 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-12-08T20:45:07.195 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-44-g9dcc13bb-1jammy [6,901 kB] 2023-12-08T20:45:07.197 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-12-08T20:45:07.198 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-12-08T20:45:07.202 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-12-08T20:45:07.207 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-12-08T20:45:07.219 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-08T20:45:07.223 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-08T20:45:07.223 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-08T20:45:07.393 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-08T20:45:07.437 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-44-g9dcc13bb-1jammy [238 kB] 2023-12-08T20:45:07.443 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-44-g9dcc13bb-1jammy [124 kB] 2023-12-08T20:45:07.445 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-44-g9dcc13bb-1jammy [1,496 kB] 2023-12-08T20:45:07.477 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-08T20:45:07.484 INFO:teuthology.orchestra.run.smithi053.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-08T20:45:07.525 INFO:teuthology.orchestra.run.smithi053.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-44-g9dcc13bb-1jammy [9,953 kB] 2023-12-08T20:45:07.558 INFO:teuthology.orchestra.run.smithi053.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-08T20:45:07.584 INFO:teuthology.orchestra.run.smithi053.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-08T20:45:07.600 INFO:teuthology.orchestra.run.smithi053.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-08T20:45:07.617 INFO:teuthology.orchestra.run.smithi053.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-08T20:45:07.811 INFO:teuthology.orchestra.run.smithi053.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-08T20:45:07.825 INFO:teuthology.orchestra.run.smithi053.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-08T20:45:07.832 INFO:teuthology.orchestra.run.smithi053.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-08T20:45:07.837 INFO:teuthology.orchestra.run.smithi053.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-08T20:45:08.015 INFO:teuthology.orchestra.run.smithi053.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-44-g9dcc13bb-1jammy [31.9 MB] 2023-12-08T20:45:08.021 INFO:teuthology.orchestra.run.smithi053.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-08T20:45:08.104 INFO:teuthology.orchestra.run.smithi053.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-08T20:45:08.120 INFO:teuthology.orchestra.run.smithi053.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-08T20:45:08.305 INFO:teuthology.orchestra.run.smithi053.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-08T20:45:08.356 INFO:teuthology.orchestra.run.smithi053.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-08T20:45:08.370 INFO:teuthology.orchestra.run.smithi053.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-08T20:45:08.528 INFO:teuthology.orchestra.run.smithi053.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-08T20:45:08.529 INFO:teuthology.orchestra.run.smithi053.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-08T20:45:08.534 INFO:teuthology.orchestra.run.smithi053.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-08T20:45:08.539 INFO:teuthology.orchestra.run.smithi053.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-08T20:45:08.553 INFO:teuthology.orchestra.run.smithi053.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-08T20:45:08.737 INFO:teuthology.orchestra.run.smithi053.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-08T20:45:08.992 INFO:teuthology.orchestra.run.smithi053.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-08T20:45:09.064 INFO:teuthology.orchestra.run.smithi146.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-44-g9dcc13bb-1jammy [6,901 kB] 2023-12-08T20:45:09.106 INFO:teuthology.orchestra.run.smithi053.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-08T20:45:09.151 INFO:teuthology.orchestra.run.smithi053.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-08T20:45:09.231 INFO:teuthology.orchestra.run.smithi053.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-08T20:45:09.244 INFO:teuthology.orchestra.run.smithi053.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-08T20:45:09.257 INFO:teuthology.orchestra.run.smithi053.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-08T20:45:09.296 INFO:teuthology.orchestra.run.smithi053.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-08T20:45:09.452 INFO:teuthology.orchestra.run.smithi146.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-44-g9dcc13bb-1jammy [238 kB] 2023-12-08T20:45:09.464 INFO:teuthology.orchestra.run.smithi146.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-44-g9dcc13bb-1jammy [124 kB] 2023-12-08T20:45:09.472 INFO:teuthology.orchestra.run.smithi146.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-44-g9dcc13bb-1jammy [1,496 kB] 2023-12-08T20:45:09.557 INFO:teuthology.orchestra.run.smithi053.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-08T20:45:09.559 INFO:teuthology.orchestra.run.smithi053.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-08T20:45:09.562 INFO:teuthology.orchestra.run.smithi053.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-08T20:45:09.571 INFO:teuthology.orchestra.run.smithi146.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-44-g9dcc13bb-1jammy [9,953 kB] 2023-12-08T20:45:09.726 INFO:teuthology.orchestra.run.smithi053.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-08T20:45:10.047 INFO:teuthology.orchestra.run.smithi053.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-44-g9dcc13bb-1jammy [14.0 kB] 2023-12-08T20:45:10.047 INFO:teuthology.orchestra.run.smithi053.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-44-g9dcc13bb-1jammy [839 kB] 2023-12-08T20:45:10.066 INFO:teuthology.orchestra.run.smithi053.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-44-g9dcc13bb-1jammy [2,144 kB] 2023-12-08T20:45:10.073 INFO:teuthology.orchestra.run.smithi053.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-08T20:45:10.153 INFO:teuthology.orchestra.run.smithi053.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-44-g9dcc13bb-1jammy [831 kB] 2023-12-08T20:45:10.207 INFO:teuthology.orchestra.run.smithi053.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-44-g9dcc13bb-1jammy [139 kB] 2023-12-08T20:45:10.213 INFO:teuthology.orchestra.run.smithi146.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-44-g9dcc13bb-1jammy [31.9 MB] 2023-12-08T20:45:10.215 INFO:teuthology.orchestra.run.smithi053.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-44-g9dcc13bb-1jammy [1,904 kB] 2023-12-08T20:45:10.339 INFO:teuthology.orchestra.run.smithi053.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-44-g9dcc13bb-1jammy [8,625 kB] 2023-12-08T20:45:10.482 INFO:teuthology.orchestra.run.smithi053.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-08T20:45:10.492 INFO:teuthology.orchestra.run.smithi053.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-08T20:45:10.493 INFO:teuthology.orchestra.run.smithi053.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-08T20:45:10.562 INFO:teuthology.orchestra.run.smithi053.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-08T20:45:10.563 INFO:teuthology.orchestra.run.smithi053.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-08T20:45:10.565 INFO:teuthology.orchestra.run.smithi053.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-08T20:45:10.566 INFO:teuthology.orchestra.run.smithi053.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-08T20:45:10.570 INFO:teuthology.orchestra.run.smithi053.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-08T20:45:10.733 INFO:teuthology.orchestra.run.smithi053.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-08T20:45:10.820 INFO:teuthology.orchestra.run.smithi053.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-08T20:45:10.897 INFO:teuthology.orchestra.run.smithi053.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-44-g9dcc13bb-1jammy [14.2 kB] 2023-12-08T20:45:10.898 INFO:teuthology.orchestra.run.smithi053.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-44-g9dcc13bb-1jammy [48.6 MB] 2023-12-08T20:45:10.916 INFO:teuthology.orchestra.run.smithi053.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-08T20:45:11.162 INFO:teuthology.orchestra.run.smithi053.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-08T20:45:11.205 INFO:teuthology.orchestra.run.smithi053.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-08T20:45:11.230 INFO:teuthology.orchestra.run.smithi053.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-08T20:45:11.238 INFO:teuthology.orchestra.run.smithi053.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-08T20:45:11.282 INFO:teuthology.orchestra.run.smithi053.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-08T20:45:11.307 INFO:teuthology.orchestra.run.smithi053.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-08T20:45:11.309 INFO:teuthology.orchestra.run.smithi053.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-12-08T20:45:11.315 INFO:teuthology.orchestra.run.smithi053.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-12-08T20:45:11.483 INFO:teuthology.orchestra.run.smithi053.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-08T20:45:12.019 INFO:teuthology.orchestra.run.smithi053.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-12-08T20:45:12.025 INFO:teuthology.orchestra.run.smithi053.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-08T20:45:12.064 INFO:teuthology.orchestra.run.smithi053.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-08T20:45:12.064 INFO:teuthology.orchestra.run.smithi053.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-08T20:45:12.070 INFO:teuthology.orchestra.run.smithi053.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-08T20:45:12.074 INFO:teuthology.orchestra.run.smithi053.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-08T20:45:12.114 INFO:teuthology.orchestra.run.smithi053.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-08T20:45:12.122 INFO:teuthology.orchestra.run.smithi053.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-08T20:45:12.134 INFO:teuthology.orchestra.run.smithi146.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-44-g9dcc13bb-1jammy [14.0 kB] 2023-12-08T20:45:12.135 INFO:teuthology.orchestra.run.smithi146.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-44-g9dcc13bb-1jammy [839 kB] 2023-12-08T20:45:12.152 INFO:teuthology.orchestra.run.smithi146.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-44-g9dcc13bb-1jammy [2,144 kB] 2023-12-08T20:45:12.191 INFO:teuthology.orchestra.run.smithi146.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-44-g9dcc13bb-1jammy [831 kB] 2023-12-08T20:45:12.195 INFO:teuthology.orchestra.run.smithi053.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-08T20:45:12.196 INFO:teuthology.orchestra.run.smithi053.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-08T20:45:12.235 INFO:teuthology.orchestra.run.smithi146.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-44-g9dcc13bb-1jammy [139 kB] 2023-12-08T20:45:12.240 INFO:teuthology.orchestra.run.smithi146.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-44-g9dcc13bb-1jammy [1,904 kB] 2023-12-08T20:45:12.347 INFO:teuthology.orchestra.run.smithi146.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-44-g9dcc13bb-1jammy [8,625 kB] 2023-12-08T20:45:12.361 INFO:teuthology.orchestra.run.smithi053.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-08T20:45:12.735 INFO:teuthology.orchestra.run.smithi146.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-44-g9dcc13bb-1jammy [14.2 kB] 2023-12-08T20:45:12.735 INFO:teuthology.orchestra.run.smithi146.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-44-g9dcc13bb-1jammy [48.6 MB] 2023-12-08T20:45:12.803 INFO:teuthology.orchestra.run.smithi053.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-08T20:45:12.818 INFO:teuthology.orchestra.run.smithi053.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-08T20:45:15.485 INFO:teuthology.orchestra.run.smithi053.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-44-g9dcc13bb-1jammy [121 kB] 2023-12-08T20:45:15.487 INFO:teuthology.orchestra.run.smithi053.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-44-g9dcc13bb-1jammy [226 kB] 2023-12-08T20:45:15.492 INFO:teuthology.orchestra.run.smithi053.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-44-g9dcc13bb-1jammy [34.0 kB] 2023-12-08T20:45:15.493 INFO:teuthology.orchestra.run.smithi053.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-44-g9dcc13bb-1jammy [23.4 kB] 2023-12-08T20:45:15.521 INFO:teuthology.orchestra.run.smithi146.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-44-g9dcc13bb-1jammy [121 kB] 2023-12-08T20:45:15.524 INFO:teuthology.orchestra.run.smithi146.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-44-g9dcc13bb-1jammy [226 kB] 2023-12-08T20:45:15.529 INFO:teuthology.orchestra.run.smithi146.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-44-g9dcc13bb-1jammy [34.0 kB] 2023-12-08T20:45:15.530 INFO:teuthology.orchestra.run.smithi146.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-44-g9dcc13bb-1jammy [23.4 kB] 2023-12-08T20:45:15.531 INFO:teuthology.orchestra.run.smithi146.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-44-g9dcc13bb-1jammy [38.3 kB] 2023-12-08T20:45:15.532 INFO:teuthology.orchestra.run.smithi146.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-44-g9dcc13bb-1jammy [12.3 MB] 2023-12-08T20:45:15.540 INFO:teuthology.orchestra.run.smithi053.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-44-g9dcc13bb-1jammy [38.3 kB] 2023-12-08T20:45:15.542 INFO:teuthology.orchestra.run.smithi053.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-44-g9dcc13bb-1jammy [12.3 MB] 2023-12-08T20:45:16.035 INFO:teuthology.orchestra.run.smithi146.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-44-g9dcc13bb-1jammy [91.4 kB] 2023-12-08T20:45:16.037 INFO:teuthology.orchestra.run.smithi146.stdout:Get:125 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-44-g9dcc13bb-1jammy [3,048 kB] 2023-12-08T20:45:16.199 INFO:teuthology.orchestra.run.smithi146.stdout:Get:126 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-44-g9dcc13bb-1jammy [180 kB] 2023-12-08T20:45:16.207 INFO:teuthology.orchestra.run.smithi146.stdout:Get:127 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [691 MB] 2023-12-08T20:45:16.479 INFO:teuthology.orchestra.run.smithi053.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-44-g9dcc13bb-1jammy [91.4 kB] 2023-12-08T20:45:16.481 INFO:teuthology.orchestra.run.smithi053.stdout:Get:125 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-44-g9dcc13bb-1jammy [3,048 kB] 2023-12-08T20:45:16.709 INFO:teuthology.orchestra.run.smithi053.stdout:Get:126 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-44-g9dcc13bb-1jammy [180 kB] 2023-12-08T20:45:16.722 INFO:teuthology.orchestra.run.smithi053.stdout:Get:127 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [691 MB] 2023-12-08T20:45:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:Get:128 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [17.3 MB] 2023-12-08T20:45:53.235 INFO:teuthology.orchestra.run.smithi146.stdout:Get:129 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [75.6 MB] 2023-12-08T20:45:57.767 INFO:teuthology.orchestra.run.smithi146.stdout:Get:130 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [39.8 MB] 2023-12-08T20:45:59.765 INFO:teuthology.orchestra.run.smithi146.stdout:Get:131 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [47.7 MB] 2023-12-08T20:46:02.214 INFO:teuthology.orchestra.run.smithi146.stdout:Get:132 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [247 MB] 2023-12-08T20:46:16.891 INFO:teuthology.orchestra.run.smithi146.stdout:Get:133 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [916 MB] 2023-12-08T20:46:34.148 INFO:teuthology.orchestra.run.smithi053.stdout:Get:128 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [17.3 MB] 2023-12-08T20:46:36.083 INFO:teuthology.orchestra.run.smithi053.stdout:Get:129 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [75.6 MB] 2023-12-08T20:46:44.418 INFO:teuthology.orchestra.run.smithi053.stdout:Get:130 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [39.8 MB] 2023-12-08T20:46:56.776 INFO:teuthology.orchestra.run.smithi053.stdout:Get:131 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [47.7 MB] 2023-12-08T20:47:11.695 INFO:teuthology.orchestra.run.smithi053.stdout:Get:132 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [247 MB] 2023-12-08T20:47:20.606 INFO:teuthology.orchestra.run.smithi146.stdout:Get:134 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [15.6 MB] 2023-12-08T20:47:21.354 INFO:teuthology.orchestra.run.smithi146.stdout:Get:135 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [79.2 MB] 2023-12-08T20:47:26.613 INFO:teuthology.orchestra.run.smithi146.stdout:Get:136 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [10.5 MB] 2023-12-08T20:47:27.107 INFO:teuthology.orchestra.run.smithi146.stdout:Get:137 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [98.4 MB] 2023-12-08T20:47:33.813 INFO:teuthology.orchestra.run.smithi146.stdout:Get:138 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [166 MB] 2023-12-08T20:47:39.502 INFO:teuthology.orchestra.run.smithi053.stdout:Get:133 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [916 MB] 2023-12-08T20:47:43.485 INFO:teuthology.orchestra.run.smithi146.stdout:Get:139 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [323 MB] 2023-12-08T20:48:09.664 INFO:teuthology.orchestra.run.smithi146.stdout:Get:140 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [1,684 kB] 2023-12-08T20:48:09.695 INFO:teuthology.orchestra.run.smithi146.stdout:Get:141 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [93.5 MB] 2023-12-08T20:48:15.269 INFO:teuthology.orchestra.run.smithi146.stdout:Get:142 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [2,947 kB] 2023-12-08T20:48:15.946 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 3,015 MB in 3min 10s (15.9 MB/s) 2023-12-08T20:48:16.066 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-08T20:48:16.162 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165989 files and directories currently installed.) 2023-12-08T20:48:16.168 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-08T20:48:16.206 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-08T20:48:16.484 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-08T20:48:16.510 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-08T20:48:16.550 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-08T20:48:16.853 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cmd2. 2023-12-08T20:48:16.879 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-08T20:48:16.920 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-08T20:48:17.264 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-08T20:48:17.290 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-08T20:48:17.381 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-08T20:48:17.693 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-08T20:48:17.719 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-08T20:48:17.751 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-08T20:48:18.079 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-08T20:48:18.105 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-08T20:48:18.145 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-08T20:48:18.616 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-08T20:48:18.642 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-08T20:48:18.690 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T20:48:19.093 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-08T20:48:19.120 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-08T20:48:19.160 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T20:48:19.480 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-08T20:48:19.506 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-08T20:48:19.546 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T20:48:19.833 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-08T20:48:19.859 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-08T20:48:19.891 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-08T20:48:20.210 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librados2. 2023-12-08T20:48:20.237 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../010-librados2_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:20.277 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librados2 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:20.754 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librbd1. 2023-12-08T20:48:20.781 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../011-librbd1_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:20.821 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librbd1 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:21.216 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs2. 2023-12-08T20:48:21.242 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:21.274 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs2 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:21.509 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rados. 2023-12-08T20:48:21.525 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../013-python3-rados_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:21.576 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rados (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:21.896 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-08T20:48:21.922 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:48:21.962 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-ceph-argparse (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:22.231 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cephfs. 2023-12-08T20:48:22.257 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:22.297 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cephfs (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:22.593 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-08T20:48:22.618 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:48:22.659 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-ceph-common (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:22.978 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-prettytable. 2023-12-08T20:48:23.004 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-08T20:48:23.036 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-08T20:48:23.264 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rbd. 2023-12-08T20:48:23.279 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:23.322 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rbd (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:23.634 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-08T20:48:23.660 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-08T20:48:23.700 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-08T20:48:23.944 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-12-08T20:48:23.962 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-12-08T20:48:24.002 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-12-08T20:48:24.305 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-12-08T20:48:24.322 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-12-08T20:48:24.363 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-08T20:48:24.692 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package lua5.1. 2023-12-08T20:48:24.718 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-12-08T20:48:24.759 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-12-08T20:48:25.053 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package lua-any. 2023-12-08T20:48:25.068 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-12-08T20:48:25.103 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking lua-any (27ubuntu1) ... 2023-12-08T20:48:25.338 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package zip. 2023-12-08T20:48:25.354 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-12-08T20:48:25.396 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking zip (3.0-12build2) ... 2023-12-08T20:48:25.742 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package unzip. 2023-12-08T20:48:25.768 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-12-08T20:48:25.808 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-12-08T20:48:26.195 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package luarocks. 2023-12-08T20:48:26.221 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-12-08T20:48:26.261 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-12-08T20:48:26.644 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librgw2. 2023-12-08T20:48:26.670 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../027-librgw2_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:26.710 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librgw2 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:27.213 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rgw. 2023-12-08T20:48:27.236 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:27.271 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rgw (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:27.599 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-08T20:48:27.626 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-08T20:48:27.666 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-08T20:48:27.954 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libradosstriper1. 2023-12-08T20:48:27.979 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:28.018 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libradosstriper1 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:28.463 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-common. 2023-12-08T20:48:28.489 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../031-ceph-common_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:28.529 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-common (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:29.777 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-base. 2023-12-08T20:48:29.803 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../032-ceph-base_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:29.853 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-base (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:30.547 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-08T20:48:30.573 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-08T20:48:30.613 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-08T20:48:30.918 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cheroot. 2023-12-08T20:48:30.945 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-08T20:48:30.985 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-08T20:48:31.296 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-08T20:48:31.323 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-08T20:48:31.363 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-08T20:48:31.632 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-08T20:48:31.659 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-08T20:48:31.698 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-08T20:48:32.001 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-08T20:48:32.028 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-08T20:48:32.068 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-08T20:48:32.371 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-tempora. 2023-12-08T20:48:32.397 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-12-08T20:48:32.437 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-08T20:48:32.706 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-portend. 2023-12-08T20:48:32.722 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-12-08T20:48:32.756 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-08T20:48:33.384 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-08T20:48:33.411 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-08T20:48:33.451 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-08T20:48:33.754 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-08T20:48:33.780 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-08T20:48:33.820 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-08T20:48:34.174 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-natsort. 2023-12-08T20:48:34.200 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-12-08T20:48:34.240 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-08T20:48:34.527 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-logutils. 2023-12-08T20:48:34.553 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-12-08T20:48:34.593 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-08T20:48:34.896 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-08T20:48:34.922 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-08T20:48:34.962 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-08T20:48:35.273 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-mako. 2023-12-08T20:48:35.300 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-08T20:48:35.340 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-08T20:48:35.661 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-08T20:48:35.686 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-08T20:48:35.726 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-08T20:48:35.988 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-08T20:48:36.014 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-08T20:48:36.054 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-08T20:48:36.357 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webob. 2023-12-08T20:48:36.383 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-08T20:48:36.441 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-08T20:48:36.776 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-waitress. 2023-12-08T20:48:36.802 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-08T20:48:36.856 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-08T20:48:37.162 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-tempita. 2023-12-08T20:48:37.189 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-08T20:48:37.229 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-08T20:48:37.548 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-paste. 2023-12-08T20:48:37.575 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-08T20:48:37.615 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-08T20:48:37.934 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-08T20:48:37.962 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-08T20:48:38.009 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-08T20:48:38.312 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-08T20:48:38.339 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-08T20:48:38.379 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-08T20:48:38.665 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webtest. 2023-12-08T20:48:38.694 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-12-08T20:48:38.731 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-08T20:48:39.042 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pecan. 2023-12-08T20:48:39.069 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-08T20:48:39.109 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-08T20:48:39.464 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-certifi. 2023-12-08T20:48:39.490 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-12-08T20:48:39.530 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-08T20:48:39.858 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-idna. 2023-12-08T20:48:39.885 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-12-08T20:48:39.924 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-08T20:48:40.269 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-urllib3. 2023-12-08T20:48:40.296 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-08T20:48:40.336 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-08T20:48:40.647 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-requests. 2023-12-08T20:48:40.674 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-08T20:48:40.713 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-08T20:48:40.974 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-08T20:48:40.990 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-08T20:48:41.033 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-08T20:48:41.319 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-08T20:48:41.334 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:48:41.377 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-modules-core (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:41.724 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-08T20:48:41.739 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:41.773 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:42.059 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-08T20:48:42.086 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-08T20:48:42.126 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-08T20:48:42.429 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-openssl. 2023-12-08T20:48:42.455 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-12-08T20:48:42.495 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-08T20:48:42.831 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr. 2023-12-08T20:48:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:43.226 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mon. 2023-12-08T20:48:43.253 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:43.284 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mon (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:44.221 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-osd. 2023-12-08T20:48:44.247 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:44.287 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-osd (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:46.090 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph. 2023-12-08T20:48:46.117 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../068-ceph_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:46.157 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:46.476 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-fuse. 2023-12-08T20:48:46.502 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:46.550 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-fuse (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:46.870 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mds. 2023-12-08T20:48:46.898 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:46.937 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mds (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:47.356 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephadm. 2023-12-08T20:48:47.383 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../071-cephadm_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:48:47.423 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephadm (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-08T20:48:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-08T20:48:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-08T20:48:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-08T20:48:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-08T20:48:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-08T20:48:49.241 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-babel. 2023-12-08T20:48:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-08T20:48:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-08T20:48:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jinja2. 2023-12-08T20:48:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-12-08T20:48:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-08T20:48:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-08T20:48:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:48:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-cephadm (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-08T20:48:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-12-08T20:48:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-08T20:48:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-routes. 2023-12-08T20:48:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-08T20:48:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-08T20:48:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-08T20:48:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:48:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-dashboard (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-08T20:48:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-08T20:48:51.732 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-08T20:48:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-joblib. 2023-12-08T20:48:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-08T20:48:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-08T20:48:52.656 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-08T20:48:52.672 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-08T20:48:52.791 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-08T20:48:53.094 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-sklearn. 2023-12-08T20:48:53.121 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-08T20:48:53.160 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-08T20:48:53.853 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-08T20:48:53.880 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:48:53.922 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:54.872 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cachetools. 2023-12-08T20:48:54.899 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-12-08T20:48:54.938 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-08T20:48:55.224 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-08T20:48:55.252 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-08T20:48:55.291 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-08T20:48:55.603 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-08T20:48:55.618 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-08T20:48:55.652 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-08T20:48:55.964 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rsa. 2023-12-08T20:48:55.979 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-12-08T20:48:56.022 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-08T20:48:56.350 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-google-auth. 2023-12-08T20:48:56.378 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-12-08T20:48:56.417 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-08T20:48:56.737 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-08T20:48:56.764 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-08T20:48:56.795 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-08T20:48:57.090 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-websocket. 2023-12-08T20:48:57.117 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-12-08T20:48:57.156 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-08T20:48:57.476 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-08T20:48:57.503 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-08T20:48:57.542 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-08T20:48:58.156 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-08T20:48:58.172 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:48:58.214 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:48:58.534 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-08T20:48:58.562 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-08T20:48:58.600 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-08T20:48:58.920 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-08T20:48:58.947 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-08T20:48:58.987 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-08T20:48:59.247 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package jq. 2023-12-08T20:48:59.263 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-08T20:48:59.305 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-08T20:48:59.558 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package socat. 2023-12-08T20:48:59.585 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-08T20:48:59.624 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-08T20:48:59.928 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package xmlstarlet. 2023-12-08T20:48:59.944 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-08T20:48:59.986 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-08T20:49:00.340 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-test. 2023-12-08T20:49:00.356 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../099-ceph-test_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:00.398 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-test (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:02.552 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-volume. 2023-12-08T20:49:02.579 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:49:02.618 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-volume (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:02.989 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-08T20:49:03.017 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:03.056 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephfs-mirror (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:03.350 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-colorama. 2023-12-08T20:49:03.378 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-12-08T20:49:03.416 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-08T20:49:03.678 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephfs-shell. 2023-12-08T20:49:03.705 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:49:03.744 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephfs-shell (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephfs-top. 2023-12-08T20:49:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:49:04.054 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephfs-top (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:04.307 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-08T20:49:04.335 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:04.374 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs-dev (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:04.659 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package lua-socket:amd64. 2023-12-08T20:49:04.687 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-12-08T20:49:04.718 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-08T20:49:05.097 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package lua-sec:amd64. 2023-12-08T20:49:05.125 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-12-08T20:49:05.164 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-12-08T20:49:05.535 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package nvme-cli. 2023-12-08T20:49:05.561 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-08T20:49:05.600 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-08T20:49:06.022 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package pkg-config. 2023-12-08T20:49:06.050 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-12-08T20:49:06.088 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-12-08T20:49:06.341 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-08T20:49:06.357 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-08T20:49:06.391 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-08T20:49:06.820 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-08T20:49:06.847 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-08T20:49:06.877 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-08T20:49:07.138 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pastescript. 2023-12-08T20:49:07.166 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-12-08T20:49:07.205 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-08T20:49:07.508 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pluggy. 2023-12-08T20:49:07.536 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-08T20:49:07.574 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-08T20:49:07.894 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-psutil. 2023-12-08T20:49:07.921 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-08T20:49:07.960 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-08T20:49:08.280 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-py. 2023-12-08T20:49:08.308 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-12-08T20:49:08.346 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-08T20:49:08.700 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pygments. 2023-12-08T20:49:08.727 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-08T20:49:08.766 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-08T20:49:09.206 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-08T20:49:09.233 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-08T20:49:09.272 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-08T20:49:09.583 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-toml. 2023-12-08T20:49:09.610 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-12-08T20:49:09.649 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-08T20:49:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pytest. 2023-12-08T20:49:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-08T20:49:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-08T20:49:10.347 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-simplejson. 2023-12-08T20:49:10.375 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-08T20:49:10.414 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-08T20:49:10.674 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-08T20:49:10.690 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-08T20:49:10.733 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-08T20:49:11.437 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package radosgw. 2023-12-08T20:49:11.465 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../122-radosgw_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:11.503 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking radosgw (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:12.264 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package rbd-fuse. 2023-12-08T20:49:12.280 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:12.314 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking rbd-fuse (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:12.625 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package rbd-mirror. 2023-12-08T20:49:12.653 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:12.692 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking rbd-mirror (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:13.111 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package rbd-nbd. 2023-12-08T20:49:13.139 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:13.177 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking rbd-nbd (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:13.447 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-common-dbg. 2023-12-08T20:49:13.474 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:13.513 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-common-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:20.618 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-fuse-dbg. 2023-12-08T20:49:20.645 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:20.683 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-fuse-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:21.136 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mds-dbg. 2023-12-08T20:49:21.151 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:21.194 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mds-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:22.138 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-dbg. 2023-12-08T20:49:22.166 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:22.205 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:22.833 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mon-dbg. 2023-12-08T20:49:22.848 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:22.882 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mon-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:23.793 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-osd-dbg. 2023-12-08T20:49:23.821 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:23.859 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-osd-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:26.268 INFO:teuthology.orchestra.run.smithi053.stdout:Get:134 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [15.6 MB] 2023-12-08T20:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout:Get:135 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [79.2 MB] 2023-12-08T20:49:26.920 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-test-dbg. 2023-12-08T20:49:26.936 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:26.979 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-test-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:29.858 INFO:teuthology.orchestra.run.smithi053.stdout:Get:136 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [10.5 MB] 2023-12-08T20:49:30.151 INFO:teuthology.orchestra.run.smithi053.stdout:Get:137 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [98.4 MB] 2023-12-08T20:49:34.288 INFO:teuthology.orchestra.run.smithi053.stdout:Get:138 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [166 MB] 2023-12-08T20:49:35.753 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs2-dbg. 2023-12-08T20:49:35.780 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:35.819 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs2-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:36.246 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librados2-dbg. 2023-12-08T20:49:36.263 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:36.305 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librados2-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:37.349 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libradosstriper1-dbg. 2023-12-08T20:49:37.377 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:37.407 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libradosstriper1-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:37.785 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librbd1-dbg. 2023-12-08T20:49:37.813 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:37.851 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librbd1-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:39.121 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librgw2-dbg. 2023-12-08T20:49:39.149 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:39.187 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librgw2-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:40.481 INFO:teuthology.orchestra.run.smithi053.stdout:Get:139 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [323 MB] 2023-12-08T20:49:40.931 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package radosgw-dbg. 2023-12-08T20:49:40.959 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:40.989 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking radosgw-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:44.167 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package rbd-fuse-dbg. 2023-12-08T20:49:44.191 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:44.233 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking rbd-fuse-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:44.536 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package rbd-mirror-dbg. 2023-12-08T20:49:44.552 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:44.594 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking rbd-mirror-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:45.755 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package rbd-nbd-dbg. 2023-12-08T20:49:45.771 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:49:45.813 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking rbd-nbd-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:46.159 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-08T20:49:46.410 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-08T20:49:46.536 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-08T20:49:46.797 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-08T20:49:47.127 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-08T20:49:47.568 INFO:teuthology.orchestra.run.smithi146.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-08T20:49:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephadm (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:48.629 INFO:teuthology.orchestra.run.smithi146.stdout:Adding system user cephadm....done 2023-12-08T20:49:48.852 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-08T20:49:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-08T20:49:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-08T20:49:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-08T20:49:49.808 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-08T20:49:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-08T20:49:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-08T20:49:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-08T20:49:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-08T20:49:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-08T20:49:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-08T20:49:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-12-08T20:49:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-08T20:49:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-08T20:49:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-08T20:49:52.752 INFO:teuthology.orchestra.run.smithi053.stdout:Get:140 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [1,684 kB] 2023-12-08T20:49:52.783 INFO:teuthology.orchestra.run.smithi053.stdout:Get:141 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [93.5 MB] 2023-12-08T20:49:52.797 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-ceph-argparse (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:49:53.048 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-08T20:49:53.166 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-08T20:49:53.292 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-08T20:49:53.543 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-12-08T20:49:53.669 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-08T20:49:53.920 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-12-08T20:49:54.392 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-12-08T20:49:54.427 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-12-08T20:49:54.490 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-08T20:49:54.616 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-08T20:49:54.967 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-08T20:49:55.101 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-08T20:49:55.377 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-08T20:49:55.637 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-08T20:49:55.946 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up zip (3.0-12build2) ... 2023-12-08T20:49:56.072 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-08T20:49:56.286 INFO:teuthology.orchestra.run.smithi053.stdout:Get:142 https://4.chacra.ceph.com/r/ceph/main/9dcc13bb80dcc1cdea72b04d80505b4649a2b882/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-44-g9dcc13bb-1jammy [2,947 kB] 2023-12-08T20:49:56.774 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-08T20:49:56.997 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 3,015 MB in 4min 51s (10.3 MB/s) 2023-12-08T20:49:57.028 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-08T20:49:57.091 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-08T20:49:57.134 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-08T20:49:57.147 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165989 files and directories currently installed.) 2023-12-08T20:49:57.152 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-08T20:49:57.190 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-08T20:49:57.261 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-08T20:49:57.470 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-08T20:49:57.495 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-08T20:49:57.544 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-08T20:49:57.562 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-08T20:49:57.863 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cmd2. 2023-12-08T20:49:57.890 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-08T20:49:57.930 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-08T20:49:57.946 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-08T20:49:58.197 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-08T20:49:58.275 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-08T20:49:58.302 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-08T20:49:58.375 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-08T20:49:58.574 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-08T20:49:58.720 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-08T20:49:58.747 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-08T20:49:58.787 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-08T20:49:58.875 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-08T20:49:59.115 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-08T20:49:59.142 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-08T20:49:59.176 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-08T20:49:59.181 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-08T20:49:59.511 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-08T20:49:59.593 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-08T20:49:59.620 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-08T20:49:59.668 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T20:49:59.762 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-08T20:49:59.888 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-ceph-common (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:00.073 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-08T20:50:00.099 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-08T20:50:00.138 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T20:50:00.189 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-idna (3.3-1) ... 2023-12-08T20:50:00.475 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-08T20:50:00.502 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-08T20:50:00.506 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-08T20:50:00.541 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T20:50:00.836 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-08T20:50:00.863 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-08T20:50:00.896 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-08T20:50:01.199 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librados2. 2023-12-08T20:50:01.224 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../010-librados2_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:01.264 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librados2 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:01.729 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-12-08T20:50:01.759 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librbd1. 2023-12-08T20:50:01.786 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../011-librbd1_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:01.825 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librbd1 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:01.997 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T20:50:02.131 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-08T20:50:02.270 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libcephfs2. 2023-12-08T20:50:02.286 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:02.320 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libcephfs2 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:02.424 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-08T20:50:02.534 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-08T20:50:02.573 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rados. 2023-12-08T20:50:02.597 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../013-python3-rados_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:02.631 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rados (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:02.668 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-08T20:50:02.934 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-08T20:50:02.961 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:50:02.969 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-08T20:50:03.001 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-ceph-argparse (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:03.229 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-08T20:50:03.262 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cephfs. 2023-12-08T20:50:03.290 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:03.329 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cephfs (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:03.480 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T20:50:03.606 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-08T20:50:03.639 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-08T20:50:03.667 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:50:03.706 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-ceph-common (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-08T20:50:04.059 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-prettytable. 2023-12-08T20:50:04.086 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-08T20:50:04.126 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-08T20:50:04.158 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-08T20:50:04.362 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rbd. 2023-12-08T20:50:04.388 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:04.409 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-08T20:50:04.420 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rbd (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:04.661 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-08T20:50:04.765 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-08T20:50:04.792 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-08T20:50:04.831 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-08T20:50:04.911 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-08T20:50:05.126 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-12-08T20:50:05.153 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-12-08T20:50:05.171 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-08T20:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-12-08T20:50:05.297 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-08T20:50:05.504 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-12-08T20:50:05.520 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-12-08T20:50:05.554 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-08T20:50:05.581 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-08T20:50:05.708 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-08T20:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package lua5.1. 2023-12-08T20:50:05.884 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-12-08T20:50:05.924 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-12-08T20:50:06.025 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-08T20:50:06.237 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package lua-any. 2023-12-08T20:50:06.262 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-12-08T20:50:06.302 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking lua-any (27ubuntu1) ... 2023-12-08T20:50:06.326 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-08T20:50:06.538 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package zip. 2023-12-08T20:50:06.554 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-12-08T20:50:06.577 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-08T20:50:06.588 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking zip (3.0-12build2) ... 2023-12-08T20:50:06.704 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-12-08T20:50:06.829 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-08T20:50:06.866 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package unzip. 2023-12-08T20:50:06.893 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-12-08T20:50:06.918 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-08T20:50:06.933 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-12-08T20:50:07.156 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-08T20:50:07.282 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-08T20:50:07.345 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package luarocks. 2023-12-08T20:50:07.372 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-12-08T20:50:07.414 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-12-08T20:50:07.658 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-08T20:50:07.778 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librgw2. 2023-12-08T20:50:07.805 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../027-librgw2_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:07.853 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librgw2 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:07.917 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up lua-any (27ubuntu1) ... 2023-12-08T20:50:08.044 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-08T20:50:08.303 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T20:50:08.356 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rgw. 2023-12-08T20:50:08.372 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:08.429 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-08T20:50:08.432 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rgw (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:08.747 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-08T20:50:08.750 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-08T20:50:08.777 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-08T20:50:08.817 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-08T20:50:09.056 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-08T20:50:09.128 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libradosstriper1. 2023-12-08T20:50:09.155 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:09.195 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libradosstriper1 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:09.324 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-08T20:50:09.535 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-08T20:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-common. 2023-12-08T20:50:09.659 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../031-ceph-common_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:09.690 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-common (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:09.828 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-08T20:50:10.104 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-08T20:50:10.364 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-08T20:50:10.741 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-08T20:50:10.979 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-base. 2023-12-08T20:50:11.006 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../032-ceph-base_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:11.009 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-08T20:50:11.055 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-base (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:11.345 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-08T20:50:11.471 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librados2 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:11.597 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libsqlite3-mod-ceph (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:11.724 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-12-08T20:50:11.775 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-08T20:50:11.791 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-08T20:50:11.833 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-08T20:50:12.051 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs2 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:12.136 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cheroot. 2023-12-08T20:50:12.163 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-08T20:50:12.193 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libradosstriper1 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:12.202 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-08T20:50:12.319 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-08T20:50:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-08T20:50:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-08T20:50:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-08T20:50:12.604 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librados2-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:12.730 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librbd1 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:12.808 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-08T20:50:12.825 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-08T20:50:12.856 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs2-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-08T20:50:12.985 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-modules-core (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:13.108 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-fuse (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-08T20:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-08T20:50:13.220 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-08T20:50:13.347 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-08T20:50:13.347 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-08T20:50:13.506 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-tempora. 2023-12-08T20:50:13.533 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-12-08T20:50:13.573 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-08T20:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-portend. 2023-12-08T20:50:13.851 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libradosstriper1-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:13.862 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-12-08T20:50:13.892 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-08T20:50:13.977 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs-dev (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:14.103 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-fuse-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:14.195 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-08T20:50:14.222 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-08T20:50:14.229 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rados (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:14.262 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-08T20:50:14.355 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librgw2 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:14.480 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephfs-top (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:14.573 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-08T20:50:14.601 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-08T20:50:14.606 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-08T20:50:14.640 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-08T20:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-natsort. 2023-12-08T20:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-12-08T20:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-08T20:50:15.389 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-logutils. 2023-12-08T20:50:15.416 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-12-08T20:50:15.455 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-08T20:50:15.758 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-08T20:50:15.785 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-08T20:50:15.825 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-08T20:50:15.835 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librbd1-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:15.963 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rbd (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:16.086 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-mako. 2023-12-08T20:50:16.087 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librgw2-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:16.113 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-08T20:50:16.152 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-08T20:50:16.213 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up rbd-fuse (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:16.339 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up rbd-nbd (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:16.465 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rgw (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:16.489 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-08T20:50:16.516 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-08T20:50:16.556 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-08T20:50:16.591 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cephfs (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:16.700 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up rbd-nbd-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:16.842 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-08T20:50:16.869 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-08T20:50:16.876 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephfs-shell (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:16.908 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-08T20:50:17.002 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up rbd-fuse-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:17.128 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-common (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:17.320 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-webob. 2023-12-08T20:50:17.347 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-08T20:50:17.386 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-08T20:50:17.696 INFO:teuthology.orchestra.run.smithi146.stdout:Adding group ceph....done 2023-12-08T20:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-waitress. 2023-12-08T20:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-08T20:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-08T20:50:18.074 INFO:teuthology.orchestra.run.smithi146.stdout:Adding system user ceph....done 2023-12-08T20:50:18.076 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-tempita. 2023-12-08T20:50:18.103 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-08T20:50:18.142 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-08T20:50:18.253 INFO:teuthology.orchestra.run.smithi146.stdout:Setting system user ceph properties....done 2023-12-08T20:50:18.273 INFO:teuthology.orchestra.run.smithi146.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-08T20:50:18.402 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-08T20:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-paste. 2023-12-08T20:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-08T20:50:18.537 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-08T20:50:18.730 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-08T20:50:18.859 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-08T20:50:18.875 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-08T20:50:18.917 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-08T20:50:19.170 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-08T20:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-08T20:50:19.215 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephfs-mirror (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:19.236 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-08T20:50:19.423 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-08T20:50:19.423 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-08T20:50:19.548 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-webtest. 2023-12-08T20:50:19.575 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-12-08T20:50:19.614 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-08T20:50:19.908 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-test (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pecan. 2023-12-08T20:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-08T20:50:19.984 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-08T20:50:20.025 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up radosgw (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:20.347 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-certifi. 2023-12-08T20:50:20.374 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-12-08T20:50:20.413 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-08T20:50:20.469 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-08T20:50:20.470 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-08T20:50:20.758 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-idna. 2023-12-08T20:50:20.785 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-12-08T20:50:20.824 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-08T20:50:20.910 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-base (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:21.069 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-urllib3. 2023-12-08T20:50:21.085 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-08T20:50:21.127 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-08T20:50:21.261 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-08T20:50:21.389 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-requests. 2023-12-08T20:50:21.416 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-08T20:50:21.497 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-08T20:50:21.841 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-08T20:50:21.869 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-08T20:50:21.908 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-08T20:50:21.929 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mds (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:22.179 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-08T20:50:22.180 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-08T20:50:22.202 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-08T20:50:22.220 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:50:22.260 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-modules-core (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:22.641 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-08T20:50:22.668 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:22.681 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-common-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:22.699 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:22.807 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up rbd-mirror (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:23.001 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-08T20:50:23.016 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-12-08T20:50:23.016 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-12-08T20:50:23.029 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-08T20:50:23.069 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-08T20:50:23.354 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-openssl. 2023-12-08T20:50:23.381 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-12-08T20:50:23.420 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-08T20:50:23.525 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:23.737 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-08T20:50:23.737 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-08T20:50:23.757 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr. 2023-12-08T20:50:23.784 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:23.823 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:24.160 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mon. 2023-12-08T20:50:24.176 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:24.218 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mon (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:24.259 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mds-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:24.394 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up radosgw-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:24.528 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-test-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:24.654 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-osd (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:24.937 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-08T20:50:24.937 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-08T20:50:25.305 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-osd. 2023-12-08T20:50:25.332 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:25.371 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-osd (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:25.464 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:25.590 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-osd-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:25.716 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up rbd-mirror-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:25.825 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-k8sevents (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:25.951 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:26.102 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mon (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:26.315 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-08T20:50:26.315 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-08T20:50:26.820 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-cephadm (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:26.972 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:27.100 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-dashboard (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:27.240 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mon-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:27.383 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-volume (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:27.408 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph. 2023-12-08T20:50:27.435 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../068-ceph_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:27.474 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:27.728 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-12-08T20:50:27.752 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-fuse. 2023-12-08T20:50:27.779 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:27.810 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-fuse (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:27.853 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-08T20:50:28.006 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-08T20:50:28.163 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mds. 2023-12-08T20:50:28.191 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:28.229 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mds (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:28.641 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephadm. 2023-12-08T20:50:28.669 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../071-cephadm_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:28.708 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephadm (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-08T20:50:29.031 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-08T20:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-08T20:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-08T20:50:29.379 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-08T20:50:29.407 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-08T20:50:29.446 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-08T20:50:29.692 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-08T20:50:29.696 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-08T20:50:29.792 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-12-08T20:50:29.982 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-12-08T20:50:29.982 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-12-08T20:50:30.156 INFO:teuthology.orchestra.run.smithi146.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-08T20:50:30.156 INFO:teuthology.orchestra.run.smithi146.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-08T20:50:30.156 INFO:teuthology.orchestra.run.smithi146.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-08T20:50:30.156 INFO:teuthology.orchestra.run.smithi146.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-08T20:50:30.156 INFO:teuthology.orchestra.run.smithi146.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-08T20:50:30.156 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-12-08T20:50:30.156 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-08T20:50:30.156 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-08T20:50:30.156 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-08T20:50:30.157 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-08T20:50:30.157 INFO:teuthology.orchestra.run.smithi146.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-08T20:50:30.157 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-08T20:50:30.157 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2023-12-08T20:50:30.158 INFO:teuthology.orchestra.run.smithi146.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-08T20:50:30.158 INFO:teuthology.orchestra.run.smithi146.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-08T20:50:30.158 INFO:teuthology.orchestra.run.smithi146.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-08T20:50:30.158 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-08T20:50:30.158 INFO:teuthology.orchestra.run.smithi146.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-08T20:50:30.159 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2023-12-08T20:50:30.159 INFO:teuthology.orchestra.run.smithi146.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-08T20:50:30.159 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-08T20:50:30.160 INFO:teuthology.orchestra.run.smithi146.stdout: libengine-pkcs11-openssl 2023-12-08T20:50:30.196 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2023-12-08T20:50:30.197 INFO:teuthology.orchestra.run.smithi146.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-08T20:50:30.197 INFO:teuthology.orchestra.run.smithi146.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-08T20:50:30.198 INFO:teuthology.orchestra.run.smithi146.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-08T20:50:30.198 INFO:teuthology.orchestra.run.smithi146.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-08T20:50:30.198 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-08T20:50:30.198 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-08T20:50:30.198 INFO:teuthology.orchestra.run.smithi146.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-08T20:50:30.199 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be upgraded: 2023-12-08T20:50:30.199 INFO:teuthology.orchestra.run.smithi146.stdout: libssl3 2023-12-08T20:50:30.250 INFO:teuthology.orchestra.run.smithi146.stdout:1 upgraded, 39 newly installed, 0 to remove and 262 not upgraded. 2023-12-08T20:50:30.251 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 54.6 MB of archives. 2023-12-08T20:50:30.251 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-08T20:50:30.251 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-08T20:50:30.350 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-08T20:50:30.410 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-08T20:50:30.424 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-08T20:50:30.426 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-08T20:50:30.428 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-08T20:50:30.429 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-08T20:50:30.430 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-08T20:50:30.431 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-08T20:50:30.433 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-08T20:50:30.433 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-08T20:50:30.434 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-08T20:50:30.448 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-08T20:50:30.476 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-babel. 2023-12-08T20:50:30.504 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-08T20:50:30.542 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-08T20:50:30.758 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-08T20:50:30.760 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-08T20:50:30.761 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-08T20:50:30.763 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-08T20:50:30.764 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-08T20:50:30.768 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-08T20:50:30.804 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-08T20:50:30.812 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-08T20:50:30.812 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-08T20:50:30.837 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-08T20:50:30.837 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-08T20:50:30.848 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-08T20:50:30.853 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jinja2. 2023-12-08T20:50:30.869 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-08T20:50:30.872 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-08T20:50:30.872 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-08T20:50:30.873 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-08T20:50:30.873 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-08T20:50:30.881 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-12-08T20:50:30.883 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-08T20:50:30.885 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-08T20:50:30.921 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-08T20:50:31.083 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-08T20:50:31.083 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-08T20:50:31.083 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-08T20:50:31.083 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-08T20:50:31.083 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-08T20:50:31.083 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-08T20:50:31.095 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-08T20:50:31.095 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-08T20:50:31.273 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-08T20:50:31.300 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:50:31.339 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-cephadm (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:31.496 INFO:teuthology.orchestra.run.smithi146.stdout:Preconfiguring packages ... 2023-12-08T20:50:31.648 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 54.6 MB in 1s (61.4 MB/s) 2023-12-08T20:50:31.726 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-08T20:50:31.753 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-12-08T20:50:31.792 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-08T20:50:31.796 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package flex. 2023-12-08T20:50:31.895 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173899 files and directories currently installed.) 2023-12-08T20:50:31.901 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-08T20:50:31.970 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-08T20:50:32.104 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-routes. 2023-12-08T20:50:32.131 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-08T20:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-08T20:50:32.498 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-08T20:50:32.520 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-08T20:50:32.526 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:50:32.565 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-dashboard (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:32.684 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-08T20:50:32.993 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-08T20:50:33.010 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-08T20:50:33.051 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-08T20:50:33.087 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-08T20:50:33.530 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-joblib. 2023-12-08T20:50:33.557 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-08T20:50:33.596 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-08T20:50:33.661 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package bison. 2023-12-08T20:50:33.765 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173972 files and directories currently installed.) 2023-12-08T20:50:33.771 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-08T20:50:33.813 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-08T20:50:33.941 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-08T20:50:33.969 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-08T20:50:34.101 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-08T20:50:34.213 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-08T20:50:34.241 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-08T20:50:34.280 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-08T20:50:34.404 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-sklearn. 2023-12-08T20:50:34.432 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-08T20:50:34.471 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-08T20:50:34.741 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package dump. 2023-12-08T20:50:34.769 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-08T20:50:34.810 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking dump (0.4b47-3) ... 2023-12-08T20:50:35.103 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package indent. 2023-12-08T20:50:35.131 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-08T20:50:35.155 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-08T20:50:35.178 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-08T20:50:35.183 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:50:35.213 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:35.422 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-08T20:50:35.450 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-08T20:50:35.489 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-08T20:50:35.817 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-08T20:50:35.845 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-08T20:50:35.884 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-08T20:50:36.108 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cachetools. 2023-12-08T20:50:36.135 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-12-08T20:50:36.136 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-08T20:50:36.153 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-08T20:50:36.174 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-08T20:50:36.195 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-08T20:50:36.477 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-08T20:50:36.489 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-08T20:50:36.505 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-08T20:50:36.517 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-08T20:50:36.544 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-08T20:50:36.556 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-08T20:50:36.808 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-08T20:50:36.836 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-08T20:50:36.875 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-08T20:50:36.880 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-08T20:50:36.908 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-08T20:50:36.947 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-08T20:50:37.153 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjson-perl. 2023-12-08T20:50:37.181 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-08T20:50:37.219 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-08T20:50:37.258 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rsa. 2023-12-08T20:50:37.286 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-12-08T20:50:37.325 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-08T20:50:37.539 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-08T20:50:37.567 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-08T20:50:37.606 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-08T20:50:37.645 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-google-auth. 2023-12-08T20:50:37.673 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-12-08T20:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-08T20:50:38.032 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-08T20:50:38.060 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-08T20:50:38.098 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-08T20:50:38.418 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-websocket. 2023-12-08T20:50:38.446 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-12-08T20:50:38.484 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-08T20:50:38.763 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-08T20:50:38.791 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-08T20:50:38.821 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-08T20:50:39.225 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-08T20:50:39.253 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-08T20:50:39.291 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T20:50:39.493 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-08T20:50:39.510 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:50:39.544 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-08T20:50:39.551 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:39.560 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-08T20:50:39.602 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T20:50:39.871 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-08T20:50:39.898 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-08T20:50:39.922 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-08T20:50:39.938 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-08T20:50:39.950 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-08T20:50:39.988 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T20:50:40.248 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-08T20:50:40.277 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-08T20:50:40.315 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-08T20:50:40.332 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-08T20:50:40.361 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-08T20:50:40.399 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-08T20:50:40.561 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package jq. 2023-12-08T20:50:40.588 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-08T20:50:40.626 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-08T20:50:40.727 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-08T20:50:40.754 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-08T20:50:40.785 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-08T20:50:40.878 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package socat. 2023-12-08T20:50:40.895 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-08T20:50:40.937 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-08T20:50:41.138 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-08T20:50:41.166 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-08T20:50:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T20:50:41.250 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package xmlstarlet. 2023-12-08T20:50:41.277 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-08T20:50:41.315 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-08T20:50:41.549 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-08T20:50:41.577 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-08T20:50:41.615 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T20:50:41.694 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-test. 2023-12-08T20:50:41.723 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../099-ceph-test_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:41.761 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-test (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:41.926 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-08T20:50:41.950 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-08T20:50:41.992 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T20:50:42.296 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-08T20:50:42.313 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-08T20:50:42.346 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-08T20:50:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-08T20:50:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-08T20:50:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-08T20:50:43.228 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package modemmanager. 2023-12-08T20:50:43.255 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-08T20:50:43.294 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T20:50:43.916 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package network-manager. 2023-12-08T20:50:43.945 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-08T20:50:43.991 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-08T20:50:44.131 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-volume. 2023-12-08T20:50:44.159 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:50:44.197 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-volume (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:44.577 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-08T20:50:44.599 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ppp. 2023-12-08T20:50:44.605 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:44.626 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-08T20:50:44.643 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephfs-mirror (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:44.909 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-08T20:50:44.938 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-colorama. 2023-12-08T20:50:44.966 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-12-08T20:50:45.029 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-08T20:50:45.245 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package pptp-linux. 2023-12-08T20:50:45.273 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-08T20:50:45.273 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephfs-shell. 2023-12-08T20:50:45.290 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:50:45.311 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-08T20:50:45.323 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephfs-shell (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:45.542 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephfs-top. 2023-12-08T20:50:45.559 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-44-g9dcc13bb-1jammy_all.deb ... 2023-12-08T20:50:45.582 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-08T20:50:45.592 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephfs-top (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:45.609 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-08T20:50:45.647 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-08T20:50:45.845 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-08T20:50:45.873 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:45.911 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libcephfs-dev (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:45.934 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-08T20:50:45.961 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-08T20:50:46.000 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-client-common (238) ... 2023-12-08T20:50:46.231 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package lua-socket:amd64. 2023-12-08T20:50:46.259 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-12-08T20:50:46.297 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-08T20:50:46.304 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-08T20:50:46.332 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-08T20:50:46.370 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T20:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package lua-sec:amd64. 2023-12-08T20:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-12-08T20:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-12-08T20:50:46.958 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-common. 2023-12-08T20:50:46.987 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-08T20:50:46.997 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package nvme-cli. 2023-12-08T20:50:47.025 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-08T20:50:47.043 INFO:teuthology.orchestra.run.smithi146.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-08T20:50:47.063 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-08T20:50:47.072 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-common (238) ... 2023-12-08T20:50:47.452 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package pkg-config. 2023-12-08T20:50:47.469 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-12-08T20:50:47.502 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-12-08T20:50:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-14. 2023-12-08T20:50:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-08T20:50:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T20:50:47.738 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-08T20:50:47.755 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-08T20:50:47.796 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-08T20:50:48.199 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-08T20:50:48.227 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-08T20:50:48.266 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-08T20:50:48.585 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pastescript. 2023-12-08T20:50:48.613 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-12-08T20:50:48.652 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-08T20:50:48.972 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pluggy. 2023-12-08T20:50:49.000 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-08T20:50:49.038 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-08T20:50:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql. 2023-12-08T20:50:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-08T20:50:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql (14+238) ... 2023-12-08T20:50:49.349 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-psutil. 2023-12-08T20:50:49.377 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-08T20:50:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-client. 2023-12-08T20:50:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-08T20:50:49.416 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-08T20:50:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-client (14+238) ... 2023-12-08T20:50:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-08T20:50:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-08T20:50:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-08T20:50:49.761 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-py. 2023-12-08T20:50:49.789 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-12-08T20:50:49.839 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-08T20:50:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package tcl8.6. 2023-12-08T20:50:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-08T20:50:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-08T20:50:50.156 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pygments. 2023-12-08T20:50:50.184 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-08T20:50:50.222 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-08T20:50:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package tcl. 2023-12-08T20:50:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-08T20:50:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-08T20:50:50.659 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-08T20:50:50.688 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-08T20:50:50.717 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-08T20:50:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package wpasupplicant. 2023-12-08T20:50:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-08T20:50:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-08T20:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-toml. 2023-12-08T20:50:51.057 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-12-08T20:50:51.095 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-08T20:50:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-08T20:50:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-08T20:50:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-08T20:50:51.398 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pytest. 2023-12-08T20:50:51.427 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-08T20:50:51.464 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-08T20:50:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-08T20:50:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-08T20:50:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-08T20:50:51.826 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-simplejson. 2023-12-08T20:50:51.854 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-08T20:50:51.909 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-08T20:50:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-client-common (238) ... 2023-12-08T20:50:52.178 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-08T20:50:52.195 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-08T20:50:52.237 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-08T20:50:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-08T20:50:52.853 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-08T20:50:52.949 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package radosgw. 2023-12-08T20:50:52.978 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../122-radosgw_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:53.013 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T20:50:53.015 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking radosgw (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:53.139 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-08T20:50:53.265 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-08T20:50:53.397 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T20:50:53.872 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-08T20:50:53.877 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package rbd-fuse. 2023-12-08T20:50:53.893 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:53.935 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking rbd-fuse (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:53.946 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-08T20:50:54.196 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package rbd-mirror. 2023-12-08T20:50:54.224 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:54.262 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking rbd-mirror (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:54.326 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-08T20:50:54.327 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-08T20:50:54.673 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package rbd-nbd. 2023-12-08T20:50:54.690 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:54.732 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking rbd-nbd (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:54.850 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-08T20:50:54.975 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-08T20:50:55.026 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-common-dbg. 2023-12-08T20:50:55.054 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:50:55.093 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-common-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:50:55.101 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-08T20:50:55.227 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-08T20:50:55.362 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-08T20:50:55.479 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-08T20:50:55.606 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-08T20:50:56.344 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-08T20:50:56.470 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up dump (0.4b47-3) ... 2023-12-08T20:50:56.555 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-08T20:50:56.622 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T20:50:56.747 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-08T20:50:56.890 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-08T20:50:57.016 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-08T20:50:57.142 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-08T20:50:57.240 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-08T20:50:57.310 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-08T20:50:57.436 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-08T20:50:57.596 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-08T20:50:57.730 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T20:50:57.856 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-08T20:50:58.033 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-client (14+238) ... 2023-12-08T20:50:58.158 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-08T20:50:58.625 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:50:58.625 INFO:teuthology.orchestra.run.smithi146.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-08T20:50:58.625 INFO:teuthology.orchestra.run.smithi146.stdout:which means they are currently configured by ifupdown: 2023-12-08T20:50:58.625 INFO:teuthology.orchestra.run.smithi146.stdout:- enp3s0f1 2023-12-08T20:50:58.625 INFO:teuthology.orchestra.run.smithi146.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-08T20:50:58.625 INFO:teuthology.orchestra.run.smithi146.stdout:remove their configuration from /etc/network/interfaces. 2023-12-08T20:50:58.625 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:50:58.753 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-08T20:50:59.076 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-08T20:50:59.425 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-08T20:50:59.952 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T20:51:00.098 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-08T20:51:00.224 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-08T20:51:00.350 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-common (238) ... 2023-12-08T20:51:01.243 INFO:teuthology.orchestra.run.smithi146.stdout:Adding user postgres to group ssl-cert 2023-12-08T20:51:01.469 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:51:01.469 INFO:teuthology.orchestra.run.smithi146.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-08T20:51:01.700 INFO:teuthology.orchestra.run.smithi146.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-08T20:51:01.701 INFO:teuthology.orchestra.run.smithi146.stdout:Removing obsolete dictionary files: 2023-12-08T20:51:02.239 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-08T20:51:02.246 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-fuse-dbg. 2023-12-08T20:51:02.275 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:02.313 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-fuse-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:02.601 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T20:51:02.798 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mds-dbg. 2023-12-08T20:51:02.815 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:02.848 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mds-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:02.928 INFO:teuthology.orchestra.run.smithi146.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-08T20:51:02.946 INFO:teuthology.orchestra.run.smithi146.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-08T20:51:02.994 INFO:teuthology.orchestra.run.smithi146.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-08T20:51:02.994 INFO:teuthology.orchestra.run.smithi146.stdout:This user must also own the server process. 2023-12-08T20:51:02.994 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:51:02.994 INFO:teuthology.orchestra.run.smithi146.stdout:The database cluster will be initialized with locale "en_US". 2023-12-08T20:51:02.995 INFO:teuthology.orchestra.run.smithi146.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-08T20:51:02.995 INFO:teuthology.orchestra.run.smithi146.stdout:The default text search configuration will be set to "english". 2023-12-08T20:51:02.995 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:51:02.995 INFO:teuthology.orchestra.run.smithi146.stdout:Data page checksums are disabled. 2023-12-08T20:51:02.995 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:51:02.995 INFO:teuthology.orchestra.run.smithi146.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-08T20:51:02.995 INFO:teuthology.orchestra.run.smithi146.stdout:creating subdirectories ... ok 2023-12-08T20:51:02.995 INFO:teuthology.orchestra.run.smithi146.stdout:selecting dynamic shared memory implementation ... posix 2023-12-08T20:51:03.011 INFO:teuthology.orchestra.run.smithi146.stdout:selecting default max_connections ... 100 2023-12-08T20:51:03.031 INFO:teuthology.orchestra.run.smithi146.stdout:selecting default shared_buffers ... 128MB 2023-12-08T20:51:03.050 INFO:teuthology.orchestra.run.smithi146.stdout:selecting default time zone ... Etc/UTC 2023-12-08T20:51:03.051 INFO:teuthology.orchestra.run.smithi146.stdout:creating configuration files ... ok 2023-12-08T20:51:03.166 INFO:teuthology.orchestra.run.smithi146.stdout:running bootstrap script ... ok 2023-12-08T20:51:03.851 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-dbg. 2023-12-08T20:51:03.879 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:performing post-bootstrap initialization ... ok 2023-12-08T20:51:03.917 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:04.529 INFO:teuthology.orchestra.run.smithi146.stdout:syncing data to disk ... ok 2023-12-08T20:51:04.653 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mon-dbg. 2023-12-08T20:51:04.670 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:04.711 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mon-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:04.942 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-08T20:51:05.780 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-osd-dbg. 2023-12-08T20:51:05.797 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:05.838 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-osd-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:07.708 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T20:51:07.833 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-08T20:51:07.959 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql (14+238) ... 2023-12-08T20:51:08.085 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T20:51:08.194 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T20:51:08.450 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-08T20:51:08.450 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-08T20:51:09.021 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-08T20:51:09.169 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-test-dbg. 2023-12-08T20:51:09.197 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:09.235 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-test-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:09.341 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-08T20:51:09.492 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-08T20:51:10.828 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-08T20:51:10.928 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-08T20:51:11.413 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-08T20:51:11.417 DEBUG:teuthology.parallel:result is None 2023-12-08T20:51:18.010 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libcephfs2-dbg. 2023-12-08T20:51:18.026 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:18.068 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libcephfs2-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:18.612 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librados2-dbg. 2023-12-08T20:51:18.641 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:18.678 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librados2-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:19.689 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libradosstriper1-dbg. 2023-12-08T20:51:19.706 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:19.739 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libradosstriper1-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:20.209 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librbd1-dbg. 2023-12-08T20:51:20.225 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:20.266 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librbd1-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:21.536 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librgw2-dbg. 2023-12-08T20:51:21.553 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:21.594 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librgw2-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:23.380 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package radosgw-dbg. 2023-12-08T20:51:23.405 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:23.447 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking radosgw-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:26.674 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package rbd-fuse-dbg. 2023-12-08T20:51:26.702 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:26.749 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking rbd-fuse-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:27.018 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package rbd-mirror-dbg. 2023-12-08T20:51:27.047 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:27.085 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking rbd-mirror-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:28.245 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package rbd-nbd-dbg. 2023-12-08T20:51:28.262 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-44-g9dcc13bb-1jammy_amd64.deb ... 2023-12-08T20:51:28.303 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking rbd-nbd-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:28.660 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-08T20:51:28.917 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-08T20:51:29.043 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-08T20:51:29.312 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-08T20:51:29.641 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-08T20:51:30.082 INFO:teuthology.orchestra.run.smithi053.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-08T20:51:30.153 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephadm (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:30.680 INFO:teuthology.orchestra.run.smithi053.stdout:Adding system user cephadm....done 2023-12-08T20:51:30.965 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-08T20:51:31.429 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-08T20:51:31.687 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-08T20:51:31.813 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-08T20:51:32.089 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-08T20:51:32.349 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-08T20:51:32.475 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-08T20:51:32.777 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-08T20:51:33.162 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-08T20:51:33.423 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-08T20:51:33.689 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-08T20:51:33.949 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-12-08T20:51:34.209 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-08T20:51:34.543 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-08T20:51:34.811 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-08T20:51:35.070 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-ceph-argparse (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:35.338 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-08T20:51:35.464 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-08T20:51:35.590 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-08T20:51:35.859 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-12-08T20:51:35.985 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-08T20:51:36.244 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-12-08T20:51:36.637 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-12-08T20:51:36.668 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-12-08T20:51:36.730 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-08T20:51:36.856 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-08T20:51:37.225 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-08T20:51:37.351 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-08T20:51:37.618 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-08T20:51:37.886 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-08T20:51:38.212 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up zip (3.0-12build2) ... 2023-12-08T20:51:38.338 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-08T20:51:39.015 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-08T20:51:39.292 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-08T20:51:39.401 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-08T20:51:39.510 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-08T20:51:39.812 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-08T20:51:40.204 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-08T20:51:40.458 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-08T20:51:40.832 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-08T20:51:41.142 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-08T20:51:41.452 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-08T20:51:41.842 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-08T20:51:42.104 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-08T20:51:42.230 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-ceph-common (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:42.531 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-idna (3.3-1) ... 2023-12-08T20:51:42.858 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-08T20:51:44.072 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-12-08T20:51:44.323 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T20:51:44.466 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-08T20:51:44.734 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-08T20:51:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-08T20:51:44.961 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-08T20:51:45.271 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-08T20:51:45.522 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-08T20:51:45.756 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T20:51:45.882 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-08T20:51:46.204 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-08T20:51:46.444 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-08T20:51:46.703 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-08T20:51:46.962 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-08T20:51:47.213 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-08T20:51:47.473 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-08T20:51:47.599 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-08T20:51:47.892 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-08T20:51:48.018 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-08T20:51:48.336 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-08T20:51:48.654 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-08T20:51:48.913 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-08T20:51:49.039 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-12-08T20:51:49.165 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-08T20:51:49.256 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-08T20:51:49.509 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-08T20:51:49.635 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-08T20:51:50.028 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-08T20:51:50.296 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up lua-any (27ubuntu1) ... 2023-12-08T20:51:50.405 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-08T20:51:50.650 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T20:51:50.774 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-08T20:51:51.092 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-08T20:51:51.401 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-08T20:51:51.678 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-08T20:51:51.914 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-08T20:51:52.173 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-08T20:51:52.441 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-08T20:51:52.693 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-08T20:51:53.053 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-08T20:51:53.354 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-08T20:51:53.690 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-08T20:51:53.816 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librados2 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:53.951 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libsqlite3-mod-ceph (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:54.077 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-12-08T20:51:54.413 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libcephfs2 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:54.530 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libradosstriper1 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:54.640 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-08T20:51:54.925 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librados2-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:55.034 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librbd1 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:55.169 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libcephfs2-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:55.295 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-modules-core (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:55.421 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-fuse (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:55.639 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-08T20:51:55.639 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-08T20:51:56.130 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libradosstriper1-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:56.257 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libcephfs-dev (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:56.382 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-fuse-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:56.533 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rados (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:56.651 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librgw2 (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:56.760 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephfs-top (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:56.886 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-08T20:51:58.207 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librbd1-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:58.333 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rbd (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:58.459 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librgw2-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:58.602 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up rbd-fuse (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:58.728 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up rbd-nbd (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:58.854 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rgw (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:58.980 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cephfs (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:59.090 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up rbd-nbd-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:59.198 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephfs-shell (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:59.324 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up rbd-fuse-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:59.459 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-common (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:51:59.985 INFO:teuthology.orchestra.run.smithi053.stdout:Adding group ceph....done 2023-12-08T20:52:00.362 INFO:teuthology.orchestra.run.smithi053.stdout:Adding system user ceph....done 2023-12-08T20:52:00.489 INFO:teuthology.orchestra.run.smithi053.stdout:Setting system user ceph properties....done 2023-12-08T20:52:00.502 INFO:teuthology.orchestra.run.smithi053.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-08T20:52:00.648 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-08T20:52:01.002 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-08T20:52:01.787 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephfs-mirror (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:02.337 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-08T20:52:02.337 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-08T20:52:02.813 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-test (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:02.914 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up radosgw (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:03.386 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-08T20:52:03.387 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-08T20:52:03.882 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-base (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:04.229 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-08T20:52:04.693 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mds (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:04.930 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-08T20:52:04.930 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-08T20:52:05.470 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-common-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:05.596 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up rbd-mirror (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:05.813 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-12-08T20:52:05.813 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-12-08T20:52:06.314 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:06.554 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-08T20:52:06.554 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-08T20:52:07.057 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mds-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:07.183 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up radosgw-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:07.300 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-test-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:07.401 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-osd (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:07.722 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-08T20:52:07.722 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-08T20:52:08.221 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:08.338 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-osd-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:08.439 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up rbd-mirror-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:08.590 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-k8sevents (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:08.716 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:08.876 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mon (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:09.097 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-08T20:52:09.097 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-08T20:52:09.627 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-cephadm (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:09.778 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:09.904 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-dashboard (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:10.038 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mon-dbg (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:10.148 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-volume (19.0.0-44-g9dcc13bb-1jammy) ... 2023-12-08T20:52:10.493 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-12-08T20:52:10.610 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-08T20:52:10.762 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-08T20:52:11.888 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-08T20:52:12.522 INFO:teuthology.orchestra.run.smithi053.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-08T20:52:12.526 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-08T20:52:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-12-08T20:52:12.777 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2023-12-08T20:52:12.778 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2023-12-08T20:52:12.956 INFO:teuthology.orchestra.run.smithi053.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-08T20:52:12.956 INFO:teuthology.orchestra.run.smithi053.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-08T20:52:12.956 INFO:teuthology.orchestra.run.smithi053.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-08T20:52:12.956 INFO:teuthology.orchestra.run.smithi053.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-08T20:52:12.956 INFO:teuthology.orchestra.run.smithi053.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-08T20:52:12.956 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2023-12-08T20:52:12.956 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-08T20:52:12.957 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-08T20:52:12.957 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-08T20:52:12.957 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-08T20:52:12.957 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-08T20:52:12.958 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-08T20:52:12.958 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2023-12-08T20:52:12.958 INFO:teuthology.orchestra.run.smithi053.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-08T20:52:12.958 INFO:teuthology.orchestra.run.smithi053.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-08T20:52:12.958 INFO:teuthology.orchestra.run.smithi053.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-08T20:52:12.958 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-08T20:52:12.958 INFO:teuthology.orchestra.run.smithi053.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-08T20:52:12.959 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2023-12-08T20:52:12.959 INFO:teuthology.orchestra.run.smithi053.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-08T20:52:12.959 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-08T20:52:12.960 INFO:teuthology.orchestra.run.smithi053.stdout: libengine-pkcs11-openssl 2023-12-08T20:52:12.999 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2023-12-08T20:52:13.000 INFO:teuthology.orchestra.run.smithi053.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-08T20:52:13.000 INFO:teuthology.orchestra.run.smithi053.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-08T20:52:13.000 INFO:teuthology.orchestra.run.smithi053.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-08T20:52:13.000 INFO:teuthology.orchestra.run.smithi053.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-08T20:52:13.000 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-08T20:52:13.001 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-08T20:52:13.001 INFO:teuthology.orchestra.run.smithi053.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-08T20:52:13.002 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages will be upgraded: 2023-12-08T20:52:13.003 INFO:teuthology.orchestra.run.smithi053.stdout: libssl3 2023-12-08T20:52:13.057 INFO:teuthology.orchestra.run.smithi053.stdout:1 upgraded, 39 newly installed, 0 to remove and 262 not upgraded. 2023-12-08T20:52:13.057 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 54.6 MB of archives. 2023-12-08T20:52:13.057 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-08T20:52:13.057 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-08T20:52:13.171 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-08T20:52:13.238 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-08T20:52:13.253 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-08T20:52:13.254 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-08T20:52:13.256 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-08T20:52:13.259 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-08T20:52:13.259 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-08T20:52:13.260 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-08T20:52:13.262 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-08T20:52:13.262 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-08T20:52:13.263 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-08T20:52:13.283 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-08T20:52:13.607 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-08T20:52:13.608 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-08T20:52:13.608 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-08T20:52:13.610 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-08T20:52:13.610 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-08T20:52:13.615 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-08T20:52:13.617 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-08T20:52:13.625 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-08T20:52:13.625 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-08T20:52:13.649 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-08T20:52:13.649 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-08T20:52:13.659 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-08T20:52:13.688 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-08T20:52:13.695 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-08T20:52:13.695 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-08T20:52:13.695 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-08T20:52:13.695 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-08T20:52:13.710 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-08T20:52:13.712 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-08T20:52:14.052 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-08T20:52:14.052 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-08T20:52:14.053 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-08T20:52:14.053 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-08T20:52:14.053 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-08T20:52:14.053 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-08T20:52:14.070 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-08T20:52:14.070 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-08T20:52:14.490 INFO:teuthology.orchestra.run.smithi053.stdout:Preconfiguring packages ... 2023-12-08T20:52:14.659 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 54.6 MB in 1s (51.4 MB/s) 2023-12-08T20:52:14.812 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package flex. 2023-12-08T20:52:14.918 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173899 files and directories currently installed.) 2023-12-08T20:52:14.924 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-08T20:52:14.969 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-08T20:52:15.561 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-08T20:52:15.733 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-08T20:52:16.138 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-08T20:52:16.678 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package bison. 2023-12-08T20:52:16.785 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173972 files and directories currently installed.) 2023-12-08T20:52:16.790 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-08T20:52:16.830 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-08T20:52:17.231 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-08T20:52:17.259 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-08T20:52:17.289 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-08T20:52:17.626 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package dump. 2023-12-08T20:52:17.656 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-08T20:52:17.803 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking dump (0.4b47-3) ... 2023-12-08T20:52:18.073 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package indent. 2023-12-08T20:52:18.089 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-08T20:52:18.132 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-08T20:52:18.392 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-08T20:52:18.411 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-08T20:52:18.475 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-08T20:52:18.805 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-08T20:52:18.833 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-08T20:52:18.871 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-08T20:52:19.133 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-08T20:52:19.160 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-08T20:52:19.190 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-08T20:52:19.527 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-08T20:52:19.555 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-08T20:52:19.593 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-08T20:52:19.846 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-08T20:52:19.863 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-08T20:52:19.904 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-08T20:52:20.157 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libjson-perl. 2023-12-08T20:52:20.173 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-08T20:52:20.215 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-08T20:52:20.502 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-08T20:52:20.530 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-08T20:52:20.560 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-08T20:52:22.280 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-08T20:52:22.308 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-08T20:52:22.346 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T20:52:22.615 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-08T20:52:22.632 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-08T20:52:22.674 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T20:52:23.044 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-08T20:52:23.072 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-08T20:52:23.110 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T20:52:23.439 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-08T20:52:23.467 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-08T20:52:23.505 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-08T20:52:23.825 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-08T20:52:23.853 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-08T20:52:23.891 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-08T20:52:24.244 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-08T20:52:24.273 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-08T20:52:24.311 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T20:52:24.631 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-08T20:52:24.659 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-08T20:52:24.697 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T20:52:24.992 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-08T20:52:25.008 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-08T20:52:25.050 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T20:52:25.319 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-08T20:52:25.336 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-08T20:52:25.377 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-08T20:52:25.898 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-08T20:52:25.926 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-08T20:52:25.965 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-08T20:52:26.318 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package modemmanager. 2023-12-08T20:52:26.346 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-08T20:52:26.385 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T20:52:27.174 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package network-manager. 2023-12-08T20:52:27.203 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-08T20:52:27.250 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-08T20:52:27.857 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ppp. 2023-12-08T20:52:27.885 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-08T20:52:28.326 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-08T20:52:28.672 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package pptp-linux. 2023-12-08T20:52:28.700 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-08T20:52:28.738 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-08T20:52:28.991 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-08T20:52:29.008 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-08T20:52:29.049 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-08T20:52:29.338 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-08T20:52:29.365 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-08T20:52:29.402 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-client-common (238) ... 2023-12-08T20:52:29.706 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-08T20:52:29.735 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-08T20:52:29.773 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T20:52:30.361 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-common. 2023-12-08T20:52:30.390 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-08T20:52:30.447 INFO:teuthology.orchestra.run.smithi053.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-08T20:52:30.476 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-common (238) ... 2023-12-08T20:52:30.927 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-14. 2023-12-08T20:52:30.955 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-08T20:52:30.997 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T20:52:32.514 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql. 2023-12-08T20:52:32.532 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-08T20:52:32.572 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql (14+238) ... 2023-12-08T20:52:32.816 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-client. 2023-12-08T20:52:32.845 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-08T20:52:32.883 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-client (14+238) ... 2023-12-08T20:52:33.520 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-08T20:52:33.548 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-08T20:52:33.577 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-08T20:52:33.888 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package tcl8.6. 2023-12-08T20:52:33.917 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-08T20:52:33.955 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-08T20:52:34.241 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package tcl. 2023-12-08T20:52:34.270 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-08T20:52:34.313 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-08T20:52:34.661 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package wpasupplicant. 2023-12-08T20:52:34.689 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-08T20:52:34.727 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-08T20:52:35.115 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-08T20:52:35.144 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-08T20:52:35.173 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-08T20:52:35.568 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-08T20:52:35.597 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-08T20:52:35.644 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-08T20:52:35.941 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-client-common (238) ... 2023-12-08T20:52:36.133 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-08T20:52:36.259 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-08T20:52:36.360 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T20:52:36.461 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-08T20:52:36.596 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-08T20:52:36.722 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T20:52:37.279 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-08T20:52:37.362 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-08T20:52:37.747 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-08T20:52:37.747 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-08T20:52:38.257 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-08T20:52:38.383 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-08T20:52:38.525 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-08T20:52:38.643 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-08T20:52:38.753 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-08T20:52:38.854 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-08T20:52:38.988 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-08T20:52:39.619 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-08T20:52:39.720 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up dump (0.4b47-3) ... 2023-12-08T20:52:39.814 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-08T20:52:39.880 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T20:52:40.131 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-08T20:52:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-08T20:52:40.384 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-08T20:52:40.510 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-08T20:52:40.592 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-08T20:52:40.645 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-08T20:52:40.746 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-08T20:52:40.922 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-08T20:52:41.048 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T20:52:41.175 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-08T20:52:41.343 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-client (14+238) ... 2023-12-08T20:52:41.469 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-08T20:52:41.914 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:41.914 INFO:teuthology.orchestra.run.smithi053.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-08T20:52:41.914 INFO:teuthology.orchestra.run.smithi053.stdout:which means they are currently configured by ifupdown: 2023-12-08T20:52:41.914 INFO:teuthology.orchestra.run.smithi053.stdout:- ens1f0 2023-12-08T20:52:41.914 INFO:teuthology.orchestra.run.smithi053.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-08T20:52:41.914 INFO:teuthology.orchestra.run.smithi053.stdout:remove their configuration from /etc/network/interfaces. 2023-12-08T20:52:41.914 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:42.052 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-08T20:52:42.410 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-08T20:52:42.753 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-08T20:52:43.280 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T20:52:43.423 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-08T20:52:43.549 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-08T20:52:43.675 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-common (238) ... 2023-12-08T20:52:44.906 INFO:teuthology.orchestra.run.smithi053.stdout:Adding user postgres to group ssl-cert 2023-12-08T20:52:45.143 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:45.143 INFO:teuthology.orchestra.run.smithi053.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-08T20:52:45.328 INFO:teuthology.orchestra.run.smithi053.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-08T20:52:45.328 INFO:teuthology.orchestra.run.smithi053.stdout:Removing obsolete dictionary files: 2023-12-08T20:52:45.882 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-08T20:52:46.262 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T20:52:46.573 INFO:teuthology.orchestra.run.smithi053.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-08T20:52:46.598 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-08T20:52:46.650 INFO:teuthology.orchestra.run.smithi053.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-08T20:52:46.650 INFO:teuthology.orchestra.run.smithi053.stdout:This user must also own the server process. 2023-12-08T20:52:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:46.650 INFO:teuthology.orchestra.run.smithi053.stdout:The database cluster will be initialized with locale "en_US". 2023-12-08T20:52:46.650 INFO:teuthology.orchestra.run.smithi053.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-08T20:52:46.651 INFO:teuthology.orchestra.run.smithi053.stdout:The default text search configuration will be set to "english". 2023-12-08T20:52:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:46.651 INFO:teuthology.orchestra.run.smithi053.stdout:Data page checksums are disabled. 2023-12-08T20:52:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:46.651 INFO:teuthology.orchestra.run.smithi053.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-08T20:52:46.651 INFO:teuthology.orchestra.run.smithi053.stdout:creating subdirectories ... ok 2023-12-08T20:52:46.651 INFO:teuthology.orchestra.run.smithi053.stdout:selecting dynamic shared memory implementation ... posix 2023-12-08T20:52:46.666 INFO:teuthology.orchestra.run.smithi053.stdout:selecting default max_connections ... 100 2023-12-08T20:52:46.686 INFO:teuthology.orchestra.run.smithi053.stdout:selecting default shared_buffers ... 128MB 2023-12-08T20:52:46.697 INFO:teuthology.orchestra.run.smithi053.stdout:selecting default time zone ... Etc/UTC 2023-12-08T20:52:46.698 INFO:teuthology.orchestra.run.smithi053.stdout:creating configuration files ... ok 2023-12-08T20:52:46.817 INFO:teuthology.orchestra.run.smithi053.stdout:running bootstrap script ... ok 2023-12-08T20:52:47.478 INFO:teuthology.orchestra.run.smithi053.stdout:performing post-bootstrap initialization ... ok 2023-12-08T20:52:48.082 INFO:teuthology.orchestra.run.smithi053.stdout:syncing data to disk ... ok 2023-12-08T20:52:48.473 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-08T20:52:51.227 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T20:52:51.353 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-08T20:52:51.478 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql (14+238) ... 2023-12-08T20:52:51.605 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T20:52:51.766 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T20:52:52.010 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-08T20:52:52.011 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-08T20:52:52.567 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-08T20:52:52.861 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-08T20:52:53.021 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-08T20:52:54.383 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-08T20:52:54.474 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-08T20:52:54.933 INFO:teuthology.orchestra.run.smithi053.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-08T20:52:54.937 DEBUG:teuthology.parallel:result is None 2023-12-08T20:52:54.938 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:52:55.154 DEBUG:teuthology.orchestra.run.smithi053:> dpkg-query -W -f '${Version}' ceph 2023-12-08T20:52:55.174 INFO:teuthology.orchestra.run.smithi053.stdout:19.0.0-44-g9dcc13bb-1jammy 2023-12-08T20:52:55.174 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-44-g9dcc13bb-1jammy 2023-12-08T20:52:55.174 INFO:teuthology.task.install:The correct ceph version 19.0.0-44-g9dcc13bb-1jammy is installed. 2023-12-08T20:52:55.175 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:52:55.311 DEBUG:teuthology.orchestra.run.smithi146:> dpkg-query -W -f '${Version}' ceph 2023-12-08T20:52:55.331 INFO:teuthology.orchestra.run.smithi146.stdout:19.0.0-44-g9dcc13bb-1jammy 2023-12-08T20:52:55.331 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-44-g9dcc13bb-1jammy 2023-12-08T20:52:55.331 INFO:teuthology.task.install:The correct ceph version 19.0.0-44-g9dcc13bb-1jammy is installed. 2023-12-08T20:52:55.331 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-08T20:52:55.331 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:52:55.332 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-08T20:52:55.346 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:52:55.346 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-08T20:52:55.385 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-08T20:52:55.385 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:52:55.385 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2023-12-08T20:52:55.403 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-08T20:52:55.458 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:52:55.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2023-12-08T20:52:55.471 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-08T20:52:55.526 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-08T20:52:55.526 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:52:55.526 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-08T20:52:55.539 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-08T20:52:55.594 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:52:55.594 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-08T20:52:55.607 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-08T20:52:55.660 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-08T20:52:55.660 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:52:55.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2023-12-08T20:52:55.675 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-08T20:52:55.731 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:52:55.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2023-12-08T20:52:55.743 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-08T20:52:55.797 INFO:teuthology.run_tasks:Running task ceph... 2023-12-08T20:52:55.871 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-08T20:52:55.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2023-12-08T20:52:55.874 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2023-12-08T20:52:55.887 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-08T20:52:55.888 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-08T20:52:55.932 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-08T20:52:55.944 INFO:tasks.ceph:Creating extra log directories... 2023-12-08T20:52:55.944 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-08T20:52:55.988 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-08T20:52:56.010 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-08T20:52:56.010 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-08T20:52:56.011 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-08T20:52:56.011 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:52:56.011 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-08T20:52:56.047 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-08T20:52:56.123 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:52:56.123 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-08T20:52:56.128 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-08T20:52:56.211 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-08T20:52:56.211 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-08T20:52:56.212 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218', 'branch': 'main', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7484218', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 3721, 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLmzGf8xlQcY+xSSHpacug3HfG5FA11wlSf4yTCF8X5ZvnF4jFbfZq6bM04t26vEes7oJ4pGuy2MG/0rDZu/sIA=', 'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCn5oXHiNIgqK8w2G01xEDfyPiEwwAF7BNao5zji20NzvVMxgvQ9zvWO97+kRZC6uewa+UdCb5B52A6aSEhpJD4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-08_19:31:32', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-08T20:52:56.212 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-08T20:52:56.215 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-08T20:52:56.253 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2023-12-08T20:52:56.266 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2023-12-08T20:52:56.309 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:52:56.310 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2023-12-08T20:52:56.323 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-08T20:52:56.324 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2023-12-08T20:52:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-08T20:52:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:52:56.371 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 884 Links: 1 2023-12-08T20:52:56.371 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:52:56.371 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-12-08 20:41:33.294113817 +0000 2023-12-08T20:52:56.372 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-12-08 20:41:32.938116979 +0000 2023-12-08T20:52:56.372 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-12-08 20:41:32.938116979 +0000 2023-12-08T20:52:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-12-08T20:52:56.372 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-08T20:52:56.425 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-12-08T20:52:56.425 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-12-08T20:52:56.425 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000226674 s, 2.3 MB/s 2023-12-08T20:52:56.426 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-08T20:52:56.476 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2023-12-08T20:52:56.523 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-08T20:52:56.523 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:52:56.523 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 904 Links: 1 2023-12-08T20:52:56.523 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:52:56.523 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-12-08 20:41:33.902108416 +0000 2023-12-08T20:52:56.524 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-12-08 20:41:33.530111720 +0000 2023-12-08T20:52:56.524 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-12-08 20:41:33.530111720 +0000 2023-12-08T20:52:56.524 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-12-08T20:52:56.524 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-08T20:52:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-12-08T20:52:56.578 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-12-08T20:52:56.578 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000311284 s, 1.6 MB/s 2023-12-08T20:52:56.579 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-08T20:52:56.632 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2023-12-08T20:52:56.679 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-08T20:52:56.679 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:52:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 915 Links: 1 2023-12-08T20:52:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:52:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-12-08 20:41:34.134106355 +0000 2023-12-08T20:52:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-12-08 20:41:34.130106391 +0000 2023-12-08T20:52:56.679 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-12-08 20:41:34.130106391 +0000 2023-12-08T20:52:56.679 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-12-08T20:52:56.679 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-08T20:52:56.733 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-12-08T20:52:56.733 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-12-08T20:52:56.733 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000247684 s, 2.1 MB/s 2023-12-08T20:52:56.735 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-08T20:52:56.785 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2023-12-08T20:52:56.831 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-08T20:52:56.831 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:52:56.831 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 931 Links: 1 2023-12-08T20:52:56.831 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:52:56.831 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-12-08 20:41:35.102097756 +0000 2023-12-08T20:52:56.831 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-12-08 20:41:34.722101132 +0000 2023-12-08T20:52:56.831 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-12-08 20:41:34.722101132 +0000 2023-12-08T20:52:56.831 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-12-08T20:52:56.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-08T20:52:56.886 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-12-08T20:52:56.886 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-12-08T20:52:56.886 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000245531 s, 2.1 MB/s 2023-12-08T20:52:56.887 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-08T20:52:56.937 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T20:52:56.937 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:52:56.937 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2023-12-08T20:52:56.943 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-08T20:52:56.943 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2023-12-08T20:52:56.989 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-08T20:52:56.989 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:52:56.990 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 877 Links: 1 2023-12-08T20:52:56.990 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:52:56.990 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-12-08 20:41:32.074722675 +0000 2023-12-08T20:52:56.990 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-12-08 20:41:31.690726105 +0000 2023-12-08T20:52:56.990 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-12-08 20:41:31.690726105 +0000 2023-12-08T20:52:56.990 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-12-08T20:52:56.990 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-08T20:52:57.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-12-08T20:52:57.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-12-08T20:52:57.043 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000422391 s, 1.2 MB/s 2023-12-08T20:52:57.045 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-08T20:52:57.097 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2023-12-08T20:52:57.145 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-08T20:52:57.145 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:52:57.145 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 887 Links: 1 2023-12-08T20:52:57.145 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:52:57.145 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-12-08 20:41:32.330720389 +0000 2023-12-08T20:52:57.145 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-12-08 20:41:32.326720425 +0000 2023-12-08T20:52:57.145 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-12-08 20:41:32.326720425 +0000 2023-12-08T20:52:57.145 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-12-08T20:52:57.146 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-08T20:52:57.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-12-08T20:52:57.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-12-08T20:52:57.199 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000316393 s, 1.6 MB/s 2023-12-08T20:52:57.200 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-08T20:52:57.247 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2023-12-08T20:52:57.294 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-08T20:52:57.295 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:52:57.295 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 909 Links: 1 2023-12-08T20:52:57.295 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:52:57.295 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-12-08 20:41:33.314711599 +0000 2023-12-08T20:52:57.295 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-12-08 20:41:32.954714815 +0000 2023-12-08T20:52:57.295 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-12-08 20:41:32.954714815 +0000 2023-12-08T20:52:57.295 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-12-08T20:52:57.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-08T20:52:57.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-12-08T20:52:57.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-12-08T20:52:57.347 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000372481 s, 1.4 MB/s 2023-12-08T20:52:57.348 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-08T20:52:57.398 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2023-12-08T20:52:57.445 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-08T20:52:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:52:57.446 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 925 Links: 1 2023-12-08T20:52:57.446 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:52:57.446 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-12-08 20:41:33.946705955 +0000 2023-12-08T20:52:57.446 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-12-08 20:41:33.570709314 +0000 2023-12-08T20:52:57.446 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-12-08 20:41:33.570709314 +0000 2023-12-08T20:52:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-12-08T20:52:57.446 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-08T20:52:57.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-12-08T20:52:57.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-12-08T20:52:57.499 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000389904 s, 1.3 MB/s 2023-12-08T20:52:57.500 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-08T20:52:57.550 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T20:52:57.550 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-08T20:52:57.550 INFO:tasks.ceph:Generating config... 2023-12-08T20:52:57.551 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-08T20:52:57.551 INFO:tasks.ceph:[client] debug client = 20 2023-12-08T20:52:57.552 INFO:tasks.ceph:[client] debug ms = 1 2023-12-08T20:52:57.552 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-08T20:52:57.552 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-08T20:52:57.552 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-12-08T20:52:57.552 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-12-08T20:52:57.552 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-12-08T20:52:57.552 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-08T20:52:57.552 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-08T20:52:57.552 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-08T20:52:57.552 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-08T20:52:57.552 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-08T20:52:57.552 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-08T20:52:57.552 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-12-08T20:52:57.552 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-08T20:52:57.552 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-08T20:52:57.553 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-08T20:52:57.553 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-08T20:52:57.553 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-08T20:52:57.553 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-08T20:52:57.553 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-08T20:52:57.553 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-08T20:52:57.553 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-08T20:52:57.553 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-08T20:52:57.553 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-12-08T20:52:57.553 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-08T20:52:57.553 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-12-08T20:52:57.553 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-08T20:52:57.553 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-08T20:52:57.553 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-08T20:52:57.553 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-08T20:52:57.554 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-08T20:52:57.554 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-08T20:52:57.554 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-08T20:52:57.554 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-08T20:52:57.554 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-08T20:52:57.554 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-08T20:52:57.554 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-12-08T20:52:57.554 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-08T20:52:57.554 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-08T20:52:57.554 INFO:tasks.ceph:Setting up mon.a... 2023-12-08T20:52:57.554 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-08T20:52:57.589 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.keyring 2023-12-08T20:52:57.633 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-08T20:52:57.713 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-08T20:52:57.766 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.53'), ('mon.b', '172.21.15.146'), ('mon.c', '[v2:172.21.15.146:3301,v1:172.21.15.146:6790]')] 2023-12-08T20:52:57.767 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.53,172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-08T20:52:57.768 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:52:57.768 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-08T20:52:57.815 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.53 --add b 172.21.15.146 --addv c '[v2:172.21.15.146:3301,v1:172.21.15.146:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:52:57.902 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:52:57.902 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: generated fsid b118091f-f50b-41fe-890c-fae34a9e8e21 2023-12-08T20:52:57.902 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = pacific 2023-12-08T20:52:57.902 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 0 2023-12-08T20:52:57.902 INFO:teuthology.orchestra.run.smithi053.stdout:fsid b118091f-f50b-41fe-890c-fae34a9e8e21 2023-12-08T20:52:57.902 INFO:teuthology.orchestra.run.smithi053.stdout:last_changed 2023-12-08T20:52:57.903514+0000 2023-12-08T20:52:57.903 INFO:teuthology.orchestra.run.smithi053.stdout:created 2023-12-08T20:52:57.903514+0000 2023-12-08T20:52:57.903 INFO:teuthology.orchestra.run.smithi053.stdout:min_mon_release 16 (pacific) 2023-12-08T20:52:57.903 INFO:teuthology.orchestra.run.smithi053.stdout:election_strategy: 1 2023-12-08T20:52:57.903 INFO:teuthology.orchestra.run.smithi053.stdout:0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2023-12-08T20:52:57.903 INFO:teuthology.orchestra.run.smithi053.stdout:1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2023-12-08T20:52:57.903 INFO:teuthology.orchestra.run.smithi053.stdout:2: [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] mon.c 2023-12-08T20:52:57.905 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-08T20:52:57.906 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-08T20:52:57.912 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b118091f-f50b-41fe-890c-fae34a9e8e21... 2023-12-08T20:52:57.913 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-08T20:52:57.955 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-08T20:52:57.980 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2023-12-08T20:52:57.980 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2023-12-08T20:52:57.980 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-08T20:52:57.980 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2023-12-08T20:52:57.980 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.980 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2023-12-08T20:52:57.980 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.980 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2023-12-08T20:52:57.980 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.980 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2023-12-08T20:52:57.980 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2023-12-08T20:52:57.981 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2023-12-08T20:52:57.982 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = "172.21.15.53,172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790]" 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: mds beacon grace = 60 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: mds heartbeat grace = 60 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: osd heartbeat grace = 60 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = b118091f-f50b-41fe-890c-fae34a9e8e21 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2023-12-08T20:52:57.983 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug trim objects = true 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.984 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore compression mode = aggressive 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 20 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 20 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-12-08T20:52:57.985 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 10 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: osd fast shutdown = False 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2023-12-08T20:52:57.986 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2023-12-08T20:52:57.987 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: mon op complaint time = 120 2023-12-08T20:52:57.988 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd crush smoke test = False 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout: client mount timeout = 600 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout: debug client = 20 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.b] 2023-12-08T20:52:57.989 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.c] 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.e] 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.f] 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout:[mds] 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds = 20 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds balancer = 20 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug frag = True 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug scatterstat = True 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout: mds op complaint time = 180 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout: mds valgrind exit = True 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout: mds verify scatter = True 2023-12-08T20:52:57.990 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2023-12-08T20:52:57.991 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2023-12-08T20:52:57.991 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2023-12-08T20:52:57.991 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2023-12-08T20:52:57.991 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2023-12-08T20:52:57.991 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-08T20:52:57.991 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.992 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-08T20:52:57.993 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.53,172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790]" 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: mds beacon grace = 60 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: mds heartbeat grace = 60 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: osd heartbeat grace = 60 2023-12-08T20:52:57.994 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = b118091f-f50b-41fe-890c-fae34a9e8e21 2023-12-08T20:52:57.995 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.995 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2023-12-08T20:52:57.995 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2023-12-08T20:52:57.995 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.995 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2023-12-08T20:52:57.995 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2023-12-08T20:52:57.995 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2023-12-08T20:52:57.995 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.995 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2023-12-08T20:52:57.995 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2023-12-08T20:52:57.995 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.995 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug trim objects = true 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.996 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore compression mode = aggressive 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 20 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 20 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 10 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2023-12-08T20:52:57.997 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: osd fast shutdown = False 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2023-12-08T20:52:57.998 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2023-12-08T20:52:57.999 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd crush smoke test = False 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2023-12-08T20:52:58.000 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.e] 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.f] 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2023-12-08T20:52:58.001 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2023-12-08T20:52:58.002 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds balancer = 20 2023-12-08T20:52:58.002 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-12-08T20:52:58.002 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2023-12-08T20:52:58.002 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2023-12-08T20:52:58.002 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2023-12-08T20:52:58.002 INFO:teuthology.orchestra.run.smithi146.stdout: mds valgrind exit = True 2023-12-08T20:52:58.002 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = True 2023-12-08T20:52:58.002 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-12-08T20:52:58.002 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-12-08T20:52:58.002 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-12-08T20:52:58.003 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-08T20:52:58.004 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-08T20:52:58.100 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-08T20:52:58.101 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:52:58.101 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-08T20:52:58.106 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:52:58.106 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-08T20:52:58.154 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T20:52:58.154 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:52:58.154 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-08T20:52:58.155 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-08T20:52:58.218 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:52:58.218 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:52:58.266 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2023-12-08T20:52:58.266 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:52:58.266 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-08T20:52:58.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-08T20:52:58.289 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:52:58.289 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:52:58.337 INFO:tasks.ceph:Setting up mon nodes... 2023-12-08T20:52:58.337 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-08T20:52:58.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-08T20:52:58.383 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-08T20:52:58.386 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-08T20:52:58.428 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-08T20:52:58.438 INFO:tasks.ceph:Setting up mds nodes... 2023-12-08T20:52:58.439 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-08T20:52:58.478 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-08T20:52:58.481 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-08T20:52:58.535 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-08T20:52:58.622 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-08T20:52:58.625 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-08T20:52:58.683 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-12-08T20:52:58.768 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-12-08T20:52:58.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-12-08T20:52:58.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-08T20:52:58.870 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-08T20:52:58.872 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-08T20:52:58.929 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-08T20:52:59.014 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-08T20:52:59.017 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-08T20:52:59.072 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-12-08T20:52:59.158 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-12-08T20:52:59.161 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-12-08T20:52:59.217 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-08T20:52:59.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-08T20:52:59.255 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-08T20:52:59.266 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-08T20:52:59.266 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-08T20:52:59.266 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-08T20:52:59.323 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T20:52:59.323 INFO:tasks.ceph:role: osd.0 2023-12-08T20:52:59.323 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T20:52:59.323 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-08T20:52:59.378 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T20:52:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T20:52:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T20:52:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T20:52:59.378 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T20:52:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-12-08T20:52:59.379 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T20:52:59.379 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T20:52:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T20:52:59.379 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T20:52:59.402 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-12-08T20:52:59.403 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-12-08T20:52:59.403 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-08T20:52:59.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-08T20:52:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T20:52:59.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:52:59.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-08T20:52:59.574 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T20:52:59.574 INFO:tasks.ceph:role: osd.1 2023-12-08T20:52:59.574 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T20:52:59.575 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-08T20:52:59.630 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T20:52:59.631 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T20:52:59.631 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T20:52:59.631 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T20:52:59.631 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T20:52:59.631 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-12-08T20:52:59.631 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T20:52:59.631 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T20:52:59.631 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T20:52:59.631 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T20:52:59.654 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-12-08T20:52:59.656 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-12-08T20:52:59.656 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-08T20:52:59.715 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-08T20:52:59.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:52:59.767 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T20:52:59.768 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-08T20:52:59.820 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T20:52:59.820 INFO:tasks.ceph:role: osd.2 2023-12-08T20:52:59.820 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T20:52:59.820 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-08T20:52:59.874 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T20:52:59.874 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T20:52:59.875 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T20:52:59.875 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T20:52:59.875 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T20:52:59.875 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-12-08T20:52:59.875 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T20:52:59.875 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T20:52:59.875 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T20:52:59.875 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T20:52:59.898 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-12-08T20:52:59.900 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-12-08T20:52:59.900 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-08T20:52:59.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-08T20:53:00.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:53:00.011 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T20:53:00.011 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-08T20:53:00.068 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T20:53:00.068 INFO:tasks.ceph:role: osd.3 2023-12-08T20:53:00.068 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T20:53:00.068 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-08T20:53:00.126 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T20:53:00.126 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T20:53:00.126 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T20:53:00.126 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T20:53:00.126 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T20:53:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-12-08T20:53:00.127 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T20:53:00.127 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T20:53:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T20:53:00.127 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T20:53:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-12-08T20:53:00.152 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-12-08T20:53:00.152 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-08T20:53:00.209 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-08T20:53:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T20:53:00.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:53:00.261 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:53:00.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:00.375+0000 7f510538e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-08T20:53:00.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:00.375+0000 7f510538e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-08T20:53:00.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:00.375+0000 7f510538e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-08T20:53:00.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:00.375+0000 7f510538e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-08T20:53:00.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:00.375+0000 7f510538e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-08T20:53:00.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:00.375+0000 7f510538e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-08T20:53:03.407 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-08T20:53:03.422 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:53:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:03.503+0000 7f5383714640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-08T20:53:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:03.503+0000 7f5383714640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-08T20:53:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:03.503+0000 7f5383714640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-08T20:53:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:03.503+0000 7f5383714640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-08T20:53:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:03.503+0000 7f5383714640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-08T20:53:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:03.503+0000 7f5383714640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-08T20:53:06.521 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-08T20:53:06.575 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:53:06.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:06.655+0000 7f8faafd5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-08T20:53:06.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:06.655+0000 7f8faafd5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-08T20:53:06.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:06.655+0000 7f8faafd5640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-08T20:53:06.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:06.655+0000 7f8faafd5640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-08T20:53:06.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:06.655+0000 7f8faafd5640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-08T20:53:06.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:06.655+0000 7f8faafd5640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-08T20:53:09.668 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-08T20:53:09.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:53:09.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:09.803+0000 7f03d3bdb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-08T20:53:09.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:09.803+0000 7f03d3bdb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-08T20:53:09.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:09.803+0000 7f03d3bdb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-08T20:53:09.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:09.803+0000 7f03d3bdb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-08T20:53:09.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:09.803+0000 7f03d3bdb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-08T20:53:09.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:09.803+0000 7f03d3bdb640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-08T20:53:12.804 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-08T20:53:12.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-08T20:53:12.874 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T20:53:12.874 INFO:tasks.ceph:role: osd.4 2023-12-08T20:53:12.874 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2023-12-08T20:53:12.874 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-08T20:53:12.935 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T20:53:12.936 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T20:53:12.936 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T20:53:12.936 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T20:53:12.936 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T20:53:12.936 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-12-08T20:53:12.937 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T20:53:12.937 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T20:53:12.937 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T20:53:12.937 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T20:53:13.388 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-12-08T20:53:13.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-12-08T20:53:13.391 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-08T20:53:13.488 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-08T20:53:13.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:53:13.499 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T20:53:13.500 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-08T20:53:13.551 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T20:53:13.552 INFO:tasks.ceph:role: osd.5 2023-12-08T20:53:13.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2023-12-08T20:53:13.552 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-08T20:53:13.616 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T20:53:13.616 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T20:53:13.616 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T20:53:13.616 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T20:53:13.616 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T20:53:13.616 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-12-08T20:53:13.616 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T20:53:13.616 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T20:53:13.616 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T20:53:13.616 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T20:53:14.079 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-12-08T20:53:14.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-12-08T20:53:14.081 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-08T20:53:14.221 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-08T20:53:14.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:53:14.233 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T20:53:14.233 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-08T20:53:14.288 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T20:53:14.288 INFO:tasks.ceph:role: osd.6 2023-12-08T20:53:14.288 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2023-12-08T20:53:14.288 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-08T20:53:14.353 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T20:53:14.353 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T20:53:14.354 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T20:53:14.354 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T20:53:14.354 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T20:53:14.354 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-12-08T20:53:14.354 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T20:53:14.354 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T20:53:14.354 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T20:53:14.354 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T20:53:14.839 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-12-08T20:53:14.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-12-08T20:53:14.841 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-08T20:53:14.981 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-08T20:53:14.991 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T20:53:14.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:53:14.992 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-08T20:53:15.049 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T20:53:15.049 INFO:tasks.ceph:role: osd.7 2023-12-08T20:53:15.049 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2023-12-08T20:53:15.049 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-08T20:53:15.116 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T20:53:15.117 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T20:53:15.117 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T20:53:15.117 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T20:53:15.117 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T20:53:15.117 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-12-08T20:53:15.118 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T20:53:15.118 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T20:53:15.118 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T20:53:15.118 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T20:53:15.552 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-12-08T20:53:15.554 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-12-08T20:53:15.554 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-08T20:53:15.668 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-08T20:53:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T20:53:15.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:53:15.680 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:53:15.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:15.888+0000 7f45cdbf0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-08T20:53:15.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:15.888+0000 7f45cdbf0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-08T20:53:15.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:15.888+0000 7f45cdbf0640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-08T20:53:15.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:15.888+0000 7f45cdbf0640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-08T20:53:15.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:15.888+0000 7f45cdbf0640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-08T20:53:15.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:15.896+0000 7f45cdbf0640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-08T20:53:18.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-08T20:53:18.926 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:53:19.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:19.004+0000 7f61d268c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-08T20:53:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:19.004+0000 7f61d268c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-08T20:53:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:19.004+0000 7f61d268c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-08T20:53:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:19.004+0000 7f61d268c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-08T20:53:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:19.004+0000 7f61d268c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-08T20:53:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:19.004+0000 7f61d268c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-08T20:53:22.030 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-08T20:53:22.085 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:53:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:22.168+0000 7fc292579640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-08T20:53:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:22.168+0000 7fc292579640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-08T20:53:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:22.168+0000 7fc292579640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-08T20:53:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:22.168+0000 7fc292579640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-08T20:53:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:22.168+0000 7fc292579640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-08T20:53:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:22.168+0000 7fc292579640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-08T20:53:25.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-08T20:53:25.256 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:53:25.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:25.336+0000 7fc8bc593640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-08T20:53:25.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:25.336+0000 7fc8bc593640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-08T20:53:25.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:25.336+0000 7fc8bc593640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-08T20:53:25.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:25.336+0000 7fc8bc593640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-08T20:53:25.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:25.336+0000 7fc8bc593640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-08T20:53:25.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:25.336+0000 7fc8bc593640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-08T20:53:26.214 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:53:26.217 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:53:28.367 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-08T20:53:28.381 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-08T20:53:28.381 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:28.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-08T20:53:28.396 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:28.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-08T20:53:28.451 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:28.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-08T20:53:28.506 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:28.506 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-12-08T20:53:28.562 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:28.562 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-08T20:53:28.618 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:28.618 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-08T20:53:28.674 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:28.674 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-08T20:53:28.730 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:28.730 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-08T20:53:28.786 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:53:28.786 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-08T20:53:28.799 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:53:28.799 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-08T20:53:28.851 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:53:28.851 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-08T20:53:28.903 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:53:28.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-12-08T20:53:28.955 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:53:28.955 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-08T20:53:29.007 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:53:29.007 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-08T20:53:29.059 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:53:29.059 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-08T20:53:29.116 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:53:29.116 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-08T20:53:29.172 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:29.172 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-08T20:53:29.178 INFO:tasks.ceph:Adding keys to all mons... 2023-12-08T20:53:29.178 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-08T20:53:29.223 DEBUG:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-08T20:53:29.233 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.y] 2023-12-08T20:53:29.233 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqgnNle3jxFhAAZ/3QylZShkFJP/7BWlsMWw== 2023-12-08T20:53:29.233 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2023-12-08T20:53:29.233 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqgnNlraedHBAAkO9N2d6BpDPuXjICssyWoA== 2023-12-08T20:53:29.233 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2023-12-08T20:53:29.233 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqgnNlhsYrJRAAgws/yH7Qlm6L7H9rSq3mQg== 2023-12-08T20:53:29.233 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.e] 2023-12-08T20:53:29.233 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqgnNl8q3aLRAA0X0x9zsifcULNJ0cx8La8w== 2023-12-08T20:53:29.233 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2023-12-08T20:53:29.233 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAsgnNlBryzFhAAkXIhqTkoTgwMAJ8JCMkDCQ== 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAvgnNlzvNgHhAAK+coQ6By6jDR9mDOrGRSDA== 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAygnNl5WFbJxAAYU8O7j51uPnwew5C59WWEA== 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA1gnNllNwyMBAAUOmB4ebr1zMEFCH+DUc9zw== 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqgnNlJwueGRAAvXk/rYaOzjpEqG+yQMhY2g== 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqgnNlu3zuMxAA5ZcQEiCQ6gI0LQNjOgVG1A== 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQArgnNlPdPyABAAOEB3rc5/VfX23Yj8q59vtw== 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.f] 2023-12-08T20:53:29.234 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQArgnNlv2CHCRAAPTmLP0NnzbRlvp5KqSPYNg== 2023-12-08T20:53:29.235 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.4] 2023-12-08T20:53:29.235 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA7gnNlFKYhNRAAMg6xz5nwN3YWfWghyI0dNg== 2023-12-08T20:53:29.235 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.5] 2023-12-08T20:53:29.235 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA/gnNl6vR9ABAAcnmNy1F27sAcrHhuZFaDZA== 2023-12-08T20:53:29.235 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.6] 2023-12-08T20:53:29.235 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBCgnNlzh4kChAAx/f4IeH1CVRGHdnf3uSE6w== 2023-12-08T20:53:29.235 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.7] 2023-12-08T20:53:29.235 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBFgnNlG+45FBAAdwPwFjyfusRL7dvtO6MQzg== 2023-12-08T20:53:29.235 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2023-12-08T20:53:29.235 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQArgnNl2mJMDxAAhZBUhT1JVAhXNL7FxJzHcw== 2023-12-08T20:53:29.236 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2023-12-08T20:53:29.236 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAqgnNle3jxFhAAZ/3QylZShkFJP/7BWlsMWw== 2023-12-08T20:53:29.236 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-12-08T20:53:29.236 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAqgnNlraedHBAAkO9N2d6BpDPuXjICssyWoA== 2023-12-08T20:53:29.236 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-12-08T20:53:29.236 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAqgnNlhsYrJRAAgws/yH7Qlm6L7H9rSq3mQg== 2023-12-08T20:53:29.236 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.e] 2023-12-08T20:53:29.236 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAqgnNl8q3aLRAA0X0x9zsifcULNJ0cx8La8w== 2023-12-08T20:53:29.236 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2023-12-08T20:53:29.236 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAsgnNlBryzFhAAkXIhqTkoTgwMAJ8JCMkDCQ== 2023-12-08T20:53:29.236 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2023-12-08T20:53:29.236 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAvgnNlzvNgHhAAK+coQ6By6jDR9mDOrGRSDA== 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAygnNl5WFbJxAAYU8O7j51uPnwew5C59WWEA== 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQA1gnNllNwyMBAAUOmB4ebr1zMEFCH+DUc9zw== 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAqgnNlJwueGRAAvXk/rYaOzjpEqG+yQMhY2g== 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAqgnNlu3zuMxAA5ZcQEiCQ6gI0LQNjOgVG1A== 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQArgnNlPdPyABAAOEB3rc5/VfX23Yj8q59vtw== 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.f] 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQArgnNlv2CHCRAAPTmLP0NnzbRlvp5KqSPYNg== 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQA7gnNlFKYhNRAAMg6xz5nwN3YWfWghyI0dNg== 2023-12-08T20:53:29.237 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2023-12-08T20:53:29.238 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQA/gnNl6vR9ABAAcnmNy1F27sAcrHhuZFaDZA== 2023-12-08T20:53:29.238 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2023-12-08T20:53:29.238 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBCgnNlzh4kChAAx/f4IeH1CVRGHdnf3uSE6w== 2023-12-08T20:53:29.238 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2023-12-08T20:53:29.238 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBFgnNlG+45FBAAdwPwFjyfusRL7dvtO6MQzg== 2023-12-08T20:53:29.238 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2023-12-08T20:53:29.238 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQArgnNl2mJMDxAAhZBUhT1JVAhXNL7FxJzHcw== 2023-12-08T20:53:29.239 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T20:53:29.283 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T20:53:29.331 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T20:53:29.375 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T20:53:29.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T20:53:29.427 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T20:53:29.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T20:53:29.516 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T20:53:29.559 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:29.561 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:29.644 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:29.647 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:29.732 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:29.735 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:29.816 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:29.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:29.899 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T20:53:29.904 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T20:53:29.980 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T20:53:29.988 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T20:53:30.068 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T20:53:30.071 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T20:53:30.117 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T20:53:30.119 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T20:53:30.196 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:30.207 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:30.277 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:30.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:30.358 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:30.379 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:30.441 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:30.444 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T20:53:30.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T20:53:30.531 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T20:53:30.610 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-08T20:53:30.611 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-08T20:53:30.632 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-08T20:53:30.729 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-08T20:53:30.740 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-08T20:53:30.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-08T20:53:30.850 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-08T20:53:30.861 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-08T20:53:30.913 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-08T20:53:31.008 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-08T20:53:31.019 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:53:31.022 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-08T20:53:31.065 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-08T20:53:31.066 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-08T20:53:31.066 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-08T20:53:31.066 DEBUG:teuthology.orchestra.run.smithi053:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-12-08T20:53:31.071 INFO:tasks.ceph.mon.a:Started 2023-12-08T20:53:31.071 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-08T20:53:31.071 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-08T20:53:31.072 DEBUG:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-12-08T20:53:31.110 INFO:tasks.ceph.mon.b:Started 2023-12-08T20:53:31.110 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-08T20:53:31.110 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-08T20:53:31.110 DEBUG:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-12-08T20:53:31.112 INFO:tasks.ceph.mon.c:Started 2023-12-08T20:53:31.113 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-08T20:53:31.113 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-08T20:53:31.113 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-12-08T20:53:31.115 INFO:tasks.ceph.mgr.y:Started 2023-12-08T20:53:31.116 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-08T20:53:31.116 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-12-08T20:53:31.118 INFO:tasks.ceph.mgr.x:Started 2023-12-08T20:53:31.118 INFO:tasks.ceph:Setting crush tunables to default 2023-12-08T20:53:31.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd crush tunables default 2023-12-08T20:53:31.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.231+0000 7f5219aee640 1 Processor -- start 2023-12-08T20:53:31.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.231+0000 7f5219aee640 1 -- start start 2023-12-08T20:53:31.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.231+0000 7f5219aee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52140c61b0 0x7f521406fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:31.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.231+0000 7f5219aee640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52140c6590 0x7f52140c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:31.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.231+0000 7f5219aee640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5214156ed0 con 0x7f52140c2a50 2023-12-08T20:53:31.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.231+0000 7f5219aee640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52140c7db0 con 0x7f52140c61b0 2023-12-08T20:53:31.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.231+0000 7f5219aee640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521406fff0 con 0x7f52140c6590 2023-12-08T20:53:31.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.231+0000 7f52137fe640 1 -- >> v2:172.21.15.53:3300/0 conn(0x7f52140c61b0 msgr2=0x7f521406fab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.53:3300/0 2023-12-08T20:53:31.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.231+0000 7f5213fff640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f52140c2a50 legacy=0x7f52140c2e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.53:6789/0 2023-12-08T20:53:31.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.231+0000 7f52137fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52140c61b0 0x7f521406fab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:53:31.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.231+0000 7f5212ffd640 1 -- >> v2:172.21.15.146:3300/0 conn(0x7f52140c6590 msgr2=0x7f52140c74b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3300/0 2023-12-08T20:53:31.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.231+0000 7f5212ffd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52140c6590 0x7f52140c74b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:53:31.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.435+0000 7f5213fff640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f52140c2a50 legacy=0x7f52140c2e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.53:6789/0 2023-12-08T20:53:31.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.435+0000 7f52137fe640 1 -- >> v2:172.21.15.53:3300/0 conn(0x7f52140c61b0 msgr2=0x7f521406fab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.53:3300/0 2023-12-08T20:53:31.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.435+0000 7f52137fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52140c61b0 0x7f521406fab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:53:31.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.435+0000 7f5212ffd640 1 -- >> v2:172.21.15.146:3300/0 conn(0x7f52140c6590 msgr2=0x7f52140c74b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3300/0 2023-12-08T20:53:31.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.435+0000 7f5212ffd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52140c6590 0x7f52140c74b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:53:31.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.839+0000 7f5213fff640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f52140c2a50 legacy=0x7f52140c2e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.53:6789/0 2023-12-08T20:53:31.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.839+0000 7f52137fe640 1 -- >> v2:172.21.15.53:3300/0 conn(0x7f52140c61b0 msgr2=0x7f521406fab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.53:3300/0 2023-12-08T20:53:31.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.839+0000 7f52137fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52140c61b0 0x7f521406fab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:53:31.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.839+0000 7f5212ffd640 1 -- >> v2:172.21.15.146:3300/0 conn(0x7f52140c6590 msgr2=0x7f52140c74b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3300/0 2023-12-08T20:53:31.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:31.839+0000 7f5212ffd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52140c6590 0x7f52140c74b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:53:32.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:32.643+0000 7f5213fff640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f52140c2a50 legacy=0x7f52140c2e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.53:6789/0 2023-12-08T20:53:32.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:32.643+0000 7f52137fe640 1 -- >> v2:172.21.15.53:3300/0 conn(0x7f52140c61b0 msgr2=0x7f521406fab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.53:3300/0 2023-12-08T20:53:32.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:32.643+0000 7f52137fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52140c61b0 0x7f521406fab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T20:53:32.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:32.643+0000 7f5212ffd640 1 -- >> v2:172.21.15.146:3300/0 conn(0x7f52140c6590 msgr2=0x7f52140c74b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3300/0 2023-12-08T20:53:32.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:32.643+0000 7f5212ffd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52140c6590 0x7f52140c74b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T20:53:34.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.231+0000 7f52117fa640 1 -- >> v2:172.21.15.146:3300/0 conn(0x7f52140c6590 msgr2=0x7f52140c74b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:34.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.231+0000 7f52117fa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52140c6590 0x7f52140c74b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:34.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.231+0000 7f52117fa640 1 -- >> v2:172.21.15.53:3300/0 conn(0x7f52140c61b0 msgr2=0x7f521406fab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:34.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.231+0000 7f52117fa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52140c61b0 0x7f521406fab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:34.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.231+0000 7f52117fa640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f52140c2a50 legacy=0x7f52140c2e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:34.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.231+0000 7f52117fa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4007380 0x7f51f4009840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:34.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.231+0000 7f52117fa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52141565a0 con 0x7f51f40036a0 2023-12-08T20:53:34.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.231+0000 7f52117fa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52140c7db0 con 0x7f51f4007380 2023-12-08T20:53:34.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.231+0000 7f52137fe640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f40036a0 legacy=0x7f51f4005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.146:6789/0 2023-12-08T20:53:34.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.231+0000 7f5212ffd640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4007380 msgr2=0x7f51f4009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3301/0 2023-12-08T20:53:34.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.231+0000 7f5212ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4007380 0x7f51f4009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:53:34.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.435+0000 7f5212ffd640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4007380 msgr2=0x7f51f4009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3301/0 2023-12-08T20:53:34.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.435+0000 7f52137fe640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f40036a0 legacy=0x7f51f4005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.146:6789/0 2023-12-08T20:53:34.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.435+0000 7f5212ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4007380 0x7f51f4009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:53:34.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.839+0000 7f5212ffd640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4007380 msgr2=0x7f51f4009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3301/0 2023-12-08T20:53:34.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.839+0000 7f52137fe640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f40036a0 legacy=0x7f51f4005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.146:6789/0 2023-12-08T20:53:34.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:34.839+0000 7f5212ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4007380 0x7f51f4009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:53:35.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:35.643+0000 7f52137fe640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f40036a0 legacy=0x7f51f4005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.146:6789/0 2023-12-08T20:53:35.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:35.643+0000 7f5212ffd640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4007380 msgr2=0x7f51f4009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3301/0 2023-12-08T20:53:35.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:35.643+0000 7f5212ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4007380 0x7f51f4009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T20:53:37.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f52117fa640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4007380 msgr2=0x7f51f4009840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f52117fa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4007380 0x7f51f4009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f52117fa640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f40036a0 legacy=0x7f51f4005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f5213fff640 1 -- reap_dead start 2023-12-08T20:53:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f52117fa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f51f4009f50 0x7f51f400a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f52117fa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a8b0 0x7f51f4007810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f52117fa640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5214156ed0 con 0x7f51f4005b20 2023-12-08T20:53:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f52117fa640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52140c7db0 con 0x7f51f4009f50 2023-12-08T20:53:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f5213fff640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f51f4005b20 legacy=0x7f51f4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.53:6789/0 2023-12-08T20:53:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f52117fa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521406fff0 con 0x7f51f400a8b0 2023-12-08T20:53:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f5212ffd640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a8b0 msgr2=0x7f51f4007810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3301/0 2023-12-08T20:53:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f52137fe640 1 -- >> v2:172.21.15.146:3300/0 conn(0x7f51f4009f50 msgr2=0x7f51f400a370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3300/0 2023-12-08T20:53:37.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f5212ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a8b0 0x7f51f4007810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:53:37.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.231+0000 7f52137fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f51f4009f50 0x7f51f400a370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:53:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.435+0000 7f5213fff640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f51f4005b20 legacy=0x7f51f4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.53:6789/0 2023-12-08T20:53:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.435+0000 7f52137fe640 1 -- >> v2:172.21.15.146:3300/0 conn(0x7f51f4009f50 msgr2=0x7f51f400a370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3300/0 2023-12-08T20:53:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.435+0000 7f5212ffd640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a8b0 msgr2=0x7f51f4007810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3301/0 2023-12-08T20:53:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.435+0000 7f52137fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f51f4009f50 0x7f51f400a370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:53:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.435+0000 7f5212ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a8b0 0x7f51f4007810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:53:37.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.839+0000 7f5213fff640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f51f4005b20 legacy=0x7f51f4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.53:6789/0 2023-12-08T20:53:37.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.839+0000 7f52137fe640 1 -- >> v2:172.21.15.146:3300/0 conn(0x7f51f4009f50 msgr2=0x7f51f400a370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3300/0 2023-12-08T20:53:37.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.839+0000 7f5212ffd640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a8b0 msgr2=0x7f51f4007810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3301/0 2023-12-08T20:53:37.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.839+0000 7f52137fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f51f4009f50 0x7f51f400a370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:53:37.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:37.839+0000 7f5212ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a8b0 0x7f51f4007810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:53:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:38.643+0000 7f5213fff640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f51f4005b20 legacy=0x7f51f4006250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.53:6789/0 2023-12-08T20:53:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:38.643+0000 7f52137fe640 1 -- >> v2:172.21.15.146:3300/0 conn(0x7f51f4009f50 msgr2=0x7f51f400a370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3300/0 2023-12-08T20:53:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:38.643+0000 7f5212ffd640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a8b0 msgr2=0x7f51f4007810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3301/0 2023-12-08T20:53:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:38.643+0000 7f52137fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f51f4009f50 0x7f51f400a370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T20:53:38.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:38.643+0000 7f5212ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a8b0 0x7f51f4007810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T20:53:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.231+0000 7f52117fa640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a8b0 msgr2=0x7f51f4007810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.231+0000 7f52117fa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a8b0 0x7f51f4007810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.231+0000 7f52117fa640 1 -- >> v2:172.21.15.146:3300/0 conn(0x7f51f4009f50 msgr2=0x7f51f400a370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.231+0000 7f52117fa640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f51f4009f50 0x7f51f400a370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.231+0000 7f52117fa640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f51f4005b20 legacy=0x7f51f4006250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.231+0000 7f52117fa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51f400e860 0x7f51f40163a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.231+0000 7f52117fa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52141565a0 con 0x7f51f4006a40 2023-12-08T20:53:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.231+0000 7f52117fa640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52140c7db0 con 0x7f51f400e860 2023-12-08T20:53:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.235+0000 7f5212ffd640 1 -- >> v2:172.21.15.53:3300/0 conn(0x7f51f400e860 msgr2=0x7f51f40163a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.53:3300/0 2023-12-08T20:53:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.235+0000 7f5212ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51f400e860 0x7f51f40163a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:53:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.235+0000 7f52137fe640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f4006a40 legacy=0x7f51f400e150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.146:6789/0 2023-12-08T20:53:40.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.439+0000 7f5212ffd640 1 -- >> v2:172.21.15.53:3300/0 conn(0x7f51f400e860 msgr2=0x7f51f40163a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.53:3300/0 2023-12-08T20:53:40.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.439+0000 7f52137fe640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f4006a40 legacy=0x7f51f400e150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.146:6789/0 2023-12-08T20:53:40.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.439+0000 7f5212ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51f400e860 0x7f51f40163a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:53:40.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.843+0000 7f5212ffd640 1 -- >> v2:172.21.15.53:3300/0 conn(0x7f51f400e860 msgr2=0x7f51f40163a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.53:3300/0 2023-12-08T20:53:40.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.843+0000 7f52137fe640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f4006a40 legacy=0x7f51f400e150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.146:6789/0 2023-12-08T20:53:40.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:40.843+0000 7f5212ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51f400e860 0x7f51f40163a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:53:41.030 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:00:09.753 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T20:53:41.047 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:00:09.770 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T20:53:41.362 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:00:10.157 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T20:53:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:41.647+0000 7f5212ffd640 1 -- >> v2:172.21.15.53:3300/0 conn(0x7f51f400e860 msgr2=0x7f51f40163a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.53:3300/0 2023-12-08T20:53:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:41.647+0000 7f5212ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51f400e860 0x7f51f40163a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T20:53:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:41.647+0000 7f52137fe640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f4006a40 legacy=0x7f51f400e150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.146:6789/0 2023-12-08T20:53:41.863 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:00:10.586 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T20:53:41.881 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:00:10.605 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T20:53:42.241 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:00:11.036 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T20:53:43.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.239+0000 7f52117fa640 1 -- >> v2:172.21.15.53:3300/0 conn(0x7f51f400e860 msgr2=0x7f51f40163a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.239+0000 7f52117fa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51f400e860 0x7f51f40163a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.239+0000 7f52117fa640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f4006a40 legacy=0x7f51f400e150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.239+0000 7f5213fff640 1 -- reap_dead start 2023-12-08T20:53:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.239+0000 7f52117fa640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 0x7f51f400e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.239+0000 7f52117fa640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5214156ed0 con 0x7f51f4005b20 2023-12-08T20:53:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.239+0000 7f52117fa640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52141565a0 con 0x7f51f400ec40 2023-12-08T20:53:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.239+0000 7f52117fa640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52140c7db0 con 0x7f51f400a350 2023-12-08T20:53:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.239+0000 7f52137fe640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f51f4005b20 legacy=0x7f51f4006230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.53:6789/0 2023-12-08T20:53:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.239+0000 7f5212ffd640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f400ec40 legacy=0x7f51f4008800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.146:6789/0 2023-12-08T20:53:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.239+0000 7f5213fff640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 msgr2=0x7f51f400e150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3301/0 2023-12-08T20:53:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.239+0000 7f5213fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 0x7f51f400e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:53:43.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.443+0000 7f52137fe640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f51f4005b20 legacy=0x7f51f4006230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.53:6789/0 2023-12-08T20:53:43.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.443+0000 7f5213fff640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 msgr2=0x7f51f400e150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3301/0 2023-12-08T20:53:43.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.443+0000 7f5212ffd640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f400ec40 legacy=0x7f51f4008800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.146:6789/0 2023-12-08T20:53:43.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.443+0000 7f5213fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 0x7f51f400e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:53:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.847+0000 7f52137fe640 1 -- >> v1:172.21.15.53:6789/0 conn(0x7f51f4005b20 legacy=0x7f51f4006230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.53:6789/0 2023-12-08T20:53:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.847+0000 7f5213fff640 1 -- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 msgr2=0x7f51f400e150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.146:3301/0 2023-12-08T20:53:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.847+0000 7f5212ffd640 1 -- >> v1:172.21.15.146:6789/0 conn(0x7f51f400ec40 legacy=0x7f51f4008800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.146:6789/0 2023-12-08T20:53:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:43.847+0000 7f5213fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 0x7f51f400e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:53:44.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:44.679+0000 7f5213fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 0x7f51f400e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:44.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:44.679+0000 7f5213fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 0x7f51f400e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:58646/0 (socket says 172.21.15.53:58646) 2023-12-08T20:53:44.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:44.679+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 learned_addr learned my addr 172.21.15.53:0/1869463238 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:53:44.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:44.707+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 msgr2=0x7f51f400e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-08T20:53:44.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:44.707+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 msgr2=0x7f51f400e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:44.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:44.707+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 0x7f51f400e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:44.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:44.707+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 0x7f51f400e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T20:53:45.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:45.331+0000 7f52137fe640 1 -- 172.21.15.53:0/1869463238 >> v1:172.21.15.53:6789/0 conn(0x7f51f4005b20 legacy=0x7f51f4006230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T20:53:45.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:45.331+0000 7f52137fe640 1 -- 172.21.15.53:0/1869463238 >> v1:172.21.15.53:6789/0 conn(0x7f51f4005b20 legacy=0x7f51f4006230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:45.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:45.331+0000 7f52137fe640 1 --1- 172.21.15.53:0/1869463238 >> v1:172.21.15.53:6789/0 conn(0x7f51f4005b20 0x7f51f4006230 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2023-12-08T20:53:46.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.239+0000 7f52117fa640 1 -- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 msgr2=0x7f51f400e150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:46.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.239+0000 7f52117fa640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400a350 0x7f51f400e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:46.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.239+0000 7f52117fa640 1 -- 172.21.15.53:0/1869463238 >> v1:172.21.15.146:6789/0 conn(0x7f51f400ec40 legacy=0x7f51f4008800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:46.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.239+0000 7f52117fa640 1 -- 172.21.15.53:0/1869463238 >> v1:172.21.15.53:6789/0 conn(0x7f51f4005b20 legacy=0x7f51f4006230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:46.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.239+0000 7f52117fa640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:46.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.239+0000 7f52117fa640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:46.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.239+0000 7f52117fa640 1 -- 172.21.15.53:0/1869463238 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52140c7db0 con 0x7f51f4008f10 2023-12-08T20:53:46.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.239+0000 7f52117fa640 1 -- 172.21.15.53:0/1869463238 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521406fff0 con 0x7f51f4009860 2023-12-08T20:53:46.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.275+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.363+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-08T20:53:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.363+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.363+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.363+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:53:46.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.475+0000 7f52137fe640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:46.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.567+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:46.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.567+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-08T20:53:46.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.567+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:46.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.567+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:46.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.571+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:53:46.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.623+0000 7f52137fe640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 msgr2=0x7f51f4009320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T20:53:46.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.623+0000 7f52137fe640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 msgr2=0x7f51f4009320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:46.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.623+0000 7f52137fe640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:46.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.623+0000 7f52137fe640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:53:46.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.867+0000 7f52137fe640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:46.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.963+0000 7f52137fe640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 msgr2=0x7f51f4009320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T20:53:46.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.963+0000 7f52137fe640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 msgr2=0x7f51f4009320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:46.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.963+0000 7f52137fe640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:46.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:46.963+0000 7f52137fe640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:53:47.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:47.071+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:47.159+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T20:53:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:47.159+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:47.159+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:47.159+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:53:47.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:47.963+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:47.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:47.967+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-08T20:53:47.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:47.967+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:47.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:47.967+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:47.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:47.967+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T20:53:48.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:48.071+0000 7f52137fe640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:48.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:48.071+0000 7f52137fe640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 msgr2=0x7f51f4009320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T20:53:48.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:48.071+0000 7f52137fe640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 msgr2=0x7f51f4009320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:48.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:48.071+0000 7f52137fe640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:48.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:48.071+0000 7f52137fe640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:53:48.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:48.963+0000 7f52137fe640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:48.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:48.967+0000 7f52137fe640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 msgr2=0x7f51f4009320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T20:53:48.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:48.967+0000 7f52137fe640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 msgr2=0x7f51f4009320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:48.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:48.967+0000 7f52137fe640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:48.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:48.967+0000 7f52137fe640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T20:53:49.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.239+0000 7f52117fa640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:49.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.239+0000 7f52117fa640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:49.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.239+0000 7f52117fa640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 msgr2=0x7f51f4009320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T20:53:49.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.239+0000 7f52117fa640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.53:3300/0 conn(0x7f51f4008f10 0x7f51f4009320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:49.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.239+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 reap_dead start 2023-12-08T20:53:49.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.239+0000 7f52117fa640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:49.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.239+0000 7f52117fa640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:49.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.239+0000 7f52117fa640 1 -- 172.21.15.53:0/1869463238 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f400e690 con 0x7f51f400ec40 2023-12-08T20:53:49.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.239+0000 7f52117fa640 1 -- 172.21.15.53:0/1869463238 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52140c7db0 con 0x7f51f4009860 2023-12-08T20:53:49.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.239+0000 7f52117fa640 1 -- 172.21.15.53:0/1869463238 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521406fff0 con 0x7f51f4008f10 2023-12-08T20:53:49.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.239+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:49.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.239+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:49.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.243+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 msgr2=0x7f51f400e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-08T20:53:49.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.243+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 msgr2=0x7f51f400e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:49.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.243+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:49.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.243+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:53:49.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.247+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-08T20:53:49.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.247+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:49.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.247+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:49.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.247+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:53:49.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.535+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.543+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-08T20:53:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.543+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.543+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.543+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:53:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.547+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:49.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.563+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 msgr2=0x7f51f400e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-08T20:53:49.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.563+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 msgr2=0x7f51f400e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:49.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.563+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:49.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:49.563+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:53:50.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:50.247+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:50.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:50.295+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:50.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:50.443+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 msgr2=0x7f51f400e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-08T20:53:50.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:50.443+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 msgr2=0x7f51f400e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:50.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:50.443+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:50.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:50.443+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:53:50.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:50.451+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-08T20:53:50.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:50.451+0000 7f5212ffd640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T20:53:50.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:50.451+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T20:53:50.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:50.451+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:53:51.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.031+0000 7f52127fc640 1 -- 172.21.15.53:0/1869463238 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915078631 0 0) 0x7f51f400e690 con 0x7f51f400ec40 2023-12-08T20:53:51.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.031+0000 7f52127fc640 1 -- 172.21.15.53:0/1869463238 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5200003530 con 0x7f51f400ec40 2023-12-08T20:53:51.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.359+0000 7f5212ffd640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:51.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.371+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.379+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 msgr2=0x7f51f40173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:53:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.379+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.379+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 >> v1:172.21.15.146:6789/0 conn(0x7f51f400ec40 legacy=0x7f51f4008800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.379+0000 7f5213fff640 1 -- 172.21.15.53:0/1869463238 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5214156ed0 con 0x7f51f4008f10 2023-12-08T20:53:51.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.391+0000 7f5213fff640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f51f4006200 tx=0x7f520c01d280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53d762b773cb21a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:51.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.459+0000 7f52127fc640 1 -- 172.21.15.53:0/1869463238 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c0ac600 con 0x7f51f4008f10 2023-12-08T20:53:51.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.459+0000 7f52127fc640 1 -- 172.21.15.53:0/1869463238 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c0a8050 con 0x7f51f4008f10 2023-12-08T20:53:51.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.459+0000 7f52127fc640 1 -- 172.21.15.53:0/1869463238 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c0aca00 con 0x7f51f4008f10 2023-12-08T20:53:51.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.459+0000 7f5219aee640 1 -- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 msgr2=0x7f51f400e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:51.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.459+0000 7f5219aee640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f51f4006200 tx=0x7f520c01d280 comp rx=0 tx=0).stop 2023-12-08T20:53:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.459+0000 7f5219aee640 1 -- 172.21.15.53:0/1869463238 shutdown_connections 2023-12-08T20:53:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.459+0000 7f5219aee640 1 --2- 172.21.15.53:0/1869463238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f4008f10 0x7f51f400e150 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.459+0000 7f5219aee640 1 --2- 172.21.15.53:0/1869463238 >> v2:172.21.15.146:3300/0 conn(0x7f51f4009860 0x7f51f40173a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.459+0000 7f5219aee640 1 -- 172.21.15.53:0/1869463238 >> 172.21.15.53:0/1869463238 conn(0x7f52140cbb50 msgr2=0x7f521406f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.463+0000 7f5219aee640 1 -- 172.21.15.53:0/1869463238 shutdown_connections 2023-12-08T20:53:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.463+0000 7f5219aee640 1 -- 172.21.15.53:0/1869463238 wait complete. 2023-12-08T20:53:51.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.463+0000 7f5219aee640 1 Processor -- start 2023-12-08T20:53:51.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.463+0000 7f5219aee640 1 -- start start 2023-12-08T20:53:51.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.467+0000 7f5219aee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f4008f10 0x7f52140ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:51.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.467+0000 7f5219aee640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51f4009860 0x7f5214157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:51.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.467+0000 7f5219aee640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400ec40 0x7f5214157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:51.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.467+0000 7f5219aee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52141593c0 con 0x7f51f4008f10 2023-12-08T20:53:51.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.467+0000 7f5219aee640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52141ef230 con 0x7f51f4009860 2023-12-08T20:53:51.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.467+0000 7f5219aee640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521414f670 con 0x7f51f400ec40 2023-12-08T20:53:51.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.483+0000 7f52137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f4008f10 0x7f52140ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:51.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.487+0000 7f52137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f4008f10 0x7f52140ca600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42972/0 (socket says 172.21.15.53:42972) 2023-12-08T20:53:51.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.487+0000 7f52137fe640 1 -- 172.21.15.53:0/4276762724 learned_addr learned my addr 172.21.15.53:0/4276762724 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:53:51.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.491+0000 7f52137fe640 1 -- 172.21.15.53:0/4276762724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400ec40 msgr2=0x7f5214157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:51.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.491+0000 7f52137fe640 1 --2- 172.21.15.53:0/4276762724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400ec40 0x7f5214157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:51.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.491+0000 7f52137fe640 1 -- 172.21.15.53:0/4276762724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51f4009860 msgr2=0x7f5214157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:51.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.491+0000 7f52137fe640 1 --2- 172.21.15.53:0/4276762724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51f4009860 0x7f5214157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:51.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.491+0000 7f52137fe640 1 -- 172.21.15.53:0/4276762724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c009990 con 0x7f51f4008f10 2023-12-08T20:53:51.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.495+0000 7f52137fe640 1 --2- 172.21.15.53:0/4276762724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f4008f10 0x7f52140ca600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f520400be10 tx=0x7f520400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:51.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.555+0000 7f520bfff640 1 -- 172.21.15.53:0/4276762724 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204005880 con 0x7f51f4008f10 2023-12-08T20:53:51.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.555+0000 7f520bfff640 1 -- 172.21.15.53:0/4276762724 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204011070 con 0x7f51f4008f10 2023-12-08T20:53:51.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.555+0000 7f5219aee640 1 -- 172.21.15.53:0/4276762724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5214154df0 con 0x7f51f4008f10 2023-12-08T20:53:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.555+0000 7f520bfff640 1 -- 172.21.15.53:0/4276762724 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040173f0 con 0x7f51f4008f10 2023-12-08T20:53:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.555+0000 7f5219aee640 1 -- 172.21.15.53:0/4276762724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52141eebe0 con 0x7f51f4008f10 2023-12-08T20:53:51.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.559+0000 7f5219aee640 1 -- 172.21.15.53:0/4276762724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5214074190 con 0x7f51f4008f10 2023-12-08T20:53:51.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.575+0000 7f520bfff640 1 -- 172.21.15.53:0/4276762724 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5204017850 con 0x7f51f4008f10 2023-12-08T20:53:51.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.575+0000 7f520bfff640 1 -- 172.21.15.53:0/4276762724 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f52040209c0 con 0x7f51f4008f10 2023-12-08T20:53:51.753 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:51.751+0000 7f7ee0364180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-08T20:53:51.879 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:51.876+0000 7f5497455180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-08T20:53:51.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.891+0000 7f520bfff640 1 -- 172.21.15.53:0/4276762724 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f520401b020 con 0x7f51f4008f10 2023-12-08T20:53:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:51.995+0000 7f5219aee640 1 -- 172.21.15.53:0/4276762724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f521414f8e0 con 0x7f51f4008f10 2023-12-08T20:53:52.328 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:52.327+0000 7f7ee0364180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-08T20:53:52.439 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:52.436+0000 7f5497455180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-08T20:53:52.515 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:52.515+0000 7f7ee0364180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-08T20:53:52.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:52.579+0000 7f520bfff640 1 -- 172.21.15.53:0/4276762724 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f52040204c0 con 0x7f51f4008f10 2023-12-08T20:53:52.581 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2023-12-08T20:53:52.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:52.583+0000 7f5219aee640 1 -- 172.21.15.53:0/4276762724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f4008f10 msgr2=0x7f52140ca600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:52.583+0000 7f5219aee640 1 --2- 172.21.15.53:0/4276762724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f4008f10 0x7f52140ca600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f520400be10 tx=0x7f520400bf00 comp rx=0 tx=0).stop 2023-12-08T20:53:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:52.583+0000 7f5219aee640 1 -- 172.21.15.53:0/4276762724 shutdown_connections 2023-12-08T20:53:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:52.583+0000 7f5219aee640 1 --2- 172.21.15.53:0/4276762724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51f400ec40 0x7f5214157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:52.583+0000 7f5219aee640 1 --2- 172.21.15.53:0/4276762724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51f4009860 0x7f5214157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:52.583+0000 7f5219aee640 1 --2- 172.21.15.53:0/4276762724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f4008f10 0x7f52140ca600 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:52.583+0000 7f5219aee640 1 -- 172.21.15.53:0/4276762724 >> 172.21.15.53:0/4276762724 conn(0x7f52140cbb50 msgr2=0x7f521414eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:52.583+0000 7f5219aee640 1 -- 172.21.15.53:0/4276762724 shutdown_connections 2023-12-08T20:53:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:53:52.583+0000 7f5219aee640 1 -- 172.21.15.53:0/4276762724 wait complete. 2023-12-08T20:53:52.603 INFO:tasks.ceph:check_enable_crimson: False 2023-12-08T20:53:52.603 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-08T20:53:52.604 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:52.604 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-08T20:53:52.616 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:52.616 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-08T20:53:52.646 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:52.644+0000 7f5497455180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-08T20:53:52.669 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:52.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-08T20:53:52.726 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:53:52.726 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-08T20:53:52.781 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:53:52.781 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-08T20:53:52.794 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:53:52.794 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-08T20:53:52.848 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:53:52.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-08T20:53:52.903 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-12-08T20:53:52.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-08T20:53:52.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new c998f36b-7c21-4e9d-b670-855b2acda0d3 0 2023-12-08T20:53:53.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.116+0000 7fc3c0f15640 1 Processor -- start 2023-12-08T20:53:53.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.116+0000 7fc3c0f15640 1 -- start start 2023-12-08T20:53:53.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.116+0000 7fc3c0f15640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc3bc14ff30 0x7fc3bc071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:53.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.116+0000 7fc3c0f15640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3bc0c7030 0x7fc3bc071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:53.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.116+0000 7fc3c0f15640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc072ad0 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.116+0000 7fc3c0f15640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3bc150310 con 0x7fc3bc14ff30 2023-12-08T20:53:53.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.116+0000 7fc3c0f15640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3bc0c76f0 con 0x7fc3bc0c7030 2023-12-08T20:53:53.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.116+0000 7fc3b9d9b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3bc0c7030 0x7fc3bc071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.116+0000 7fc3bad9d640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc3bc0c6ac0 0x7fc3bc0c4750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37328/0 (socket says 172.21.15.146:37328) 2023-12-08T20:53:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.116+0000 7fc3bad9d640 1 -- 172.21.15.146:0/3952603187 learned_addr learned my addr 172.21.15.146:0/3952603187 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-12-08T20:53:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.116+0000 7fc3ba59c640 1 --2- 172.21.15.146:0/3952603187 >> v2:172.21.15.53:3300/0 conn(0x7fc3bc14ff30 0x7fc3bc071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:53.120 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:53.119+0000 7f7ee0364180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-08T20:53:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.120+0000 7fc3b9d9b640 1 -- 172.21.15.146:0/3952603187 >> v2:172.21.15.53:3300/0 conn(0x7fc3bc14ff30 msgr2=0x7fc3bc071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:53:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.120+0000 7fc3b9d9b640 1 --2- 172.21.15.146:0/3952603187 >> v2:172.21.15.53:3300/0 conn(0x7fc3bc14ff30 0x7fc3bc071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.120+0000 7fc3b9d9b640 1 -- 172.21.15.146:0/3952603187 >> v1:172.21.15.146:6789/0 conn(0x7fc3bc0c6ac0 legacy=0x7fc3bc0c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.120+0000 7fc3b9d9b640 1 -- 172.21.15.146:0/3952603187 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc0c79d0 con 0x7fc3bc0c7030 2023-12-08T20:53:53.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.128+0000 7fc3b9d9b640 1 --2- 172.21.15.146:0/3952603187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3bc0c7030 0x7fc3bc071bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0c8fb0 tx=0x7fc3b001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71fc2806fb60e430 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:53.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3b959a640 1 -- 172.21.15.146:0/3952603187 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00ab600 con 0x7fc3bc0c7030 2023-12-08T20:53:53.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3b959a640 1 -- 172.21.15.146:0/3952603187 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b00a7050 con 0x7fc3bc0c7030 2023-12-08T20:53:53.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3b959a640 1 -- 172.21.15.146:0/3952603187 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00ab980 con 0x7fc3bc0c7030 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 -- 172.21.15.146:0/3952603187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3bc0c7030 msgr2=0x7fc3bc071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 --2- 172.21.15.146:0/3952603187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3bc0c7030 0x7fc3bc071bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0c8fb0 tx=0x7fc3b001c460 comp rx=0 tx=0).stop 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 -- 172.21.15.146:0/3952603187 shutdown_connections 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 --2- 172.21.15.146:0/3952603187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3bc0c7030 0x7fc3bc071bd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 --2- 172.21.15.146:0/3952603187 >> v2:172.21.15.53:3300/0 conn(0x7fc3bc14ff30 0x7fc3bc071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 -- 172.21.15.146:0/3952603187 >> 172.21.15.146:0/3952603187 conn(0x7fc3bc0c7f70 msgr2=0x7fc3bc0c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 -- 172.21.15.146:0/3952603187 shutdown_connections 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 -- 172.21.15.146:0/3952603187 wait complete. 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 Processor -- start 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 -- start start 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3bc0c6ac0 0x7fc3bc142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3bc0c7030 0x7fc3bc140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3bc14ff30 0x7fc3bc1411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:53.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1f6000 con 0x7fc3bc14ff30 2023-12-08T20:53:53.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1f5a80 con 0x7fc3bc0c7030 2023-12-08T20:53:53.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.136+0000 7fc3c0f15640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1f5d20 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.140+0000 7fc3ba59c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3bc0c6ac0 0x7fc3bc142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:53.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.140+0000 7fc3bad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3bc14ff30 0x7fc3bc1411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:53.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.140+0000 7fc3ba59c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3bc0c6ac0 0x7fc3bc142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39376/0 (socket says 172.21.15.146:39376) 2023-12-08T20:53:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.140+0000 7fc3ba59c640 1 -- 172.21.15.146:0/2814474093 learned_addr learned my addr 172.21.15.146:0/2814474093 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-12-08T20:53:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.144+0000 7fc3ba59c640 1 -- 172.21.15.146:0/2814474093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3bc0c7030 msgr2=0x7fc3bc140c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.144+0000 7fc3ba59c640 1 --2- 172.21.15.146:0/2814474093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3bc0c7030 0x7fc3bc140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.144+0000 7fc3ba59c640 1 -- 172.21.15.146:0/2814474093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3bc14ff30 msgr2=0x7fc3bc1411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.144+0000 7fc3ba59c640 1 --2- 172.21.15.146:0/2814474093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3bc14ff30 0x7fc3bc1411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.144+0000 7fc3ba59c640 1 -- 172.21.15.146:0/2814474093 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0009420 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.144+0000 7fc3ba59c640 1 --2- 172.21.15.146:0/2814474093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3bc0c6ac0 0x7fc3bc142db0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400e910 tx=0x7fc3b400edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.148+0000 7fc3aaffd640 1 -- 172.21.15.146:0/2814474093 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b400cc40 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.148+0000 7fc3c0f15640 1 -- 172.21.15.146:0/2814474093 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc159930 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.148+0000 7fc3c0f15640 1 -- 172.21.15.146:0/2814474093 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc06b6d0 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.148+0000 7fc3c0f15640 1 -- 172.21.15.146:0/2814474093 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc074190 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.148+0000 7fc3aaffd640 1 -- 172.21.15.146:0/2814474093 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b400cda0 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.148+0000 7fc3aaffd640 1 -- 172.21.15.146:0/2814474093 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4005ba0 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.177 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:53.175+0000 7f7ee0364180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-08T20:53:53.231 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:53.231+0000 7f7ee0364180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-08T20:53:53.239 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:53.236+0000 7f5497455180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-08T20:53:53.294 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:53.292+0000 7f5497455180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-08T20:53:53.312 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:53.311+0000 7f7ee0364180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-08T20:53:53.347 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:53.344+0000 7f5497455180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-08T20:53:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.352+0000 7fc3aaffd640 1 -- 172.21.15.146:0/2814474093 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc3b4006390 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.352+0000 7fc3aaffd640 1 -- 172.21.15.146:0/2814474093 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc3b401b9e0 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.352+0000 7fc3aaffd640 1 -- 172.21.15.146:0/2814474093 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc3b4020060 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.366 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:53.367+0000 7f7ee0364180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-08T20:53:53.427 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:53.424+0000 7f5497455180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-08T20:53:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.432+0000 7fc3c0f15640 1 -- 172.21.15.146:0/2814474093 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c998f36b-7c21-4e9d-b670-855b2acda0d3", "id": 0} v 0) v1 -- 0x7fc3bc06bcf0 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.448 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:53.447+0000 7f7ee0364180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-08T20:53:53.482 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:53.480+0000 7f5497455180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-08T20:53:53.504 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:53.503+0000 7f7ee0364180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-08T20:53:53.564 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:53.564+0000 7f5497455180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-08T20:53:53.617 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:53.616+0000 7f5497455180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-08T20:53:53.651 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:53.651+0000 7f7ee0364180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-08T20:53:53.716 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:53.715+0000 7f7ee0364180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-08T20:53:53.759 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:53.756+0000 7f5497455180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-08T20:53:53.821 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:53.820+0000 7f5497455180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-08T20:53:53.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.936+0000 7fc3aaffd640 1 -- 172.21.15.146:0/2814474093 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c998f36b-7c21-4e9d-b670-855b2acda0d3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc3b4016070 con 0x7fc3bc0c6ac0 2023-12-08T20:53:53.937 INFO:teuthology.orchestra.run.smithi146.stdout:0 2023-12-08T20:53:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.936+0000 7fc3c0f15640 1 -- 172.21.15.146:0/2814474093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3bc0c6ac0 msgr2=0x7fc3bc142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.936+0000 7fc3c0f15640 1 --2- 172.21.15.146:0/2814474093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3bc0c6ac0 0x7fc3bc142db0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400e910 tx=0x7fc3b400edd0 comp rx=0 tx=0).stop 2023-12-08T20:53:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.936+0000 7fc3c0f15640 1 -- 172.21.15.146:0/2814474093 shutdown_connections 2023-12-08T20:53:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.936+0000 7fc3c0f15640 1 --2- 172.21.15.146:0/2814474093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3bc14ff30 0x7fc3bc1411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.936+0000 7fc3c0f15640 1 --2- 172.21.15.146:0/2814474093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3bc0c7030 0x7fc3bc140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.936+0000 7fc3c0f15640 1 --2- 172.21.15.146:0/2814474093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3bc0c6ac0 0x7fc3bc142db0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.936+0000 7fc3c0f15640 1 -- 172.21.15.146:0/2814474093 >> 172.21.15.146:0/2814474093 conn(0x7fc3bc0c7f70 msgr2=0x7fc3bc0c61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.936+0000 7fc3c0f15640 1 -- 172.21.15.146:0/2814474093 shutdown_connections 2023-12-08T20:53:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:53.936+0000 7fc3c0f15640 1 -- 172.21.15.146:0/2814474093 wait complete. 2023-12-08T20:53:53.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 8d77a649-afd9-4a9c-b26d-e8441f648abe 1 2023-12-08T20:53:54.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.072+0000 7fcab18e7640 1 Processor -- start 2023-12-08T20:53:54.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.072+0000 7fcab18e7640 1 -- start start 2023-12-08T20:53:54.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.072+0000 7fcab18e7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcaac153960 0x7fcaac06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:54.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.072+0000 7fcab18e7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac159610 con 0x7fcaac06edd0 2023-12-08T20:53:54.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.072+0000 7fcab18e7640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac153d40 con 0x7fcaac0c2de0 2023-12-08T20:53:54.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.072+0000 7fcab18e7640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac1598d0 con 0x7fcaac153960 2023-12-08T20:53:54.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.076+0000 7fcaaaffd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcaac153960 0x7fcaac06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:54.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.076+0000 7fcaab7fe640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcaac0c2de0 0x7fcaac163f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37332/0 (socket says 172.21.15.146:37332) 2023-12-08T20:53:54.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.076+0000 7fcaab7fe640 1 -- 172.21.15.146:0/3253195926 learned_addr learned my addr 172.21.15.146:0/3253195926 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-12-08T20:53:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.080+0000 7fcaaaffd640 1 -- 172.21.15.146:0/3253195926 >> v1:172.21.15.146:6789/0 conn(0x7fcaac0c2de0 legacy=0x7fcaac163f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.080+0000 7fcaaaffd640 1 -- 172.21.15.146:0/3253195926 >> v1:172.21.15.53:6789/0 conn(0x7fcaac06edd0 legacy=0x7fcaac15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.080+0000 7fcaaaffd640 1 -- 172.21.15.146:0/3253195926 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac159bb0 con 0x7fcaac153960 2023-12-08T20:53:54.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.088+0000 7fcaaaffd640 1 --2- 172.21.15.146:0/3253195926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaac153960 0x7fcaac06a5b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009d90 tx=0x7fca9c01f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e891821bafa76f24 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:54.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.092+0000 7fcaa9ffb640 1 -- 172.21.15.146:0/3253195926 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c0af600 con 0x7fcaac153960 2023-12-08T20:53:54.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.092+0000 7fcaa9ffb640 1 -- 172.21.15.146:0/3253195926 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c0ab050 con 0x7fcaac153960 2023-12-08T20:53:54.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.092+0000 7fcaa9ffb640 1 -- 172.21.15.146:0/3253195926 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c0af980 con 0x7fcaac153960 2023-12-08T20:53:54.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.092+0000 7fcab18e7640 1 -- 172.21.15.146:0/3253195926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaac153960 msgr2=0x7fcaac06a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:54.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.092+0000 7fcab18e7640 1 --2- 172.21.15.146:0/3253195926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaac153960 0x7fcaac06a5b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009d90 tx=0x7fca9c01f130 comp rx=0 tx=0).stop 2023-12-08T20:53:54.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.092+0000 7fcab18e7640 1 -- 172.21.15.146:0/3253195926 shutdown_connections 2023-12-08T20:53:54.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.092+0000 7fcab18e7640 1 --2- 172.21.15.146:0/3253195926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaac153960 0x7fcaac06a5b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:54.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.092+0000 7fcab18e7640 1 -- 172.21.15.146:0/3253195926 >> 172.21.15.146:0/3253195926 conn(0x7fcaac0c8a00 msgr2=0x7fcaac0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:54.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.092+0000 7fcab18e7640 1 -- 172.21.15.146:0/3253195926 shutdown_connections 2023-12-08T20:53:54.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.092+0000 7fcab18e7640 1 -- 172.21.15.146:0/3253195926 wait complete. 2023-12-08T20:53:54.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcab18e7640 1 Processor -- start 2023-12-08T20:53:54.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcab18e7640 1 -- start start 2023-12-08T20:53:54.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcab18e7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaac06edd0 0x7fcaac1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:54.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcab18e7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaac0c2de0 0x7fcaac155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:54.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcab18e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaac153960 0x7fcaac156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:54.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcab18e7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac14ceb0 con 0x7fcaac153960 2023-12-08T20:53:54.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcab18e7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac1f0310 con 0x7fcaac06edd0 2023-12-08T20:53:54.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcab18e7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac154120 con 0x7fcaac0c2de0 2023-12-08T20:53:54.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcaaa7fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaac0c2de0 0x7fcaac155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:54.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcaab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaac153960 0x7fcaac156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:54.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcaaa7fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaac0c2de0 0x7fcaac155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39392/0 (socket says 172.21.15.146:39392) 2023-12-08T20:53:54.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcaaa7fc640 1 -- 172.21.15.146:0/633867473 learned_addr learned my addr 172.21.15.146:0/633867473 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-12-08T20:53:54.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.096+0000 7fcaaaffd640 1 --2- 172.21.15.146:0/633867473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaac06edd0 0x7fcaac1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:54.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.100+0000 7fcaaa7fc640 1 -- 172.21.15.146:0/633867473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaac06edd0 msgr2=0x7fcaac1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:54.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.100+0000 7fcaaa7fc640 1 --2- 172.21.15.146:0/633867473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaac06edd0 0x7fcaac1551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:54.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.100+0000 7fcaaa7fc640 1 -- 172.21.15.146:0/633867473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaac153960 msgr2=0x7fcaac156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:54.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.100+0000 7fcaaa7fc640 1 --2- 172.21.15.146:0/633867473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaac153960 0x7fcaac156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:54.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.100+0000 7fcaaa7fc640 1 -- 172.21.15.146:0/633867473 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c009a70 con 0x7fcaac0c2de0 2023-12-08T20:53:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.104+0000 7fcaaa7fc640 1 --2- 172.21.15.146:0/633867473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaac0c2de0 0x7fcaac155ee0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000c480 tx=0x7fcaa000c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:54.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.108+0000 7fca93fff640 1 -- 172.21.15.146:0/633867473 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa00052d0 con 0x7fcaac0c2de0 2023-12-08T20:53:54.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.108+0000 7fca93fff640 1 -- 172.21.15.146:0/633867473 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa0005430 con 0x7fcaac0c2de0 2023-12-08T20:53:54.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.108+0000 7fca93fff640 1 -- 172.21.15.146:0/633867473 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0003890 con 0x7fcaac0c2de0 2023-12-08T20:53:54.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.108+0000 7fcab18e7640 1 -- 172.21.15.146:0/633867473 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac154400 con 0x7fcaac0c2de0 2023-12-08T20:53:54.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.108+0000 7fcab18e7640 1 -- 172.21.15.146:0/633867473 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac1549c0 con 0x7fcaac0c2de0 2023-12-08T20:53:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.108+0000 7fcab18e7640 1 -- 172.21.15.146:0/633867473 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac074190 con 0x7fcaac0c2de0 2023-12-08T20:53:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.112+0000 7fca93fff640 1 -- 172.21.15.146:0/633867473 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcaa0003cf0 con 0x7fcaac0c2de0 2023-12-08T20:53:54.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.112+0000 7fca93fff640 1 -- 172.21.15.146:0/633867473 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fcaa0025430 con 0x7fcaac0c2de0 2023-12-08T20:53:54.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.288+0000 7fca93fff640 1 -- 172.21.15.146:0/633867473 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fcaa0012630 con 0x7fcaac0c2de0 2023-12-08T20:53:54.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.356+0000 7fcab18e7640 1 -- 172.21.15.146:0/633867473 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8d77a649-afd9-4a9c-b26d-e8441f648abe", "id": 1} v 0) v1 -- 0x7fcaac06e530 con 0x7fcaac0c2de0 2023-12-08T20:53:54.360 INFO:tasks.ceph.mgr.y.smithi053.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-08T20:53:54.360 INFO:tasks.ceph.mgr.y.smithi053.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-08T20:53:54.360 INFO:tasks.ceph.mgr.y.smithi053.stderr: from numpy import show_config as show_numpy_config 2023-12-08T20:53:54.441 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:54.439+0000 7f7ee0364180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-08T20:53:54.457 INFO:tasks.ceph.mgr.x.smithi146.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-08T20:53:54.457 INFO:tasks.ceph.mgr.x.smithi146.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-08T20:53:54.457 INFO:tasks.ceph.mgr.x.smithi146.stderr: from numpy import show_config as show_numpy_config 2023-12-08T20:53:54.524 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:54.524+0000 7f5497455180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-08T20:53:54.621 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:54.623+0000 7f7ee0364180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-08T20:53:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.672+0000 7fca93fff640 1 -- 172.21.15.146:0/633867473 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d77a649-afd9-4a9c-b26d-e8441f648abe", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcaa00128c0 con 0x7fcaac0c2de0 2023-12-08T20:53:54.674 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-12-08T20:53:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.672+0000 7fcab18e7640 1 -- 172.21.15.146:0/633867473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaac0c2de0 msgr2=0x7fcaac155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.672+0000 7fcab18e7640 1 --2- 172.21.15.146:0/633867473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaac0c2de0 0x7fcaac155ee0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000c480 tx=0x7fcaa000c940 comp rx=0 tx=0).stop 2023-12-08T20:53:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.672+0000 7fcab18e7640 1 -- 172.21.15.146:0/633867473 shutdown_connections 2023-12-08T20:53:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.672+0000 7fcab18e7640 1 --2- 172.21.15.146:0/633867473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaac153960 0x7fcaac156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.672+0000 7fcab18e7640 1 --2- 172.21.15.146:0/633867473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaac0c2de0 0x7fcaac155ee0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.672+0000 7fcab18e7640 1 --2- 172.21.15.146:0/633867473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaac06edd0 0x7fcaac1551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.672+0000 7fcab18e7640 1 -- 172.21.15.146:0/633867473 >> 172.21.15.146:0/633867473 conn(0x7fcaac0c8a00 msgr2=0x7fcaac06fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.672+0000 7fcab18e7640 1 -- 172.21.15.146:0/633867473 shutdown_connections 2023-12-08T20:53:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.672+0000 7fcab18e7640 1 -- 172.21.15.146:0/633867473 wait complete. 2023-12-08T20:53:54.693 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new a26009bb-533d-40af-a8f6-9b4ae30cb26d 2 2023-12-08T20:53:54.732 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:54.732+0000 7f5497455180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-08T20:53:54.800 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:54.799+0000 7f7ee0364180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-08T20:53:54.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.836+0000 7fc735fbb640 1 Processor -- start 2023-12-08T20:53:54.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.836+0000 7fc735fbb640 1 -- start start 2023-12-08T20:53:54.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.836+0000 7fc735fbb640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc730151350 0x7fc730151730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:54.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.836+0000 7fc735fbb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7300c7d20 0x7fc7300c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:54.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.836+0000 7fc735fbb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300b0c50 con 0x7fc7300cceb0 2023-12-08T20:53:54.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.836+0000 7fc735fbb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7300b0380 con 0x7fc7300c7d20 2023-12-08T20:53:54.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.836+0000 7fc735fbb640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7300ca830 con 0x7fc730151350 2023-12-08T20:53:54.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.836+0000 7fc72f7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc730151350 0x7fc730151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:54.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.836+0000 7fc72f7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc730151350 0x7fc730151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42294/0 (socket says 172.21.15.146:42294) 2023-12-08T20:53:54.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.836+0000 7fc72f7fe640 1 -- 172.21.15.146:0/3477564382 learned_addr learned my addr 172.21.15.146:0/3477564382 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-12-08T20:53:54.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.840+0000 7fc72f7fe640 1 -- 172.21.15.146:0/3477564382 >> v2:172.21.15.53:3300/0 conn(0x7fc7300c7d20 msgr2=0x7fc7300c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:53:54.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.840+0000 7fc72f7fe640 1 --2- 172.21.15.146:0/3477564382 >> v2:172.21.15.53:3300/0 conn(0x7fc7300c7d20 0x7fc7300c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:54.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.840+0000 7fc72f7fe640 1 -- 172.21.15.146:0/3477564382 >> v1:172.21.15.53:6789/0 conn(0x7fc7300cceb0 legacy=0x7fc7300c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:53:54.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.840+0000 7fc72f7fe640 1 -- 172.21.15.146:0/3477564382 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300c26c0 con 0x7fc730151350 2023-12-08T20:53:54.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.840+0000 7fc72f7fe640 1 --2- 172.21.15.146:0/3477564382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc730151350 0x7fc730151730 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc730072780 tx=0x7fc72001c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc876da44c43ada0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:54.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.844+0000 7fc72effd640 1 -- 172.21.15.146:0/3477564382 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200ab650 con 0x7fc730151350 2023-12-08T20:53:54.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.844+0000 7fc72effd640 1 -- 172.21.15.146:0/3477564382 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7200ab7b0 con 0x7fc730151350 2023-12-08T20:53:54.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.844+0000 7fc72effd640 1 -- 172.21.15.146:0/3477564382 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200abb40 con 0x7fc730151350 2023-12-08T20:53:54.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.844+0000 7fc735fbb640 1 -- 172.21.15.146:0/3477564382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc730151350 msgr2=0x7fc730151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:54.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.844+0000 7fc735fbb640 1 --2- 172.21.15.146:0/3477564382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc730151350 0x7fc730151730 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc730072780 tx=0x7fc72001c430 comp rx=0 tx=0).stop 2023-12-08T20:53:54.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 -- 172.21.15.146:0/3477564382 shutdown_connections 2023-12-08T20:53:54.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 --2- 172.21.15.146:0/3477564382 >> v2:172.21.15.53:3300/0 conn(0x7fc7300c7d20 0x7fc7300c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:54.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 --2- 172.21.15.146:0/3477564382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc730151350 0x7fc730151730 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:54.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 -- 172.21.15.146:0/3477564382 >> 172.21.15.146:0/3477564382 conn(0x7fc730060fd0 msgr2=0x7fc7300613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:54.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 -- 172.21.15.146:0/3477564382 shutdown_connections 2023-12-08T20:53:54.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 -- 172.21.15.146:0/3477564382 wait complete. 2023-12-08T20:53:54.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 Processor -- start 2023-12-08T20:53:54.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 -- start start 2023-12-08T20:53:54.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7300c7d20 0x7fc7301428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:54.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7300cceb0 0x7fc7301454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:54.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc730151350 0x7fc7301417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:54.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc730145050 con 0x7fc7300cceb0 2023-12-08T20:53:54.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7301603b0 con 0x7fc730151350 2023-12-08T20:53:54.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc735fbb640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7301431e0 con 0x7fc7300c7d20 2023-12-08T20:53:54.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc72ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc730151350 0x7fc7301417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:54.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc72f7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7300c7d20 0x7fc7301428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:54.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc72ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc730151350 0x7fc7301417d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42298/0 (socket says 172.21.15.146:42298) 2023-12-08T20:53:54.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.848+0000 7fc72ffff640 1 -- 172.21.15.146:0/2631518855 learned_addr learned my addr 172.21.15.146:0/2631518855 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-12-08T20:53:54.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.852+0000 7fc72ffff640 1 -- 172.21.15.146:0/2631518855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7300c7d20 msgr2=0x7fc7301428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:54.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.852+0000 7fc72ffff640 1 --2- 172.21.15.146:0/2631518855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7300c7d20 0x7fc7301428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:54.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.852+0000 7fc72ffff640 1 -- 172.21.15.146:0/2631518855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7300cceb0 msgr2=0x7fc7301454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:54.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.852+0000 7fc72ffff640 1 --2- 172.21.15.146:0/2631518855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7300cceb0 0x7fc7301454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:54.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.852+0000 7fc72ffff640 1 -- 172.21.15.146:0/2631518855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7200094d0 con 0x7fc730151350 2023-12-08T20:53:54.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.856+0000 7fc72ffff640 1 --2- 172.21.15.146:0/2631518855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc730151350 0x7fc7301417d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc72800c780 tx=0x7fc72800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:54.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.860+0000 7fc72cff9640 1 -- 172.21.15.146:0/2631518855 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728003d90 con 0x7fc730151350 2023-12-08T20:53:54.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.860+0000 7fc72cff9640 1 -- 172.21.15.146:0/2631518855 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72800ce90 con 0x7fc730151350 2023-12-08T20:53:54.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.860+0000 7fc72cff9640 1 -- 172.21.15.146:0/2631518855 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7280052b0 con 0x7fc730151350 2023-12-08T20:53:54.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.860+0000 7fc735fbb640 1 -- 172.21.15.146:0/2631518855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7301434c0 con 0x7fc730151350 2023-12-08T20:53:54.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.860+0000 7fc735fbb640 1 -- 172.21.15.146:0/2631518855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7301437a0 con 0x7fc730151350 2023-12-08T20:53:54.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:54.860+0000 7fc735fbb640 1 -- 172.21.15.146:0/2631518855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc730074190 con 0x7fc730151350 2023-12-08T20:53:54.872 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:54.871+0000 7f7ee0364180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-08T20:53:54.913 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:54.912+0000 7f5497455180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-08T20:53:54.986 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:54.984+0000 7f5497455180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-08T20:53:55.013 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:55.015+0000 7f7ee0364180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-08T20:53:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.060+0000 7fc72cff9640 1 -- 172.21.15.146:0/2631518855 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc72800a5e0 con 0x7fc730151350 2023-12-08T20:53:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.060+0000 7fc72cff9640 1 -- 172.21.15.146:0/2631518855 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc72801b7d0 con 0x7fc730151350 2023-12-08T20:53:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.060+0000 7fc72cff9640 1 -- 172.21.15.146:0/2631518855 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc728017070 con 0x7fc730151350 2023-12-08T20:53:55.121 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:55.120+0000 7f5497455180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-08T20:53:55.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.128+0000 7fc735fbb640 1 -- 172.21.15.146:0/2631518855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a26009bb-533d-40af-a8f6-9b4ae30cb26d", "id": 2} v 0) v1 -- 0x7fc730145190 con 0x7fc730151350 2023-12-08T20:53:55.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.468+0000 7fc72cff9640 1 -- 172.21.15.146:0/2631518855 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a26009bb-533d-40af-a8f6-9b4ae30cb26d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc72801b4e0 con 0x7fc730151350 2023-12-08T20:53:55.471 INFO:teuthology.orchestra.run.smithi146.stdout:2 2023-12-08T20:53:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.472+0000 7fc735fbb640 1 -- 172.21.15.146:0/2631518855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc730151350 msgr2=0x7fc7301417d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.472+0000 7fc735fbb640 1 --2- 172.21.15.146:0/2631518855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc730151350 0x7fc7301417d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc72800c780 tx=0x7fc72800cc40 comp rx=0 tx=0).stop 2023-12-08T20:53:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.472+0000 7fc735fbb640 1 -- 172.21.15.146:0/2631518855 shutdown_connections 2023-12-08T20:53:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.472+0000 7fc735fbb640 1 --2- 172.21.15.146:0/2631518855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc730151350 0x7fc7301417d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.472+0000 7fc735fbb640 1 --2- 172.21.15.146:0/2631518855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7300cceb0 0x7fc7301454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.472+0000 7fc735fbb640 1 --2- 172.21.15.146:0/2631518855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7300c7d20 0x7fc7301428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.472+0000 7fc735fbb640 1 -- 172.21.15.146:0/2631518855 >> 172.21.15.146:0/2631518855 conn(0x7fc730060fd0 msgr2=0x7fc7300613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.472+0000 7fc735fbb640 1 -- 172.21.15.146:0/2631518855 shutdown_connections 2023-12-08T20:53:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.472+0000 7fc735fbb640 1 -- 172.21.15.146:0/2631518855 wait complete. 2023-12-08T20:53:55.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 45890f53-e85e-4a31-984e-408d82667826 3 2023-12-08T20:53:55.646 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:55.647+0000 7f7ee0364180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-08T20:53:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.652+0000 7f6bdf940640 1 Processor -- start 2023-12-08T20:53:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.652+0000 7f6bdf940640 1 -- start start 2023-12-08T20:53:55.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.652+0000 7f6bdf940640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6bd80c4ec0 0x7f6bd806b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:55.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.652+0000 7f6bdf940640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd8157ef0 0x7f6bd81510d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:55.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.652+0000 7f6bdf940640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd815b510 con 0x7f6bd80c52a0 2023-12-08T20:53:55.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.652+0000 7f6bdf940640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd80c77c0 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.652+0000 7f6bdf940640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8157390 con 0x7f6bd8157ef0 2023-12-08T20:53:55.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.656+0000 7f6bddedd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd8157ef0 0x7f6bd81510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:55.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.656+0000 7f6bdd6dc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6bd80c4ec0 0x7f6bd806b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:55.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.656+0000 7f6bdcedb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6bd80c52a0 0x7f6bd81577e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.146:34718/0 (socket says 172.21.15.146:34718) 2023-12-08T20:53:55.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.656+0000 7f6bdd6dc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6bd80c4ec0 0x7f6bd806b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38138/0 (socket says 172.21.15.146:38138) 2023-12-08T20:53:55.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.656+0000 7f6bdcedb640 1 -- 172.21.15.146:0/3482890929 learned_addr learned my addr 172.21.15.146:0/3482890929 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-12-08T20:53:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.660+0000 7f6bdd6dc640 1 -- 172.21.15.146:0/3482890929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd8157ef0 msgr2=0x7f6bd81510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:53:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.660+0000 7f6bdd6dc640 1 --2- 172.21.15.146:0/3482890929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd8157ef0 0x7f6bd81510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.660+0000 7f6bdd6dc640 1 -- 172.21.15.146:0/3482890929 >> v1:172.21.15.53:6789/0 conn(0x7f6bd80c52a0 legacy=0x7f6bd81577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.660+0000 7f6bdd6dc640 1 -- 172.21.15.146:0/3482890929 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd815b7f0 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.664+0000 7f6bdd6dc640 1 --2- 172.21.15.146:0/3482890929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd80c4ec0 0x7f6bd806b6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40097c0 tx=0x7f6bd401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0de3dce19e1ae48 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.668+0000 7f6bcffff640 1 -- 172.21.15.146:0/3482890929 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40a8970 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.668+0000 7f6bcffff640 1 -- 172.21.15.146:0/3482890929 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd40a8ad0 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.668+0000 7f6bcffff640 1 -- 172.21.15.146:0/3482890929 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40a8e60 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 -- 172.21.15.146:0/3482890929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd80c4ec0 msgr2=0x7f6bd806b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 --2- 172.21.15.146:0/3482890929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd80c4ec0 0x7f6bd806b6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40097c0 tx=0x7f6bd401ec70 comp rx=0 tx=0).stop 2023-12-08T20:53:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 -- 172.21.15.146:0/3482890929 shutdown_connections 2023-12-08T20:53:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 --2- 172.21.15.146:0/3482890929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd8157ef0 0x7f6bd81510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 --2- 172.21.15.146:0/3482890929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd80c4ec0 0x7f6bd806b6b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 -- 172.21.15.146:0/3482890929 >> 172.21.15.146:0/3482890929 conn(0x7f6bd80cbb50 msgr2=0x7f6bd806f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 -- 172.21.15.146:0/3482890929 shutdown_connections 2023-12-08T20:53:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 -- 172.21.15.146:0/3482890929 wait complete. 2023-12-08T20:53:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 Processor -- start 2023-12-08T20:53:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 -- start start 2023-12-08T20:53:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd80c4ec0 0x7f6bd81587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd80c52a0 0x7f6bd81ef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd8157ef0 0x7f6bd813fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd81ef0e0 con 0x7f6bd8157ef0 2023-12-08T20:53:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8159170 con 0x7f6bd80c52a0 2023-12-08T20:53:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdf940640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd81eed90 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdd6dc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd80c4ec0 0x7f6bd81587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdcedb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd80c52a0 0x7f6bd81ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdd6dc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd80c4ec0 0x7f6bd81587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49464/0 (socket says 172.21.15.146:49464) 2023-12-08T20:53:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.672+0000 7f6bdd6dc640 1 -- 172.21.15.146:0/2814036019 learned_addr learned my addr 172.21.15.146:0/2814036019 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-12-08T20:53:55.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.676+0000 7f6bddedd640 1 --2- 172.21.15.146:0/2814036019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd8157ef0 0x7f6bd813fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:55.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.676+0000 7f6bdd6dc640 1 -- 172.21.15.146:0/2814036019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd80c52a0 msgr2=0x7f6bd81ef570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:55.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.676+0000 7f6bdd6dc640 1 --2- 172.21.15.146:0/2814036019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd80c52a0 0x7f6bd81ef570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:55.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.676+0000 7f6bdd6dc640 1 -- 172.21.15.146:0/2814036019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd8157ef0 msgr2=0x7f6bd813fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:55.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.676+0000 7f6bdd6dc640 1 --2- 172.21.15.146:0/2814036019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd8157ef0 0x7f6bd813fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:55.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.676+0000 7f6bdd6dc640 1 -- 172.21.15.146:0/2814036019 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4009420 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.676+0000 7f6bdcedb640 1 --2- 172.21.15.146:0/2814036019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd80c52a0 0x7f6bd81ef570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:53:55.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.680+0000 7f6bdd6dc640 1 --2- 172.21.15.146:0/2814036019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd80c4ec0 0x7f6bd81587b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6bd401b880 tx=0x7f6bd401ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:55.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.684+0000 7f6bcdffb640 1 -- 172.21.15.146:0/2814036019 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40b1dc0 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.684+0000 7f6bcdffb640 1 -- 172.21.15.146:0/2814036019 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd40b9410 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.684+0000 7f6bcdffb640 1 -- 172.21.15.146:0/2814036019 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40b97c0 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.684+0000 7f6bdf940640 1 -- 172.21.15.146:0/2814036019 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd81f27f0 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.684+0000 7f6bdf940640 1 -- 172.21.15.146:0/2814036019 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd81f2db0 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.684+0000 7f6bdf940640 1 -- 172.21.15.146:0/2814036019 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd8074190 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.725 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:55.723+0000 7f7ee0364180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-08T20:53:55.760 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:55.760+0000 7f5497455180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-08T20:53:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.800+0000 7f6bcdffb640 1 -- 172.21.15.146:0/2814036019 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6bd40b7040 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.800+0000 7f6bcdffb640 1 -- 172.21.15.146:0/2814036019 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6bd40cec30 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.800+0000 7f6bcdffb640 1 -- 172.21.15.146:0/2814036019 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6bd40b5070 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.838 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:55.836+0000 7f5497455180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-08T20:53:55.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:55.876+0000 7f6bdf940640 1 -- 172.21.15.146:0/2814036019 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "45890f53-e85e-4a31-984e-408d82667826", "id": 3} v 0) v1 -- 0x7f6bd8157170 con 0x7f6bd80c4ec0 2023-12-08T20:53:55.903 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:55.903+0000 7f7ee0364180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-08T20:53:55.981 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:55.979+0000 7f7ee0364180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-08T20:53:56.037 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:56.036+0000 7f5497455180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-08T20:53:56.112 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:56.112+0000 7f5497455180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-08T20:53:56.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.144+0000 7f6bcdffb640 1 -- 172.21.15.146:0/2814036019 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "45890f53-e85e-4a31-984e-408d82667826", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6bd40b9db0 con 0x7f6bd80c4ec0 2023-12-08T20:53:56.146 INFO:teuthology.orchestra.run.smithi146.stdout:3 2023-12-08T20:53:56.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.144+0000 7f6bdf940640 1 -- 172.21.15.146:0/2814036019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd80c4ec0 msgr2=0x7f6bd81587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:56.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.144+0000 7f6bdf940640 1 --2- 172.21.15.146:0/2814036019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd80c4ec0 0x7f6bd81587b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6bd401b880 tx=0x7f6bd401ba10 comp rx=0 tx=0).stop 2023-12-08T20:53:56.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.148+0000 7f6bdf940640 1 -- 172.21.15.146:0/2814036019 shutdown_connections 2023-12-08T20:53:56.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.148+0000 7f6bdf940640 1 --2- 172.21.15.146:0/2814036019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd8157ef0 0x7f6bd813fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:56.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.148+0000 7f6bdf940640 1 --2- 172.21.15.146:0/2814036019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd80c52a0 0x7f6bd81ef570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:56.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.148+0000 7f6bdf940640 1 --2- 172.21.15.146:0/2814036019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd80c4ec0 0x7f6bd81587b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:56.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.148+0000 7f6bdf940640 1 -- 172.21.15.146:0/2814036019 >> 172.21.15.146:0/2814036019 conn(0x7f6bd80cbb50 msgr2=0x7f6bd8071640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:56.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.148+0000 7f6bdf940640 1 -- 172.21.15.146:0/2814036019 shutdown_connections 2023-12-08T20:53:56.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.148+0000 7f6bdf940640 1 -- 172.21.15.146:0/2814036019 wait complete. 2023-12-08T20:53:56.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 71f66519-d49b-4f54-a914-0412fe375ab6 4 2023-12-08T20:53:56.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.280+0000 7fa486756640 1 Processor -- start 2023-12-08T20:53:56.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.280+0000 7fa486756640 1 -- start start 2023-12-08T20:53:56.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa486756640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 0x7fa48006e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:56.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa486756640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4800c0f40 0x7fa48006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:56.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa486756640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48006f6f0 con 0x7fa4800c2700 2023-12-08T20:53:56.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa486756640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa480156480 con 0x7fa4800c0f40 2023-12-08T20:53:56.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa486756640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa480156740 con 0x7fa480150370 2023-12-08T20:53:56.285 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:56.283+0000 7f7ee0364180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-08T20:53:56.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa47ffff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 0x7fa48006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:56.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa47f7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4800c0f40 0x7fa48006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:56.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa47ffff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 0x7fa48006e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49480/0 (socket says 172.21.15.146:49480) 2023-12-08T20:53:56.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa47ffff640 1 -- 172.21.15.146:0/1837063836 learned_addr learned my addr 172.21.15.146:0/1837063836 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-12-08T20:53:56.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa47ffff640 1 -- 172.21.15.146:0/1837063836 >> v2:172.21.15.146:3300/0 conn(0x7fa4800c0f40 msgr2=0x7fa48006edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:53:56.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa47ffff640 1 --2- 172.21.15.146:0/1837063836 >> v2:172.21.15.146:3300/0 conn(0x7fa4800c0f40 0x7fa48006edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa47ffff640 1 -- 172.21.15.146:0/1837063836 >> v1:172.21.15.146:6789/0 conn(0x7fa4800c2700 legacy=0x7fa48006fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:53:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.284+0000 7fa47ffff640 1 -- 172.21.15.146:0/1837063836 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480156a20 con 0x7fa480150370 2023-12-08T20:53:56.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.288+0000 7fa47ffff640 1 --2- 172.21.15.146:0/1837063836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 0x7fa48006e890 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa47000bb10 tx=0x7fa47001eb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1a66b42e300bbb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.292+0000 7fa47effd640 1 -- 172.21.15.146:0/1837063836 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4700a79c0 con 0x7fa480150370 2023-12-08T20:53:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.292+0000 7fa47effd640 1 -- 172.21.15.146:0/1837063836 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4700a7b20 con 0x7fa480150370 2023-12-08T20:53:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.292+0000 7fa47effd640 1 -- 172.21.15.146:0/1837063836 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4700af440 con 0x7fa480150370 2023-12-08T20:53:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.292+0000 7fa486756640 1 -- 172.21.15.146:0/1837063836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 msgr2=0x7fa48006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.292+0000 7fa486756640 1 --2- 172.21.15.146:0/1837063836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 0x7fa48006e890 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa47000bb10 tx=0x7fa47001eb40 comp rx=0 tx=0).stop 2023-12-08T20:53:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.292+0000 7fa486756640 1 -- 172.21.15.146:0/1837063836 shutdown_connections 2023-12-08T20:53:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.292+0000 7fa486756640 1 --2- 172.21.15.146:0/1837063836 >> v2:172.21.15.146:3300/0 conn(0x7fa4800c0f40 0x7fa48006edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.292+0000 7fa486756640 1 --2- 172.21.15.146:0/1837063836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 0x7fa48006e890 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.292+0000 7fa486756640 1 -- 172.21.15.146:0/1837063836 >> 172.21.15.146:0/1837063836 conn(0x7fa4800723e0 msgr2=0x7fa48006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.292+0000 7fa486756640 1 -- 172.21.15.146:0/1837063836 shutdown_connections 2023-12-08T20:53:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.292+0000 7fa486756640 1 -- 172.21.15.146:0/1837063836 wait complete. 2023-12-08T20:53:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa486756640 1 Processor -- start 2023-12-08T20:53:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa486756640 1 -- start start 2023-12-08T20:53:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa486756640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4800c0f40 0x7fa4800cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa486756640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4800c2700 0x7fa48014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa486756640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 0x7fa480145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa486756640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa480144e00 con 0x7fa4800c2700 2023-12-08T20:53:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa486756640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa480146f40 con 0x7fa4800c0f40 2023-12-08T20:53:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa486756640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800c9e30 con 0x7fa480150370 2023-12-08T20:53:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa484cf3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 0x7fa480145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa47ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4800c0f40 0x7fa4800cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa484cf3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 0x7fa480145290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49490/0 (socket says 172.21.15.146:49490) 2023-12-08T20:53:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa484cf3640 1 -- 172.21.15.146:0/1696485945 learned_addr learned my addr 172.21.15.146:0/1696485945 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-12-08T20:53:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.296+0000 7fa47f7fe640 1 --2- 172.21.15.146:0/1696485945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4800c2700 0x7fa48014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.300+0000 7fa484cf3640 1 -- 172.21.15.146:0/1696485945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4800c0f40 msgr2=0x7fa4800cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.300+0000 7fa484cf3640 1 --2- 172.21.15.146:0/1696485945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4800c0f40 0x7fa4800cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.300+0000 7fa484cf3640 1 -- 172.21.15.146:0/1696485945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4800c2700 msgr2=0x7fa48014bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.300+0000 7fa484cf3640 1 --2- 172.21.15.146:0/1696485945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4800c2700 0x7fa48014bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.300+0000 7fa484cf3640 1 -- 172.21.15.146:0/1696485945 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47000b770 con 0x7fa480150370 2023-12-08T20:53:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.304+0000 7fa484cf3640 1 --2- 172.21.15.146:0/1696485945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 0x7fa480145290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c780 tx=0x7fa47800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:56.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.308+0000 7fa47cff9640 1 -- 172.21.15.146:0/1696485945 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478004b70 con 0x7fa480150370 2023-12-08T20:53:56.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.308+0000 7fa47cff9640 1 -- 172.21.15.146:0/1696485945 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47800ce90 con 0x7fa480150370 2023-12-08T20:53:56.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.308+0000 7fa47cff9640 1 -- 172.21.15.146:0/1696485945 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47800a850 con 0x7fa480150370 2023-12-08T20:53:56.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.308+0000 7fa486756640 1 -- 172.21.15.146:0/1696485945 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4800ca110 con 0x7fa480150370 2023-12-08T20:53:56.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.308+0000 7fa486756640 1 -- 172.21.15.146:0/1696485945 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4801f6040 con 0x7fa480150370 2023-12-08T20:53:56.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.308+0000 7fa486756640 1 -- 172.21.15.146:0/1696485945 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa480144f70 con 0x7fa480150370 2023-12-08T20:53:56.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.308+0000 7fa47cff9640 1 -- 172.21.15.146:0/1696485945 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa47800a9b0 con 0x7fa480150370 2023-12-08T20:53:56.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.308+0000 7fa47cff9640 1 -- 172.21.15.146:0/1696485945 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa478005030 con 0x7fa480150370 2023-12-08T20:53:56.347 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:56.347+0000 7f7ee0364180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-08T20:53:56.350 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:53:56.352 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:53:56.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.436+0000 7fa47cff9640 1 -- 172.21.15.146:0/1696485945 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa47800ac60 con 0x7fa480150370 2023-12-08T20:53:56.450 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:56.448+0000 7f5497455180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-08T20:53:56.510 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-12-08T20:53:56.508+0000 7f5497455180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-08T20:53:56.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:56.512+0000 7fa486756640 1 -- 172.21.15.146:0/1696485945 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "71f66519-d49b-4f54-a914-0412fe375ab6", "id": 4} v 0) v1 -- 0x7fa480074190 con 0x7fa480150370 2023-12-08T20:53:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.140+0000 7fa47cff9640 1 -- 172.21.15.146:0/1696485945 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mgrmap(e 2) v1 ==== 42894+0+0 (secure 0 0 0) 0x7fa478005530 con 0x7fa480150370 2023-12-08T20:53:57.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.736+0000 7fa47cff9640 1 -- 172.21.15.146:0/1696485945 <== mon.2 v2:172.21.15.146:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "71f66519-d49b-4f54-a914-0412fe375ab6", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa47801a990 con 0x7fa480150370 2023-12-08T20:53:57.736 INFO:teuthology.orchestra.run.smithi146.stdout:4 2023-12-08T20:53:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.736+0000 7fa486756640 1 -- 172.21.15.146:0/1696485945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 msgr2=0x7fa480145290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.736+0000 7fa486756640 1 --2- 172.21.15.146:0/1696485945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 0x7fa480145290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c780 tx=0x7fa47800cc40 comp rx=0 tx=0).stop 2023-12-08T20:53:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.736+0000 7fa486756640 1 -- 172.21.15.146:0/1696485945 shutdown_connections 2023-12-08T20:53:57.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.736+0000 7fa486756640 1 --2- 172.21.15.146:0/1696485945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa480150370 0x7fa480145290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:57.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.736+0000 7fa486756640 1 --2- 172.21.15.146:0/1696485945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4800c2700 0x7fa48014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:57.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.736+0000 7fa486756640 1 --2- 172.21.15.146:0/1696485945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4800c0f40 0x7fa4800cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:57.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.736+0000 7fa486756640 1 -- 172.21.15.146:0/1696485945 >> 172.21.15.146:0/1696485945 conn(0x7fa4800723e0 msgr2=0x7fa480153d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:57.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.736+0000 7fa486756640 1 -- 172.21.15.146:0/1696485945 shutdown_connections 2023-12-08T20:53:57.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.736+0000 7fa486756640 1 -- 172.21.15.146:0/1696485945 wait complete. 2023-12-08T20:53:57.755 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 166e6999-df74-407d-89ec-51c8ba8b7755 5 2023-12-08T20:53:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.920+0000 7fb9f5fb4640 1 Processor -- start 2023-12-08T20:53:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.920+0000 7fb9f5fb4640 1 -- start start 2023-12-08T20:53:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.920+0000 7fb9f5fb4640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9f00710a0 0x7fb9f00cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.920+0000 7fb9f5fb4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9f01532e0 0x7fb9f0153710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.920+0000 7fb9f5fb4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f006c610 con 0x7fb9f0070cc0 2023-12-08T20:53:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.920+0000 7fb9f5fb4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f00cdb40 con 0x7fb9f01532e0 2023-12-08T20:53:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.920+0000 7fb9f5fb4640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f0153c50 con 0x7fb9f00710a0 2023-12-08T20:53:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.920+0000 7fb9eeffd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9f00710a0 0x7fb9f00cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:57.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.924+0000 7fb9eeffd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9f00710a0 0x7fb9f00cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38170/0 (socket says 172.21.15.146:38170) 2023-12-08T20:53:57.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.924+0000 7fb9eeffd640 1 -- 172.21.15.146:0/1641748672 learned_addr learned my addr 172.21.15.146:0/1641748672 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-12-08T20:53:57.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.924+0000 7fb9eeffd640 1 -- 172.21.15.146:0/1641748672 >> v2:172.21.15.53:3300/0 conn(0x7fb9f01532e0 msgr2=0x7fb9f0153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:53:57.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.924+0000 7fb9eeffd640 1 --2- 172.21.15.146:0/1641748672 >> v2:172.21.15.53:3300/0 conn(0x7fb9f01532e0 0x7fb9f0153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:57.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.924+0000 7fb9eeffd640 1 -- 172.21.15.146:0/1641748672 >> v1:172.21.15.53:6789/0 conn(0x7fb9f0070cc0 legacy=0x7fb9f0159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:53:57.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.924+0000 7fb9eeffd640 1 -- 172.21.15.146:0/1641748672 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f00c78c0 con 0x7fb9f00710a0 2023-12-08T20:53:57.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.928+0000 7fb9eeffd640 1 --2- 172.21.15.146:0/1641748672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f00710a0 0x7fb9f00cd600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb9f006fb20 tx=0x7fb9d801ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=187ff1518d78d0d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9ee7fc640 1 -- 172.21.15.146:0/1641748672 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80a89b0 con 0x7fb9f00710a0 2023-12-08T20:53:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9ee7fc640 1 -- 172.21.15.146:0/1641748672 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d80a8b10 con 0x7fb9f00710a0 2023-12-08T20:53:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9ee7fc640 1 -- 172.21.15.146:0/1641748672 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80a8ea0 con 0x7fb9f00710a0 2023-12-08T20:53:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1641748672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f00710a0 msgr2=0x7fb9f00cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 --2- 172.21.15.146:0/1641748672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f00710a0 0x7fb9f00cd600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb9f006fb20 tx=0x7fb9d801ecb0 comp rx=0 tx=0).stop 2023-12-08T20:53:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1641748672 shutdown_connections 2023-12-08T20:53:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 --2- 172.21.15.146:0/1641748672 >> v2:172.21.15.53:3300/0 conn(0x7fb9f01532e0 0x7fb9f0153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 --2- 172.21.15.146:0/1641748672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f00710a0 0x7fb9f00cd600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1641748672 >> 172.21.15.146:0/1641748672 conn(0x7fb9f006abe0 msgr2=0x7fb9f006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1641748672 shutdown_connections 2023-12-08T20:53:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1641748672 wait complete. 2023-12-08T20:53:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 Processor -- start 2023-12-08T20:53:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 -- start start 2023-12-08T20:53:57.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9f0070cc0 0x7fb9f014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:57.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f00710a0 0x7fb9f00c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:57.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f01532e0 0x7fb9f00c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:57.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f00c6290 con 0x7fb9f01532e0 2023-12-08T20:53:57.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f00c6e50 con 0x7fb9f00710a0 2023-12-08T20:53:57.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.936+0000 7fb9f5fb4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0158070 con 0x7fb9f0070cc0 2023-12-08T20:53:57.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.940+0000 7fb9eeffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f00710a0 0x7fb9f00c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:57.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.940+0000 7fb9ef7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9f0070cc0 0x7fb9f014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:57.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.940+0000 7fb9eeffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f00710a0 0x7fb9f00c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38178/0 (socket says 172.21.15.146:38178) 2023-12-08T20:53:57.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.940+0000 7fb9eeffd640 1 -- 172.21.15.146:0/1484670160 learned_addr learned my addr 172.21.15.146:0/1484670160 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-12-08T20:53:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.944+0000 7fb9eeffd640 1 -- 172.21.15.146:0/1484670160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9f0070cc0 msgr2=0x7fb9f014db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.944+0000 7fb9eeffd640 1 --2- 172.21.15.146:0/1484670160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9f0070cc0 0x7fb9f014db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.944+0000 7fb9eeffd640 1 -- 172.21.15.146:0/1484670160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f01532e0 msgr2=0x7fb9f00c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.944+0000 7fb9eeffd640 1 --2- 172.21.15.146:0/1484670160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f01532e0 0x7fb9f00c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.944+0000 7fb9eeffd640 1 -- 172.21.15.146:0/1484670160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80094d0 con 0x7fb9f00710a0 2023-12-08T20:53:57.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.948+0000 7fb9eeffd640 1 --2- 172.21.15.146:0/1484670160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f00710a0 0x7fb9f00c3fe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80b3040 tx=0x7fb9d801ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:57.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.956+0000 7fb9e7fff640 1 -- 172.21.15.146:0/1484670160 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80b0e00 con 0x7fb9f00710a0 2023-12-08T20:53:57.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.956+0000 7fb9e7fff640 1 -- 172.21.15.146:0/1484670160 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d80bb470 con 0x7fb9f00710a0 2023-12-08T20:53:57.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.956+0000 7fb9e7fff640 1 -- 172.21.15.146:0/1484670160 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80bb820 con 0x7fb9f00710a0 2023-12-08T20:53:57.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.956+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1484670160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f0158740 con 0x7fb9f00710a0 2023-12-08T20:53:57.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.956+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1484670160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f0157460 con 0x7fb9f00710a0 2023-12-08T20:53:57.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:57.960+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1484670160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f00675b0 con 0x7fb9f00710a0 2023-12-08T20:53:58.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:58.084+0000 7fb9e7fff640 1 -- 172.21.15.146:0/1484670160 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 2) v1 ==== 42894+0+0 (secure 0 0 0) 0x7fb9d80b7070 con 0x7fb9f00710a0 2023-12-08T20:53:58.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:58.100+0000 7fb9e7fff640 1 -- 172.21.15.146:0/1484670160 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fb9d80ce7d0 con 0x7fb9f00710a0 2023-12-08T20:53:58.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:58.100+0000 7fb9e7fff640 1 -- 172.21.15.146:0/1484670160 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb9d80c49b0 con 0x7fb9f00710a0 2023-12-08T20:53:58.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:58.176+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1484670160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "166e6999-df74-407d-89ec-51c8ba8b7755", "id": 5} v 0) v1 -- 0x7fb9f00675b0 con 0x7fb9f00710a0 2023-12-08T20:53:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.204+0000 7fb9e7fff640 1 -- 172.21.15.146:0/1484670160 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mgrmap(e 3) v1 ==== 85690+0+0 (secure 0 0 0) 0x7fb9d80c5460 con 0x7fb9f00710a0 2023-12-08T20:53:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.208+0000 7fb9e7fff640 1 --2- 172.21.15.146:0/1484670160 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb9d0066610 0x7fb9d0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.208+0000 7fb9ef7fe640 1 --2- 172.21.15.146:0/1484670160 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb9d0066610 0x7fb9d0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:59.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.208+0000 7fb9ef7fe640 1 --2- 172.21.15.146:0/1484670160 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb9d0066610 0x7fb9d0068a00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00ca3c0 tx=0x7fb9e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:59.260 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:59.259+0000 7f7e87af1640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-08T20:53:59.373 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-12-08T20:53:59.375+0000 7f7e87af1640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-08T20:53:59.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.812+0000 7fb9e7fff640 1 -- 172.21.15.146:0/1484670160 <== mon.1 v2:172.21.15.146:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "166e6999-df74-407d-89ec-51c8ba8b7755", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb9d80f2340 con 0x7fb9f00710a0 2023-12-08T20:53:59.816 INFO:teuthology.orchestra.run.smithi146.stdout:5 2023-12-08T20:53:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.816+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1484670160 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb9d0066610 msgr2=0x7fb9d0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.816+0000 7fb9f5fb4640 1 --2- 172.21.15.146:0/1484670160 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb9d0066610 0x7fb9d0068a00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00ca3c0 tx=0x7fb9e0009040 comp rx=0 tx=0).stop 2023-12-08T20:53:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.816+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1484670160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f00710a0 msgr2=0x7fb9f00c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.816+0000 7fb9f5fb4640 1 --2- 172.21.15.146:0/1484670160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f00710a0 0x7fb9f00c3fe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80b3040 tx=0x7fb9d801ba50 comp rx=0 tx=0).stop 2023-12-08T20:53:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.816+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1484670160 shutdown_connections 2023-12-08T20:53:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.816+0000 7fb9f5fb4640 1 --2- 172.21.15.146:0/1484670160 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb9d0066610 0x7fb9d0068a00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.816+0000 7fb9f5fb4640 1 --2- 172.21.15.146:0/1484670160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f01532e0 0x7fb9f00c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.816+0000 7fb9f5fb4640 1 --2- 172.21.15.146:0/1484670160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f00710a0 0x7fb9f00c3fe0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.816+0000 7fb9f5fb4640 1 --2- 172.21.15.146:0/1484670160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9f0070cc0 0x7fb9f014db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.816+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1484670160 >> 172.21.15.146:0/1484670160 conn(0x7fb9f006abe0 msgr2=0x7fb9f00cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.816+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1484670160 shutdown_connections 2023-12-08T20:53:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.816+0000 7fb9f5fb4640 1 -- 172.21.15.146:0/1484670160 wait complete. 2023-12-08T20:53:59.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new fc441dde-e4a9-4d73-8cf9-a06d73919aba 6 2023-12-08T20:53:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.956+0000 7f9055ecc640 1 Processor -- start 2023-12-08T20:53:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.956+0000 7f9055ecc640 1 -- start start 2023-12-08T20:53:59.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.960+0000 7f9055ecc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f90500718f0 0x7f905006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:59.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.960+0000 7f9055ecc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500726a0 0x7f9050153410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:59.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.960+0000 7f9055ecc640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90500c77a0 con 0x7f90500c67d0 2023-12-08T20:53:59.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.960+0000 7f9055ecc640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90500616f0 con 0x7f90500718f0 2023-12-08T20:53:59.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.960+0000 7f9055ecc640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905015a250 con 0x7f90500726a0 2023-12-08T20:53:59.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.960+0000 7f904ffff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500726a0 0x7f9050153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:59.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.960+0000 7f904ffff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500726a0 0x7f9050153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49506/0 (socket says 172.21.15.146:49506) 2023-12-08T20:53:59.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.960+0000 7f904ffff640 1 -- 172.21.15.146:0/2728984019 learned_addr learned my addr 172.21.15.146:0/2728984019 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-12-08T20:53:59.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.964+0000 7f904ffff640 1 -- 172.21.15.146:0/2728984019 >> v2:172.21.15.146:3300/0 conn(0x7f90500718f0 msgr2=0x7f905006a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:53:59.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.964+0000 7f904ffff640 1 --2- 172.21.15.146:0/2728984019 >> v2:172.21.15.146:3300/0 conn(0x7f90500718f0 0x7f905006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:59.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.964+0000 7f904ffff640 1 -- 172.21.15.146:0/2728984019 >> v1:172.21.15.146:6789/0 conn(0x7f90500c67d0 legacy=0x7f9050071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:53:59.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.964+0000 7f904ffff640 1 -- 172.21.15.146:0/2728984019 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905015a530 con 0x7f90500726a0 2023-12-08T20:53:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.964+0000 7f904ffff640 1 --2- 172.21.15.146:0/2728984019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500726a0 0x7f9050153410 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9040009870 tx=0x7f904001ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1f1c6136842626 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:59.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.968+0000 7f904e7fc640 1 -- 172.21.15.146:0/2728984019 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400a89b0 con 0x7f90500726a0 2023-12-08T20:53:59.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.968+0000 7f904e7fc640 1 -- 172.21.15.146:0/2728984019 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90400a8b10 con 0x7f90500726a0 2023-12-08T20:53:59.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.968+0000 7f904e7fc640 1 -- 172.21.15.146:0/2728984019 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400a8ea0 con 0x7f90500726a0 2023-12-08T20:53:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.968+0000 7f9055ecc640 1 -- 172.21.15.146:0/2728984019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500726a0 msgr2=0x7f9050153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.968+0000 7f9055ecc640 1 --2- 172.21.15.146:0/2728984019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500726a0 0x7f9050153410 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9040009870 tx=0x7f904001ecf0 comp rx=0 tx=0).stop 2023-12-08T20:53:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 -- 172.21.15.146:0/2728984019 shutdown_connections 2023-12-08T20:53:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 --2- 172.21.15.146:0/2728984019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500726a0 0x7f9050153410 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 --2- 172.21.15.146:0/2728984019 >> v2:172.21.15.146:3300/0 conn(0x7f90500718f0 0x7f905006a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 -- 172.21.15.146:0/2728984019 >> 172.21.15.146:0/2728984019 conn(0x7f90500c7f70 msgr2=0x7f90500c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:53:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 -- 172.21.15.146:0/2728984019 shutdown_connections 2023-12-08T20:53:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 -- 172.21.15.146:0/2728984019 wait complete. 2023-12-08T20:53:59.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 Processor -- start 2023-12-08T20:53:59.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 -- start start 2023-12-08T20:53:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90500718f0 0x7f905014d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90500726a0 0x7f905014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500c67d0 0x7f9050142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:53:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9050159ed0 con 0x7f90500718f0 2023-12-08T20:53:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9050157fb0 con 0x7f90500726a0 2023-12-08T20:53:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f9055ecc640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9050158290 con 0x7f90500c67d0 2023-12-08T20:53:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f904ffff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500c67d0 0x7f9050142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:53:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f904ffff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500c67d0 0x7f9050142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49514/0 (socket says 172.21.15.146:49514) 2023-12-08T20:53:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.972+0000 7f904ffff640 1 -- 172.21.15.146:0/779788180 learned_addr learned my addr 172.21.15.146:0/779788180 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-12-08T20:53:59.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.976+0000 7f904ffff640 1 -- 172.21.15.146:0/779788180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90500726a0 msgr2=0x7f905014d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:59.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.976+0000 7f904ffff640 1 --2- 172.21.15.146:0/779788180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90500726a0 0x7f905014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:59.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.976+0000 7f904ffff640 1 -- 172.21.15.146:0/779788180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90500718f0 msgr2=0x7f905014d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:53:59.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.976+0000 7f904ffff640 1 --2- 172.21.15.146:0/779788180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90500718f0 0x7f905014d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:53:59.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.976+0000 7f904ffff640 1 -- 172.21.15.146:0/779788180 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90400094d0 con 0x7f90500c67d0 2023-12-08T20:53:59.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.980+0000 7f904ffff640 1 --2- 172.21.15.146:0/779788180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500c67d0 0x7f9050142490 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f904001d3a0 tx=0x7f904001ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:53:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.984+0000 7f9047fff640 1 -- 172.21.15.146:0/779788180 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400b0dc0 con 0x7f90500c67d0 2023-12-08T20:53:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.984+0000 7f9047fff640 1 -- 172.21.15.146:0/779788180 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90400ba440 con 0x7f90500c67d0 2023-12-08T20:53:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.984+0000 7f9047fff640 1 -- 172.21.15.146:0/779788180 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400ba7f0 con 0x7f90500c67d0 2023-12-08T20:53:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.984+0000 7f9055ecc640 1 -- 172.21.15.146:0/779788180 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9050158570 con 0x7f90500c67d0 2023-12-08T20:53:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.984+0000 7f9055ecc640 1 -- 172.21.15.146:0/779788180 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9050158b30 con 0x7f90500c67d0 2023-12-08T20:53:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:53:59.984+0000 7f9055ecc640 1 -- 172.21.15.146:0/779788180 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9050158d20 con 0x7f90500c67d0 2023-12-08T20:54:00.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:00.276+0000 7f9047fff640 1 -- 172.21.15.146:0/779788180 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 3) v1 ==== 85690+0+0 (secure 0 0 0) 0x7f90400ba950 con 0x7f90500c67d0 2023-12-08T20:54:00.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:00.276+0000 7f9047fff640 1 --2- 172.21.15.146:0/779788180 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9030066310 0x7f90300687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:00.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:00.276+0000 7f904f7fe640 1 --2- 172.21.15.146:0/779788180 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9030066310 0x7f90300687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:00.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:00.280+0000 7f904f7fe640 1 --2- 172.21.15.146:0/779788180 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9030066310 0x7f90300687d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f904800ab90 tx=0x7f9048009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:00.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:00.320+0000 7f9047fff640 1 -- 172.21.15.146:0/779788180 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f90400f43d0 con 0x7f90500c67d0 2023-12-08T20:54:00.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:00.328+0000 7f9047fff640 1 -- 172.21.15.146:0/779788180 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90400f0010 con 0x7f90500c67d0 2023-12-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:00.600+0000 7f9055ecc640 1 -- 172.21.15.146:0/779788180 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fc441dde-e4a9-4d73-8cf9-a06d73919aba", "id": 6} v 0) v1 -- 0x7f9050158d20 con 0x7f90500c67d0 2023-12-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:00.616+0000 7f9047fff640 1 -- 172.21.15.146:0/779788180 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f90400f03e0 con 0x7f90500c67d0 2023-12-08T20:54:01.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.408+0000 7f9047fff640 1 -- 172.21.15.146:0/779788180 <== mon.2 v2:172.21.15.146:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc441dde-e4a9-4d73-8cf9-a06d73919aba", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f904010a990 con 0x7f90500c67d0 2023-12-08T20:54:01.408 INFO:teuthology.orchestra.run.smithi146.stdout:6 2023-12-08T20:54:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.412+0000 7f9055ecc640 1 -- 172.21.15.146:0/779788180 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9030066310 msgr2=0x7f90300687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:01.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.412+0000 7f9055ecc640 1 --2- 172.21.15.146:0/779788180 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9030066310 0x7f90300687d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f904800ab90 tx=0x7f9048009250 comp rx=0 tx=0).stop 2023-12-08T20:54:01.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.412+0000 7f9055ecc640 1 -- 172.21.15.146:0/779788180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500c67d0 msgr2=0x7f9050142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:01.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.412+0000 7f9055ecc640 1 --2- 172.21.15.146:0/779788180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500c67d0 0x7f9050142490 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f904001d3a0 tx=0x7f904001ba90 comp rx=0 tx=0).stop 2023-12-08T20:54:01.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.412+0000 7f9055ecc640 1 -- 172.21.15.146:0/779788180 shutdown_connections 2023-12-08T20:54:01.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.412+0000 7f9055ecc640 1 --2- 172.21.15.146:0/779788180 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9030066310 0x7f90300687d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:01.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.412+0000 7f9055ecc640 1 --2- 172.21.15.146:0/779788180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90500c67d0 0x7f9050142490 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:01.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.412+0000 7f9055ecc640 1 --2- 172.21.15.146:0/779788180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90500726a0 0x7f905014d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:01.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.412+0000 7f9055ecc640 1 --2- 172.21.15.146:0/779788180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90500718f0 0x7f905014d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:01.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.412+0000 7f9055ecc640 1 -- 172.21.15.146:0/779788180 >> 172.21.15.146:0/779788180 conn(0x7f90500c7f70 msgr2=0x7f905014b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:01.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.412+0000 7f9055ecc640 1 -- 172.21.15.146:0/779788180 shutdown_connections 2023-12-08T20:54:01.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.412+0000 7f9055ecc640 1 -- 172.21.15.146:0/779788180 wait complete. 2023-12-08T20:54:01.434 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 0a2f1734-646e-45d8-8753-73d3a712b68c 7 2023-12-08T20:54:01.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.552+0000 7f6ed18b0640 1 Processor -- start 2023-12-08T20:54:01.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.552+0000 7f6ed18b0640 1 -- start start 2023-12-08T20:54:01.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.556+0000 7f6ed18b0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ecc14fd00 0x7f6ecc0c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:01.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.556+0000 7f6ed18b0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc0c23e0 con 0x7f6ecc14f920 2023-12-08T20:54:01.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.556+0000 7f6ed18b0640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc06f020 con 0x7f6ecc0c53a0 2023-12-08T20:54:01.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.556+0000 7f6ed18b0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c1c40 con 0x7f6ecc14fd00 2023-12-08T20:54:01.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.556+0000 7f6ed10af640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6ecc0c53a0 0x7f6ecc072100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35618/0 (socket says 172.21.15.146:35618) 2023-12-08T20:54:01.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.556+0000 7f6ed10af640 1 -- 172.21.15.146:0/2450499052 learned_addr learned my addr 172.21.15.146:0/2450499052 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-12-08T20:54:01.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.556+0000 7f6ecbfff640 1 --2- 172.21.15.146:0/2450499052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ecc14fd00 0x7f6ecc0c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:01.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.556+0000 7f6ecb7fe640 1 -- 172.21.15.146:0/2450499052 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028989683 0 0) 0x7f6ecc06f020 con 0x7f6ecc0c53a0 2023-12-08T20:54:01.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.556+0000 7f6ecb7fe640 1 -- 172.21.15.146:0/2450499052 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb4003530 con 0x7f6ecc0c53a0 2023-12-08T20:54:01.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.556+0000 7f6ecbfff640 1 -- 172.21.15.146:0/2450499052 >> v1:172.21.15.146:6789/0 conn(0x7f6ecc0c53a0 legacy=0x7f6ecc072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:01.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.556+0000 7f6ecbfff640 1 -- 172.21.15.146:0/2450499052 >> v1:172.21.15.53:6789/0 conn(0x7f6ecc14f920 legacy=0x7f6ecc0c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:01.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.556+0000 7f6ecbfff640 1 -- 172.21.15.146:0/2450499052 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0c13a0 con 0x7f6ecc14fd00 2023-12-08T20:54:01.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.560+0000 7f6ecbfff640 1 --2- 172.21.15.146:0/2450499052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ecc14fd00 0x7f6ecc0c1ea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000a990 tx=0x7f6ec001d860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24eb9eaa3e4d844f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.564+0000 7f6ecb7fe640 1 -- 172.21.15.146:0/2450499052 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00a6890 con 0x7f6ecc14fd00 2023-12-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.564+0000 7f6ecb7fe640 1 -- 172.21.15.146:0/2450499052 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec00a69f0 con 0x7f6ecc14fd00 2023-12-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.564+0000 7f6ecb7fe640 1 -- 172.21.15.146:0/2450499052 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00a6d80 con 0x7f6ecc14fd00 2023-12-08T20:54:01.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.564+0000 7f6ed18b0640 1 -- 172.21.15.146:0/2450499052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ecc14fd00 msgr2=0x7f6ecc0c1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:01.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.564+0000 7f6ed18b0640 1 --2- 172.21.15.146:0/2450499052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ecc14fd00 0x7f6ecc0c1ea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000a990 tx=0x7f6ec001d860 comp rx=0 tx=0).stop 2023-12-08T20:54:01.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.564+0000 7f6ed18b0640 1 -- 172.21.15.146:0/2450499052 shutdown_connections 2023-12-08T20:54:01.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.564+0000 7f6ed18b0640 1 --2- 172.21.15.146:0/2450499052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ecc14fd00 0x7f6ecc0c1ea0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:01.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.564+0000 7f6ed18b0640 1 -- 172.21.15.146:0/2450499052 >> 172.21.15.146:0/2450499052 conn(0x7f6ecc06a5b0 msgr2=0x7f6ecc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:01.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.564+0000 7f6ed18b0640 1 -- 172.21.15.146:0/2450499052 shutdown_connections 2023-12-08T20:54:01.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.564+0000 7f6ed18b0640 1 -- 172.21.15.146:0/2450499052 wait complete. 2023-12-08T20:54:01.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ed18b0640 1 Processor -- start 2023-12-08T20:54:01.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ed18b0640 1 -- start start 2023-12-08T20:54:01.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ed18b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc0c53a0 0x7f6ecc1f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:01.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ed18b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ecc14f920 0x7f6ecc1f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:01.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ed18b0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ecc14fd00 0x7f6ecc14ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ed18b0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc1f4b20 con 0x7f6ecc0c53a0 2023-12-08T20:54:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ed18b0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc151190 con 0x7f6ecc14f920 2023-12-08T20:54:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ed18b0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc151450 con 0x7f6ecc14fd00 2023-12-08T20:54:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ecbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ecc14f920 0x7f6ecc1f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ed10af640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ecc14fd00 0x7f6ecc14ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ecbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ecc14f920 0x7f6ecc1f1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38206/0 (socket says 172.21.15.146:38206) 2023-12-08T20:54:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ecbfff640 1 -- 172.21.15.146:0/3131605649 learned_addr learned my addr 172.21.15.146:0/3131605649 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-12-08T20:54:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.568+0000 7f6ed08ae640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc0c53a0 0x7f6ecc1f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.572+0000 7f6ed10af640 1 -- 172.21.15.146:0/3131605649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ecc14f920 msgr2=0x7f6ecc1f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.572+0000 7f6ed10af640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ecc14f920 0x7f6ecc1f1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.572+0000 7f6ed10af640 1 -- 172.21.15.146:0/3131605649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc0c53a0 msgr2=0x7f6ecc1f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.572+0000 7f6ed10af640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc0c53a0 0x7f6ecc1f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.572+0000 7f6ed10af640 1 -- 172.21.15.146:0/3131605649 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec000a5c0 con 0x7f6ecc14fd00 2023-12-08T20:54:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.576+0000 7f6ed10af640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ecc14fd00 0x7f6ecc14ea30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400ca80 tx=0x7f6ec400cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.576+0000 7f6ec97fa640 1 -- 172.21.15.146:0/3131605649 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec400ac30 con 0x7f6ecc14fd00 2023-12-08T20:54:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.580+0000 7f6ec97fa640 1 -- 172.21.15.146:0/3131605649 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400ad90 con 0x7f6ecc14fd00 2023-12-08T20:54:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.580+0000 7f6ed18b0640 1 -- 172.21.15.146:0/3131605649 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc1f4dc0 con 0x7f6ecc14fd00 2023-12-08T20:54:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.580+0000 7f6ec97fa640 1 -- 172.21.15.146:0/3131605649 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4012600 con 0x7f6ecc14fd00 2023-12-08T20:54:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.580+0000 7f6ed18b0640 1 -- 172.21.15.146:0/3131605649 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc151730 con 0x7f6ecc14fd00 2023-12-08T20:54:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.580+0000 7f6ed18b0640 1 -- 172.21.15.146:0/3131605649 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc074190 con 0x7f6ecc14fd00 2023-12-08T20:54:01.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.596+0000 7f6ec97fa640 1 -- 172.21.15.146:0/3131605649 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f6ec4007070 con 0x7f6ecc14fd00 2023-12-08T20:54:01.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.596+0000 7f6ec97fa640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6eb80663e0 0x7f6eb80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:01.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.596+0000 7f6ed08ae640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6eb80663e0 0x7f6eb80688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:01.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.600+0000 7f6ed08ae640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6eb80663e0 0x7f6eb80688a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc001810 tx=0x7f6ebc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.880+0000 7f6ec97fa640 1 -- 172.21.15.146:0/3131605649 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6ec4055350 con 0x7f6ecc14fd00 2023-12-08T20:54:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:01.880+0000 7f6ec97fa640 1 -- 172.21.15.146:0/3131605649 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ec4051690 con 0x7f6ecc14fd00 2023-12-08T20:54:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.060+0000 7f6ed18b0640 1 -- 172.21.15.146:0/3131605649 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0a2f1734-646e-45d8-8753-73d3a712b68c", "id": 7} v 0) v1 -- 0x7f6ecc1f5270 con 0x7f6ecc14fd00 2023-12-08T20:54:02.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ec97fa640 1 -- 172.21.15.146:0/3131605649 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0a2f1734-646e-45d8-8753-73d3a712b68c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6ec40210b0 con 0x7f6ecc14fd00 2023-12-08T20:54:02.472 INFO:teuthology.orchestra.run.smithi146.stdout:7 2023-12-08T20:54:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ed18b0640 1 -- 172.21.15.146:0/3131605649 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6eb80663e0 msgr2=0x7f6eb80688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ed18b0640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6eb80663e0 0x7f6eb80688a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc001810 tx=0x7f6ebc009040 comp rx=0 tx=0).stop 2023-12-08T20:54:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ed18b0640 1 -- 172.21.15.146:0/3131605649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ecc14fd00 msgr2=0x7f6ecc14ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ed18b0640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ecc14fd00 0x7f6ecc14ea30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400ca80 tx=0x7f6ec400cf40 comp rx=0 tx=0).stop 2023-12-08T20:54:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ed18b0640 1 -- 172.21.15.146:0/3131605649 shutdown_connections 2023-12-08T20:54:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ed18b0640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6eb80663e0 0x7f6eb80688a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ed18b0640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ecc14fd00 0x7f6ecc14ea30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ed18b0640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ecc14f920 0x7f6ecc1f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ed18b0640 1 --2- 172.21.15.146:0/3131605649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc0c53a0 0x7f6ecc1f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ed18b0640 1 -- 172.21.15.146:0/3131605649 >> 172.21.15.146:0/3131605649 conn(0x7f6ecc06a5b0 msgr2=0x7f6ecc14cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ed18b0640 1 -- 172.21.15.146:0/3131605649 shutdown_connections 2023-12-08T20:54:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-12-08T20:54:02.472+0000 7f6ed18b0640 1 -- 172.21.15.146:0/3131605649 wait complete. 2023-12-08T20:54:02.495 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-08T20:54:02.495 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-12-08T20:54:02.497 INFO:tasks.ceph.osd.0:Started 2023-12-08T20:54:02.498 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-08T20:54:02.498 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-12-08T20:54:02.500 INFO:tasks.ceph.osd.1:Started 2023-12-08T20:54:02.500 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-08T20:54:02.500 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-12-08T20:54:02.503 INFO:tasks.ceph.osd.2:Started 2023-12-08T20:54:02.503 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-08T20:54:02.503 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-12-08T20:54:02.505 INFO:tasks.ceph.osd.3:Started 2023-12-08T20:54:02.505 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-08T20:54:02.505 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-12-08T20:54:02.507 INFO:tasks.ceph.osd.4:Started 2023-12-08T20:54:02.507 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-08T20:54:02.507 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-12-08T20:54:02.509 INFO:tasks.ceph.osd.5:Started 2023-12-08T20:54:02.509 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-08T20:54:02.510 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-12-08T20:54:02.512 INFO:tasks.ceph.osd.6:Started 2023-12-08T20:54:02.512 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-08T20:54:02.512 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-12-08T20:54:02.514 INFO:tasks.ceph.osd.7:Started 2023-12-08T20:54:02.514 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:54:02.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.655+0000 7f1413b43640 1 Processor -- start 2023-12-08T20:54:02.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.655+0000 7f1413b43640 1 -- start start 2023-12-08T20:54:02.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.655+0000 7f1413b43640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f140c0ceed0 0x7f140c0cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:02.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.655+0000 7f1413b43640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c0cb190 con 0x7f140c153910 2023-12-08T20:54:02.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.655+0000 7f1413b43640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c0cc2d0 con 0x7f140c0ca2f0 2023-12-08T20:54:02.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.655+0000 7f1413b43640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0ca120 con 0x7f140c0ceed0 2023-12-08T20:54:02.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.655+0000 7f14118df640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f140c153910 0x7f140c15a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60850/0 (socket says 172.21.15.53:60850) 2023-12-08T20:54:02.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.655+0000 7f14118df640 1 -- 172.21.15.53:0/3407239726 learned_addr learned my addr 172.21.15.53:0/3407239726 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:54:02.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.655+0000 7f14120e0640 1 --2- 172.21.15.53:0/3407239726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f140c0ceed0 0x7f140c0cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:02.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.659+0000 7f14120e0640 1 -- 172.21.15.53:0/3407239726 >> v1:172.21.15.146:6789/0 conn(0x7f140c0ca2f0 legacy=0x7f140c0c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.659+0000 7f14120e0640 1 -- 172.21.15.53:0/3407239726 >> v1:172.21.15.53:6789/0 conn(0x7f140c153910 legacy=0x7f140c15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.659+0000 7f14120e0640 1 -- 172.21.15.53:0/3407239726 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0ca730 con 0x7f140c0ceed0 2023-12-08T20:54:02.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.663+0000 7f14120e0640 1 --2- 172.21.15.53:0/3407239726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f140c0ceed0 0x7f140c0cf360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1404009dc0 tx=0x7f140401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=226a4941d6365808 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:02.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.667+0000 7f14108dd640 1 -- 172.21.15.53:0/3407239726 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040af600 con 0x7f140c0ceed0 2023-12-08T20:54:02.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.667+0000 7f14108dd640 1 -- 172.21.15.53:0/3407239726 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14040ab050 con 0x7f140c0ceed0 2023-12-08T20:54:02.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.667+0000 7f14108dd640 1 -- 172.21.15.53:0/3407239726 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040af980 con 0x7f140c0ceed0 2023-12-08T20:54:02.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.667+0000 7f1413b43640 1 -- 172.21.15.53:0/3407239726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f140c0ceed0 msgr2=0x7f140c0cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:02.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.667+0000 7f1413b43640 1 --2- 172.21.15.53:0/3407239726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f140c0ceed0 0x7f140c0cf360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1404009dc0 tx=0x7f140401f150 comp rx=0 tx=0).stop 2023-12-08T20:54:02.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.667+0000 7f1413b43640 1 -- 172.21.15.53:0/3407239726 shutdown_connections 2023-12-08T20:54:02.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.667+0000 7f1413b43640 1 --2- 172.21.15.53:0/3407239726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f140c0ceed0 0x7f140c0cf360 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:02.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.667+0000 7f1413b43640 1 -- 172.21.15.53:0/3407239726 >> 172.21.15.53:0/3407239726 conn(0x7f140c08afc0 msgr2=0x7f140c08b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:02.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.667+0000 7f1413b43640 1 -- 172.21.15.53:0/3407239726 shutdown_connections 2023-12-08T20:54:02.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.667+0000 7f1413b43640 1 -- 172.21.15.53:0/3407239726 wait complete. 2023-12-08T20:54:02.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.667+0000 7f1413b43640 1 Processor -- start 2023-12-08T20:54:02.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.667+0000 7f1413b43640 1 -- start start 2023-12-08T20:54:02.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.671+0000 7f1413b43640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f140c0ca2f0 0x7f140c1f0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:02.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.671+0000 7f1413b43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f140c0ceed0 0x7f140c0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:02.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.671+0000 7f1413b43640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f140c153910 0x7f140c159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:02.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.671+0000 7f1413b43640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c14d030 con 0x7f140c0ceed0 2023-12-08T20:54:02.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.671+0000 7f1413b43640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c15a900 con 0x7f140c153910 2023-12-08T20:54:02.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.671+0000 7f1413b43640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c1f05a0 con 0x7f140c0ca2f0 2023-12-08T20:54:02.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.671+0000 7f14120e0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f140c153910 0x7f140c159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:02.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.671+0000 7f14118df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f140c0ca2f0 0x7f140c1f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:02.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.671+0000 7f14120e0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f140c153910 0x7f140c159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40592/0 (socket says 172.21.15.53:40592) 2023-12-08T20:54:02.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.671+0000 7f14120e0640 1 -- 172.21.15.53:0/1350358239 learned_addr learned my addr 172.21.15.53:0/1350358239 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:02.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.671+0000 7f14110de640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f140c0ceed0 0x7f140c0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:02.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.675+0000 7f14120e0640 1 -- 172.21.15.53:0/1350358239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f140c0ca2f0 msgr2=0x7f140c1f0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:02.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.675+0000 7f14120e0640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f140c0ca2f0 0x7f140c1f0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:02.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.675+0000 7f14120e0640 1 -- 172.21.15.53:0/1350358239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f140c0ceed0 msgr2=0x7f140c0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:02.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.675+0000 7f14120e0640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f140c0ceed0 0x7f140c0c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:02.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.675+0000 7f14120e0640 1 -- 172.21.15.53:0/1350358239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404009a70 con 0x7f140c153910 2023-12-08T20:54:02.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.675+0000 7f14118df640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f140c0ca2f0 0x7f140c1f0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:54:02.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.675+0000 7f14120e0640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f140c153910 0x7f140c159660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1404009eb0 tx=0x7f140401bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:02.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.683+0000 7f14027fc640 1 -- 172.21.15.53:0/1350358239 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040ba830 con 0x7f140c153910 2023-12-08T20:54:02.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.683+0000 7f14027fc640 1 -- 172.21.15.53:0/1350358239 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14040ba9b0 con 0x7f140c153910 2023-12-08T20:54:02.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.683+0000 7f14027fc640 1 -- 172.21.15.53:0/1350358239 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040bad60 con 0x7f140c153910 2023-12-08T20:54:02.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.683+0000 7f1413b43640 1 -- 172.21.15.53:0/1350358239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c14c140 con 0x7f140c153910 2023-12-08T20:54:02.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.683+0000 7f1413b43640 1 -- 172.21.15.53:0/1350358239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c14c700 con 0x7f140c153910 2023-12-08T20:54:02.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.683+0000 7f1413b43640 1 -- 172.21.15.53:0/1350358239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c14d1e0 con 0x7f140c153910 2023-12-08T20:54:02.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.707+0000 7f14027fc640 1 -- 172.21.15.53:0/1350358239 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f14040cf430 con 0x7f140c153910 2023-12-08T20:54:02.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.707+0000 7f14027fc640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f13f0066460 0x7f13f0068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:02.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.707+0000 7f14118df640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f13f0066460 0x7f13f0068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:02.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.707+0000 7f14118df640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f13f0066460 0x7f13f0068920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1408005890 tx=0x7f1408009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:02.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.711+0000 7f14027fc640 1 -- 172.21.15.53:0/1350358239 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f14040f45d0 con 0x7f140c153910 2023-12-08T20:54:02.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:02.983+0000 7f14027fc640 1 -- 172.21.15.53:0/1350358239 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14040f0910 con 0x7f140c153910 2023-12-08T20:54:03.125 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-12-08T20:54:03.124+0000 7f73e17dc640 -1 Falling back to public interface 2023-12-08T20:54:03.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.155+0000 7f1413b43640 1 -- 172.21.15.53:0/1350358239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f140c14d1e0 con 0x7f140c153910 2023-12-08T20:54:03.162 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-12-08T20:54:03.163+0000 7f5307f64640 -1 Falling back to public interface 2023-12-08T20:54:03.170 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-12-08T20:54:03.171+0000 7f825e224640 -1 Falling back to public interface 2023-12-08T20:54:03.170 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-12-08T20:54:03.171+0000 7efd16811640 -1 Falling back to public interface 2023-12-08T20:54:03.173 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-12-08T20:54:03.172+0000 7fe2660b0640 -1 Falling back to public interface 2023-12-08T20:54:03.190 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-12-08T20:54:03.191+0000 7f4e57d6f640 -1 Falling back to public interface 2023-12-08T20:54:03.193 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-12-08T20:54:03.192+0000 7f4f9e01f640 -1 Falling back to public interface 2023-12-08T20:54:03.205 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-12-08T20:54:03.204+0000 7f0770388640 -1 Falling back to public interface 2023-12-08T20:54:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.295+0000 7f14027fc640 1 -- 172.21.15.53:0/1350358239 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f140c14d1e0 con 0x7f140c153910 2023-12-08T20:54:03.295 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:54:03.295 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":10,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:54:02.238448+0000","last_up_change":"0.000000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:54:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.299+0000 7f1413b43640 1 -- 172.21.15.53:0/1350358239 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f13f0066460 msgr2=0x7f13f0068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.299+0000 7f1413b43640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f13f0066460 0x7f13f0068920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1408005890 tx=0x7f1408009040 comp rx=0 tx=0).stop 2023-12-08T20:54:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.299+0000 7f1413b43640 1 -- 172.21.15.53:0/1350358239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f140c153910 msgr2=0x7f140c159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.299+0000 7f1413b43640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f140c153910 0x7f140c159660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1404009eb0 tx=0x7f140401bef0 comp rx=0 tx=0).stop 2023-12-08T20:54:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.299+0000 7f1413b43640 1 -- 172.21.15.53:0/1350358239 shutdown_connections 2023-12-08T20:54:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.299+0000 7f1413b43640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f13f0066460 0x7f13f0068920 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.299+0000 7f1413b43640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f140c153910 0x7f140c159660 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.299+0000 7f1413b43640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f140c0ceed0 0x7f140c0c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.299+0000 7f1413b43640 1 --2- 172.21.15.53:0/1350358239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f140c0ca2f0 0x7f140c1f0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.299+0000 7f1413b43640 1 -- 172.21.15.53:0/1350358239 >> 172.21.15.53:0/1350358239 conn(0x7f140c08afc0 msgr2=0x7f140c0cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.299+0000 7f1413b43640 1 -- 172.21.15.53:0/1350358239 shutdown_connections 2023-12-08T20:54:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:03.299+0000 7f1413b43640 1 -- 172.21.15.53:0/1350358239 wait complete. 2023-12-08T20:54:03.322 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-08T20:54:03.323 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-08T20:54:04.129 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-08T20:54:04.254 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.255+0000 7fee6f8f8640 1 Processor -- start 2023-12-08T20:54:04.254 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.255+0000 7fee6f8f8640 1 -- start start 2023-12-08T20:54:04.255 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.255+0000 7fee6f8f8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee680c36f0 0x7fee68156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:04.255 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.255+0000 7fee6f8f8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee680c62b0 0x7fee680c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:04.255 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.255+0000 7fee6f8f8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee68066410 con 0x7fee680c4ee0 2023-12-08T20:54:04.255 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.255+0000 7fee6f8f8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee680c4910 con 0x7fee680c62b0 2023-12-08T20:54:04.255 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.255+0000 7fee6f8f8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee680c5800 con 0x7fee680c36f0 2023-12-08T20:54:04.256 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.255+0000 7fee6ce93640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee680c36f0 0x7fee68156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:04.256 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.255+0000 7fee6de95640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee680c62b0 0x7fee680c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:04.257 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.255+0000 7fee6ce93640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee680c36f0 0x7fee68156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40596/0 (socket says 172.21.15.53:40596) 2023-12-08T20:54:04.257 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.255+0000 7fee6ce93640 1 -- 172.21.15.53:0/3144867905 learned_addr learned my addr 172.21.15.53:0/3144867905 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:04.260 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.259+0000 7fee6de95640 1 -- 172.21.15.53:0/3144867905 >> v2:172.21.15.146:3300/0 conn(0x7fee680c36f0 msgr2=0x7fee68156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:04.261 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.259+0000 7fee6de95640 1 --2- 172.21.15.53:0/3144867905 >> v2:172.21.15.146:3300/0 conn(0x7fee680c36f0 0x7fee68156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:04.261 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.259+0000 7fee6de95640 1 -- 172.21.15.53:0/3144867905 >> v1:172.21.15.53:6789/0 conn(0x7fee680c4ee0 legacy=0x7fee680c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:04.261 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.259+0000 7fee6de95640 1 -- 172.21.15.53:0/3144867905 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680c3260 con 0x7fee680c62b0 2023-12-08T20:54:04.269 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.271+0000 7fee6de95640 1 --2- 172.21.15.53:0/3144867905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee680c62b0 0x7fee680c52c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fee680c6a20 tx=0x7fee6001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43abeb53891f0ca6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:04.274 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee67fff640 1 -- 172.21.15.53:0/3144867905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600a58a0 con 0x7fee680c62b0 2023-12-08T20:54:04.274 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee67fff640 1 -- 172.21.15.53:0/3144867905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee600a5a00 con 0x7fee680c62b0 2023-12-08T20:54:04.274 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee67fff640 1 -- 172.21.15.53:0/3144867905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600a5d90 con 0x7fee680c62b0 2023-12-08T20:54:04.276 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee6f8f8640 1 -- 172.21.15.53:0/3144867905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee680c62b0 msgr2=0x7fee680c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:04.276 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee6f8f8640 1 --2- 172.21.15.53:0/3144867905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee680c62b0 0x7fee680c52c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fee680c6a20 tx=0x7fee6001c8d0 comp rx=0 tx=0).stop 2023-12-08T20:54:04.276 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee6f8f8640 1 -- 172.21.15.53:0/3144867905 shutdown_connections 2023-12-08T20:54:04.276 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee6f8f8640 1 --2- 172.21.15.53:0/3144867905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee680c62b0 0x7fee680c52c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:04.276 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee6f8f8640 1 --2- 172.21.15.53:0/3144867905 >> v2:172.21.15.146:3300/0 conn(0x7fee680c36f0 0x7fee68156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:04.276 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee6f8f8640 1 -- 172.21.15.53:0/3144867905 >> 172.21.15.53:0/3144867905 conn(0x7fee680c7f70 msgr2=0x7fee680c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:04.276 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee6f8f8640 1 -- 172.21.15.53:0/3144867905 shutdown_connections 2023-12-08T20:54:04.276 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee6f8f8640 1 -- 172.21.15.53:0/3144867905 wait complete. 2023-12-08T20:54:04.277 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee6f8f8640 1 Processor -- start 2023-12-08T20:54:04.277 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.275+0000 7fee6f8f8640 1 -- start start 2023-12-08T20:54:04.278 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.279+0000 7fee6f8f8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee680c36f0 0x7fee681f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:04.278 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.279+0000 7fee6f8f8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee680c4ee0 0x7fee6813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:04.278 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.279+0000 7fee6f8f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee680c62b0 0x7fee68137b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:04.278 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.279+0000 7fee6f8f8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68159780 con 0x7fee680c62b0 2023-12-08T20:54:04.278 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.279+0000 7fee6f8f8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68159e60 con 0x7fee680c36f0 2023-12-08T20:54:04.278 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.279+0000 7fee6f8f8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6815a120 con 0x7fee680c4ee0 2023-12-08T20:54:04.278 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.279+0000 7fee6de95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee680c62b0 0x7fee68137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:04.279 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.279+0000 7fee6de95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee680c62b0 0x7fee68137b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45078/0 (socket says 172.21.15.53:45078) 2023-12-08T20:54:04.279 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.279+0000 7fee6de95640 1 -- 172.21.15.53:0/658602318 learned_addr learned my addr 172.21.15.53:0/658602318 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:04.279 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.279+0000 7fee6ce93640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee680c4ee0 0x7fee6813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:04.279 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.279+0000 7fee6d694640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee680c36f0 0x7fee681f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:04.282 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.283+0000 7fee6de95640 1 -- 172.21.15.53:0/658602318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee680c4ee0 msgr2=0x7fee6813ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:04.283 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.283+0000 7fee6de95640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee680c4ee0 0x7fee6813ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:04.283 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.283+0000 7fee6de95640 1 -- 172.21.15.53:0/658602318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee680c36f0 msgr2=0x7fee681f0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:04.283 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.283+0000 7fee6de95640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee680c36f0 0x7fee681f0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:04.283 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.283+0000 7fee6de95640 1 -- 172.21.15.53:0/658602318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60009a70 con 0x7fee680c62b0 2023-12-08T20:54:04.285 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.287+0000 7fee6de95640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee680c62b0 0x7fee68137b70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fee600b0040 tx=0x7fee60019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:04.290 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.291+0000 7fee65ffb640 1 -- 172.21.15.53:0/658602318 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600b9650 con 0x7fee680c62b0 2023-12-08T20:54:04.290 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.291+0000 7fee65ffb640 1 -- 172.21.15.53:0/658602318 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee600b97b0 con 0x7fee680c62b0 2023-12-08T20:54:04.290 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.291+0000 7fee65ffb640 1 -- 172.21.15.53:0/658602318 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600b9b80 con 0x7fee680c62b0 2023-12-08T20:54:04.290 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.291+0000 7fee6f8f8640 1 -- 172.21.15.53:0/658602318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6815a3e0 con 0x7fee680c62b0 2023-12-08T20:54:04.290 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.291+0000 7fee6f8f8640 1 -- 172.21.15.53:0/658602318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee68157670 con 0x7fee680c62b0 2023-12-08T20:54:04.290 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.291+0000 7fee6f8f8640 1 -- 172.21.15.53:0/658602318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee680741f0 con 0x7fee680c62b0 2023-12-08T20:54:04.621 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.619+0000 7fee65ffb640 1 -- 172.21.15.53:0/658602318 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7fee600b9ce0 con 0x7fee680c62b0 2023-12-08T20:54:04.621 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.623+0000 7fee65ffb640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fee54066430 0x7fee540688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:04.622 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.623+0000 7fee6d694640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fee54066430 0x7fee540688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:04.623 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.623+0000 7fee6d694640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fee54066430 0x7fee540688f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee58007fd0 tx=0x7fee58007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:04.661 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.663+0000 7fee65ffb640 1 -- 172.21.15.53:0/658602318 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fee600f0b80 con 0x7fee680c62b0 2023-12-08T20:54:04.661 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.663+0000 7fee65ffb640 1 -- 172.21.15.53:0/658602318 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee600ecec0 con 0x7fee680c62b0 2023-12-08T20:54:04.830 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.831+0000 7fee6f8f8640 1 -- 172.21.15.53:0/658602318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee680741f0 con 0x7fee680c62b0 2023-12-08T20:54:04.924 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.923+0000 7fee65ffb640 1 -- 172.21.15.53:0/658602318 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fee600b2070 con 0x7fee680c62b0 2023-12-08T20:54:04.925 INFO:teuthology.misc.health.smithi053.stdout: 2023-12-08T20:54:04.925 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":10,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:54:02.238448+0000","last_up_change":"0.000000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:54:04.927 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.927+0000 7fee6f8f8640 1 -- 172.21.15.53:0/658602318 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fee54066430 msgr2=0x7fee540688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:04.928 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.927+0000 7fee6f8f8640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fee54066430 0x7fee540688f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee58007fd0 tx=0x7fee58007e40 comp rx=0 tx=0).stop 2023-12-08T20:54:04.928 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.927+0000 7fee6f8f8640 1 -- 172.21.15.53:0/658602318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee680c62b0 msgr2=0x7fee68137b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:04.928 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.927+0000 7fee6f8f8640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee680c62b0 0x7fee68137b70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fee600b0040 tx=0x7fee60019670 comp rx=0 tx=0).stop 2023-12-08T20:54:04.928 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.927+0000 7fee6f8f8640 1 -- 172.21.15.53:0/658602318 shutdown_connections 2023-12-08T20:54:04.928 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.927+0000 7fee6f8f8640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fee54066430 0x7fee540688f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:04.928 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.927+0000 7fee6f8f8640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee680c62b0 0x7fee68137b70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:04.928 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.927+0000 7fee6f8f8640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee680c4ee0 0x7fee6813ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:04.928 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.927+0000 7fee6f8f8640 1 --2- 172.21.15.53:0/658602318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee680c36f0 0x7fee681f0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:04.928 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.927+0000 7fee6f8f8640 1 -- 172.21.15.53:0/658602318 >> 172.21.15.53:0/658602318 conn(0x7fee680c7f70 msgr2=0x7fee680c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:04.928 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.927+0000 7fee6f8f8640 1 -- 172.21.15.53:0/658602318 shutdown_connections 2023-12-08T20:54:04.928 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:04.927+0000 7fee6f8f8640 1 -- 172.21.15.53:0/658602318 wait complete. 2023-12-08T20:54:04.949 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-08T20:54:06.611 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-12-08T20:54:06.608+0000 7f0770388640 -1 osd.6 0 log_to_monitors true 2023-12-08T20:54:06.934 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-12-08T20:54:06.935+0000 7f5307f64640 -1 osd.2 0 log_to_monitors true 2023-12-08T20:54:07.006 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-12-08T20:54:07.007+0000 7f825e224640 -1 osd.3 0 log_to_monitors true 2023-12-08T20:54:07.026 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-12-08T20:54:07.020+0000 7f73e17dc640 -1 osd.4 0 log_to_monitors true 2023-12-08T20:54:07.031 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-12-08T20:54:07.031+0000 7efd16811640 -1 osd.0 0 log_to_monitors true 2023-12-08T20:54:07.035 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-12-08T20:54:07.032+0000 7f4f9e01f640 -1 osd.7 0 log_to_monitors true 2023-12-08T20:54:07.085 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-12-08T20:54:07.083+0000 7f4e57d6f640 -1 osd.1 0 log_to_monitors true 2023-12-08T20:54:07.114 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-12-08T20:54:07.112+0000 7fe2660b0640 -1 osd.5 0 log_to_monitors true 2023-12-08T20:54:09.432 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-12-08T20:54:09.428+0000 7f076cb43640 -1 osd.6 0 waiting for initial osdmap 2023-12-08T20:54:09.653 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-12-08T20:54:09.652+0000 7f076416c640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:54:10.968 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-12-08T20:54:10.968+0000 7f4f99fc8640 -1 osd.7 0 waiting for initial osdmap 2023-12-08T20:54:11.015 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-12-08T20:54:11.012+0000 7f73dd785640 -1 osd.4 0 waiting for initial osdmap 2023-12-08T20:54:11.056 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-12-08T20:54:11.056+0000 7f73d55c0640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:54:11.083 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-12-08T20:54:11.080+0000 7f4f91e03640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:54:11.153 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-12-08T20:54:11.152+0000 7fe262059640 -1 osd.5 0 waiting for initial osdmap 2023-12-08T20:54:11.209 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-12-08T20:54:11.208+0000 7fe259e94640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:54:11.285 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-12-08T20:54:11.283+0000 7f5303f0d640 -1 osd.2 0 waiting for initial osdmap 2023-12-08T20:54:11.326 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-12-08T20:54:11.327+0000 7f52fbd48640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:54:11.354 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-12-08T20:54:11.355+0000 7f4e53d18640 -1 osd.1 0 waiting for initial osdmap 2023-12-08T20:54:11.365 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-12-08T20:54:11.363+0000 7efd12fcc640 -1 osd.0 0 waiting for initial osdmap 2023-12-08T20:54:11.382 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-12-08T20:54:11.383+0000 7f825a1cd640 -1 osd.3 0 waiting for initial osdmap 2023-12-08T20:54:11.462 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-12-08T20:54:11.463+0000 7f4e4bb53640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:54:11.514 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-12-08T20:54:11.515+0000 7f8252008640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:54:11.530 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-12-08T20:54:11.531+0000 7efd0a5f5640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:54:11.754 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-08T20:54:11.881 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.879+0000 7feb4ac70640 1 Processor -- start 2023-12-08T20:54:11.881 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.879+0000 7feb4ac70640 1 -- start start 2023-12-08T20:54:11.882 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.883+0000 7feb4ac70640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feb4413cfc0 0x7feb4406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:11.882 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.883+0000 7feb4ac70640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb4413d3a0 0x7feb44066410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:11.882 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.883+0000 7feb4ac70640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb440c4b80 0x7feb440c5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:11.883 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.883+0000 7feb4ac70640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4415b790 con 0x7feb4413cfc0 2023-12-08T20:54:11.883 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.883+0000 7feb4ac70640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb44158150 con 0x7feb440c4b80 2023-12-08T20:54:11.883 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.883+0000 7feb4ac70640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4415a970 con 0x7feb4413d3a0 2023-12-08T20:54:11.883 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.883+0000 7feb43fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb4413d3a0 0x7feb44066410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:11.884 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.883+0000 7feb4920d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb440c4b80 0x7feb440c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:11.884 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.883+0000 7feb43fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb4413d3a0 0x7feb44066410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:37762/0 (socket says 172.21.15.53:37762) 2023-12-08T20:54:11.884 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.883+0000 7feb43fff640 1 -- 172.21.15.53:0/2460688323 learned_addr learned my addr 172.21.15.53:0/2460688323 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:11.890 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.891+0000 7feb43fff640 1 -- 172.21.15.53:0/2460688323 >> v2:172.21.15.146:3300/0 conn(0x7feb440c4b80 msgr2=0x7feb440c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:11.890 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.891+0000 7feb43fff640 1 --2- 172.21.15.53:0/2460688323 >> v2:172.21.15.146:3300/0 conn(0x7feb440c4b80 0x7feb440c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:11.890 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.891+0000 7feb43fff640 1 -- 172.21.15.53:0/2460688323 >> v2:172.21.15.53:3300/0 conn(0x7feb4413cfc0 msgr2=0x7feb4406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:11.890 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.891+0000 7feb43fff640 1 --2- 172.21.15.53:0/2460688323 >> v2:172.21.15.53:3300/0 conn(0x7feb4413cfc0 0x7feb4406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:11.890 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.891+0000 7feb43fff640 1 -- 172.21.15.53:0/2460688323 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4415ac10 con 0x7feb4413d3a0 2023-12-08T20:54:11.899 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.899+0000 7feb43fff640 1 --2- 172.21.15.53:0/2460688323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb4413d3a0 0x7feb44066410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb38009870 tx=0x7feb3801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75fe7fea5707ba90 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:11.905 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.903+0000 7feb437fe640 1 -- 172.21.15.53:0/2460688323 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380a89b0 con 0x7feb4413d3a0 2023-12-08T20:54:11.905 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.903+0000 7feb437fe640 1 -- 172.21.15.53:0/2460688323 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb380a8b10 con 0x7feb4413d3a0 2023-12-08T20:54:11.905 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.903+0000 7feb437fe640 1 -- 172.21.15.53:0/2460688323 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380a8ea0 con 0x7feb4413d3a0 2023-12-08T20:54:11.906 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 -- 172.21.15.53:0/2460688323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb4413d3a0 msgr2=0x7feb44066410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:11.906 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 --2- 172.21.15.53:0/2460688323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb4413d3a0 0x7feb44066410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb38009870 tx=0x7feb3801ecf0 comp rx=0 tx=0).stop 2023-12-08T20:54:11.906 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 -- 172.21.15.53:0/2460688323 shutdown_connections 2023-12-08T20:54:11.906 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 --2- 172.21.15.53:0/2460688323 >> v2:172.21.15.146:3300/0 conn(0x7feb440c4b80 0x7feb440c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:11.906 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 --2- 172.21.15.53:0/2460688323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb4413d3a0 0x7feb44066410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:11.907 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 --2- 172.21.15.53:0/2460688323 >> v2:172.21.15.53:3300/0 conn(0x7feb4413cfc0 0x7feb4406a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:11.907 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 -- 172.21.15.53:0/2460688323 >> 172.21.15.53:0/2460688323 conn(0x7feb440c7f70 msgr2=0x7feb440c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:11.907 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 -- 172.21.15.53:0/2460688323 shutdown_connections 2023-12-08T20:54:11.907 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 -- 172.21.15.53:0/2460688323 wait complete. 2023-12-08T20:54:11.908 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 Processor -- start 2023-12-08T20:54:11.908 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 -- start start 2023-12-08T20:54:11.909 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb440c4b80 0x7feb441375e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:11.909 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb4413cfc0 0x7feb441358d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:11.909 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb4413d3a0 0x7feb44155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:11.909 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb441ecc40 con 0x7feb4413cfc0 2023-12-08T20:54:11.909 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb44137c40 con 0x7feb4413d3a0 2023-12-08T20:54:11.909 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.907+0000 7feb4ac70640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb441ecee0 con 0x7feb440c4b80 2023-12-08T20:54:11.910 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.911+0000 7feb4920d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb4413d3a0 0x7feb44155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:11.911 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.911+0000 7feb48a0c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb440c4b80 0x7feb441375e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:11.911 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.911+0000 7feb4920d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb4413d3a0 0x7feb44155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:46662/0 (socket says 172.21.15.53:46662) 2023-12-08T20:54:11.911 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.911+0000 7feb4920d640 1 -- 172.21.15.53:0/3113185918 learned_addr learned my addr 172.21.15.53:0/3113185918 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:11.920 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.919+0000 7feb48a0c640 1 -- 172.21.15.53:0/3113185918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb4413d3a0 msgr2=0x7feb44155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:11.920 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.919+0000 7feb48a0c640 1 --2- 172.21.15.53:0/3113185918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb4413d3a0 0x7feb44155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:11.920 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.919+0000 7feb48a0c640 1 -- 172.21.15.53:0/3113185918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb4413cfc0 msgr2=0x7feb441358d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:11.920 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.919+0000 7feb48a0c640 1 --2- 172.21.15.53:0/3113185918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb4413cfc0 0x7feb441358d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:11.921 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.919+0000 7feb48a0c640 1 -- 172.21.15.53:0/3113185918 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb380094d0 con 0x7feb440c4b80 2023-12-08T20:54:11.926 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.927+0000 7feb48a0c640 1 --2- 172.21.15.53:0/3113185918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb440c4b80 0x7feb441375e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb3400b410 tx=0x7feb3400b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:11.935 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.935+0000 7feb417fa640 1 -- 172.21.15.53:0/3113185918 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb34011830 con 0x7feb440c4b80 2023-12-08T20:54:11.935 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.935+0000 7feb417fa640 1 -- 172.21.15.53:0/3113185918 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb34011990 con 0x7feb440c4b80 2023-12-08T20:54:11.935 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.935+0000 7feb417fa640 1 -- 172.21.15.53:0/3113185918 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb34011d40 con 0x7feb440c4b80 2023-12-08T20:54:11.936 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.935+0000 7feb4ac70640 1 -- 172.21.15.53:0/3113185918 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb441ed1c0 con 0x7feb440c4b80 2023-12-08T20:54:11.936 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.935+0000 7feb4ac70640 1 -- 172.21.15.53:0/3113185918 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb440c9d30 con 0x7feb440c4b80 2023-12-08T20:54:11.936 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:11.935+0000 7feb4ac70640 1 -- 172.21.15.53:0/3113185918 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb441ed6e0 con 0x7feb440c4b80 2023-12-08T20:54:12.239 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.239+0000 7feb417fa640 1 -- 172.21.15.53:0/3113185918 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7feb3401a400 con 0x7feb440c4b80 2023-12-08T20:54:12.239 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.239+0000 7feb417fa640 1 --2- 172.21.15.53:0/3113185918 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7feb300663e0 0x7feb300688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:12.240 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.239+0000 7feb43fff640 1 --2- 172.21.15.53:0/3113185918 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7feb300663e0 0x7feb300688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:12.240 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.239+0000 7feb417fa640 1 -- 172.21.15.53:0/3113185918 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3071+0+0 (secure 0 0 0) 0x7feb34055b00 con 0x7feb440c4b80 2023-12-08T20:54:12.240 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.239+0000 7feb43fff640 1 --2- 172.21.15.53:0/3113185918 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7feb300663e0 0x7feb300688a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb380b2000 tx=0x7feb38004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:12.251 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.251+0000 7feb417fa640 1 -- 172.21.15.53:0/3113185918 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb34051740 con 0x7feb440c4b80 2023-12-08T20:54:12.425 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.423+0000 7feb4ac70640 1 -- 172.21.15.53:0/3113185918 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb441ed6e0 con 0x7feb440c4b80 2023-12-08T20:54:12.711 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.711+0000 7feb417fa640 1 -- 172.21.15.53:0/3113185918 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8526 (secure 0 0 0) 0x7feb441ed6e0 con 0x7feb440c4b80 2023-12-08T20:54:12.712 INFO:teuthology.misc.health.smithi053.stdout: 2023-12-08T20:54:12.712 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":14,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:54:11.247837+0000","last_up_change":"2023-12-08T20:54:11.247837+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:54:12.715 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.715+0000 7feb4ac70640 1 -- 172.21.15.53:0/3113185918 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7feb300663e0 msgr2=0x7feb300688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:12.715 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.715+0000 7feb4ac70640 1 --2- 172.21.15.53:0/3113185918 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7feb300663e0 0x7feb300688a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb380b2000 tx=0x7feb38004740 comp rx=0 tx=0).stop 2023-12-08T20:54:12.715 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.715+0000 7feb4ac70640 1 -- 172.21.15.53:0/3113185918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb440c4b80 msgr2=0x7feb441375e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:12.715 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.715+0000 7feb4ac70640 1 --2- 172.21.15.53:0/3113185918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb440c4b80 0x7feb441375e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb3400b410 tx=0x7feb3400b810 comp rx=0 tx=0).stop 2023-12-08T20:54:12.715 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.715+0000 7feb4ac70640 1 -- 172.21.15.53:0/3113185918 shutdown_connections 2023-12-08T20:54:12.715 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.715+0000 7feb4ac70640 1 --2- 172.21.15.53:0/3113185918 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7feb300663e0 0x7feb300688a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:12.715 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.715+0000 7feb4ac70640 1 --2- 172.21.15.53:0/3113185918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb4413d3a0 0x7feb44155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:12.715 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.715+0000 7feb4ac70640 1 --2- 172.21.15.53:0/3113185918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb4413cfc0 0x7feb441358d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:12.715 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.715+0000 7feb4ac70640 1 --2- 172.21.15.53:0/3113185918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb440c4b80 0x7feb441375e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:12.715 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.715+0000 7feb4ac70640 1 -- 172.21.15.53:0/3113185918 >> 172.21.15.53:0/3113185918 conn(0x7feb440c7f70 msgr2=0x7feb4406b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:12.715 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.715+0000 7feb4ac70640 1 -- 172.21.15.53:0/3113185918 shutdown_connections 2023-12-08T20:54:12.715 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:12.715+0000 7feb4ac70640 1 -- 172.21.15.53:0/3113185918 wait complete. 2023-12-08T20:54:12.736 DEBUG:teuthology.misc:3 of 8 OSDs are up 2023-12-08T20:54:19.545 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-08T20:54:19.660 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.659+0000 7f3803d42640 1 Processor -- start 2023-12-08T20:54:19.660 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.659+0000 7f3803d42640 1 -- start start 2023-12-08T20:54:19.661 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.659+0000 7f3803d42640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f37fc06b250 0x7f37fc0c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:19.661 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.659+0000 7f3803d42640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f37fc0cc5b0 0x7f37fc0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:19.661 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.659+0000 7f3803d42640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc0c6b10 con 0x7f37fc0cc1d0 2023-12-08T20:54:19.661 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.659+0000 7f3803d42640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc06f330 con 0x7f37fc0cc5b0 2023-12-08T20:54:19.661 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.659+0000 7f3803d42640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc1577f0 con 0x7f37fc06b250 2023-12-08T20:54:19.662 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.663+0000 7f38022df640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f37fc0cc5b0 0x7f37fc0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:19.662 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.663+0000 7f38022df640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f37fc0cc5b0 0x7f37fc0c74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43374/0 (socket says 172.21.15.53:43374) 2023-12-08T20:54:19.663 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.663+0000 7f38022df640 1 -- 172.21.15.53:0/3410859588 learned_addr learned my addr 172.21.15.53:0/3410859588 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:19.663 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.663+0000 7f38012dd640 1 --2- 172.21.15.53:0/3410859588 >> v2:172.21.15.146:3300/0 conn(0x7f37fc06b250 0x7f37fc0c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:19.665 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.667+0000 7f38022df640 1 -- 172.21.15.53:0/3410859588 >> v2:172.21.15.146:3300/0 conn(0x7f37fc06b250 msgr2=0x7f37fc0c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:19.665 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.667+0000 7f38022df640 1 --2- 172.21.15.53:0/3410859588 >> v2:172.21.15.146:3300/0 conn(0x7f37fc06b250 0x7f37fc0c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:19.666 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.667+0000 7f38022df640 1 -- 172.21.15.53:0/3410859588 >> v1:172.21.15.146:6789/0 conn(0x7f37fc0cc1d0 legacy=0x7f37fc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:19.666 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.667+0000 7f38022df640 1 -- 172.21.15.53:0/3410859588 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc157ad0 con 0x7f37fc0cc5b0 2023-12-08T20:54:19.669 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:19.667+0000 7f38022df640 1 --2- 172.21.15.53:0/3410859588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc0cc5b0 0x7f37fc0c74e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f37fc06fb40 tx=0x7f37f401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f456e08a160752a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:24.600 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.599+0000 7f3800adc640 1 -- 172.21.15.53:0/3410859588 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f40af400 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.601 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.599+0000 7f3800adc640 1 -- 172.21.15.53:0/3410859588 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f40ab050 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.601 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.599+0000 7f3800adc640 1 -- 172.21.15.53:0/3410859588 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f40af800 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.602 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 -- 172.21.15.53:0/3410859588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc0cc5b0 msgr2=0x7f37fc0c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:24.602 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 --2- 172.21.15.53:0/3410859588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc0cc5b0 0x7f37fc0c74e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f37fc06fb40 tx=0x7f37f401f1c0 comp rx=0 tx=0).stop 2023-12-08T20:54:24.602 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 -- 172.21.15.53:0/3410859588 shutdown_connections 2023-12-08T20:54:24.602 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 --2- 172.21.15.53:0/3410859588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc0cc5b0 0x7f37fc0c74e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:24.602 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 --2- 172.21.15.53:0/3410859588 >> v2:172.21.15.146:3300/0 conn(0x7f37fc06b250 0x7f37fc0c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:24.602 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 -- 172.21.15.53:0/3410859588 >> 172.21.15.53:0/3410859588 conn(0x7f37fc06b6c0 msgr2=0x7f37fc06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:24.602 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 -- 172.21.15.53:0/3410859588 shutdown_connections 2023-12-08T20:54:24.602 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 -- 172.21.15.53:0/3410859588 wait complete. 2023-12-08T20:54:24.603 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 Processor -- start 2023-12-08T20:54:24.603 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 -- start start 2023-12-08T20:54:24.605 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc06b250 0x7f37fc1495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:24.605 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37fc0cc1d0 0x7f37fc1ed010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:24.605 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc0cc5b0 0x7f37fc0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:24.605 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc1ea8e0 con 0x7f37fc06b250 2023-12-08T20:54:24.605 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc1ec900 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.605 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.603+0000 7f3803d42640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc155260 con 0x7f37fc0cc1d0 2023-12-08T20:54:24.606 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.607+0000 7f38022df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc0cc5b0 0x7f37fc0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:24.607 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.607+0000 7f38022df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc0cc5b0 0x7f37fc0cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:34810/0 (socket says 172.21.15.53:34810) 2023-12-08T20:54:24.608 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.607+0000 7f38022df640 1 -- 172.21.15.53:0/1376751228 learned_addr learned my addr 172.21.15.53:0/1376751228 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:24.619 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.619+0000 7f38022df640 1 -- 172.21.15.53:0/1376751228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37fc0cc1d0 msgr2=0x7f37fc1ed010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:24.620 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.619+0000 7f38022df640 1 --2- 172.21.15.53:0/1376751228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37fc0cc1d0 0x7f37fc1ed010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:24.620 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.619+0000 7f38022df640 1 -- 172.21.15.53:0/1376751228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc06b250 msgr2=0x7f37fc1495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:24.620 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.619+0000 7f38022df640 1 --2- 172.21.15.53:0/1376751228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc06b250 0x7f37fc1495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:24.620 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.619+0000 7f38022df640 1 -- 172.21.15.53:0/1376751228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f4009b30 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.627 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.627+0000 7f38022df640 1 --2- 172.21.15.53:0/1376751228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc0cc5b0 0x7f37fc0cb3e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f37f401bdd0 tx=0x7f37f401bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:24.639 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.639+0000 7f37f27fc640 1 -- 172.21.15.53:0/1376751228 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4004240 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.639 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.639+0000 7f37f27fc640 1 -- 172.21.15.53:0/1376751228 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f40043a0 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.639 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.639+0000 7f3803d42640 1 -- 172.21.15.53:0/1376751228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc14b6c0 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.639 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.639+0000 7f37f27fc640 1 -- 172.21.15.53:0/1376751228 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4004730 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.639 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.639+0000 7f3803d42640 1 -- 172.21.15.53:0/1376751228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc1f0880 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.640 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.639+0000 7f3803d42640 1 -- 172.21.15.53:0/1376751228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc06c650 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.943 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.943+0000 7f37f27fc640 1 -- 172.21.15.53:0/1376751228 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f37f40c5460 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.943 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.943+0000 7f37f27fc640 1 --2- 172.21.15.53:0/1376751228 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f37e0066430 0x7f37e00688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:24.944 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.943+0000 7f3801ade640 1 --2- 172.21.15.53:0/1376751228 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f37e0066430 0x7f37e00688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:24.944 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.943+0000 7f3801ade640 1 --2- 172.21.15.53:0/1376751228 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f37e0066430 0x7f37e00688f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37ec000f70 tx=0x7f37ec0079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:24.951 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.951+0000 7f37f27fc640 1 -- 172.21.15.53:0/1376751228 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f37f40f4340 con 0x7f37fc0cc5b0 2023-12-08T20:54:24.973 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:24.975+0000 7f37f27fc640 1 -- 172.21.15.53:0/1376751228 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37f40eff80 con 0x7f37fc0cc5b0 2023-12-08T20:54:25.150 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:25.151+0000 7f3803d42640 1 -- 172.21.15.53:0/1376751228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37fc0741f0 con 0x7f37fc0cc5b0 2023-12-08T20:54:26.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:54:26.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:54:31.517 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:31.515+0000 7f37f27fc640 1 -- 172.21.15.53:0/1376751228 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37f40f0350 con 0x7f37fc0cc5b0 2023-12-08T20:54:32.182 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.183+0000 7f37f27fc640 1 -- 172.21.15.53:0/1376751228 <== mon.1 v2:172.21.15.146:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f37f40bcae0 con 0x7f37fc0cc5b0 2023-12-08T20:54:32.183 INFO:teuthology.misc.health.smithi053.stdout: 2023-12-08T20:54:32.183 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":18,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:54:16.826803+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:54:32.186 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.187+0000 7f3803d42640 1 -- 172.21.15.53:0/1376751228 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f37e0066430 msgr2=0x7f37e00688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:32.187 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.187+0000 7f3803d42640 1 --2- 172.21.15.53:0/1376751228 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f37e0066430 0x7f37e00688f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37ec000f70 tx=0x7f37ec0079c0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.187 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.187+0000 7f3803d42640 1 -- 172.21.15.53:0/1376751228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc0cc5b0 msgr2=0x7f37fc0cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:32.187 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.187+0000 7f3803d42640 1 --2- 172.21.15.53:0/1376751228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc0cc5b0 0x7f37fc0cb3e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f37f401bdd0 tx=0x7f37f401bf60 comp rx=0 tx=0).stop 2023-12-08T20:54:32.187 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.187+0000 7f3803d42640 1 -- 172.21.15.53:0/1376751228 shutdown_connections 2023-12-08T20:54:32.187 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.187+0000 7f3803d42640 1 --2- 172.21.15.53:0/1376751228 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f37e0066430 0x7f37e00688f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.187 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.187+0000 7f3803d42640 1 --2- 172.21.15.53:0/1376751228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc0cc5b0 0x7f37fc0cb3e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.187 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.187+0000 7f3803d42640 1 --2- 172.21.15.53:0/1376751228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37fc0cc1d0 0x7f37fc1ed010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.187 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.187+0000 7f3803d42640 1 --2- 172.21.15.53:0/1376751228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc06b250 0x7f37fc1495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.187 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.187+0000 7f3803d42640 1 -- 172.21.15.53:0/1376751228 >> 172.21.15.53:0/1376751228 conn(0x7f37fc06b6c0 msgr2=0x7f37fc06baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:32.187 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.187+0000 7f3803d42640 1 -- 172.21.15.53:0/1376751228 shutdown_connections 2023-12-08T20:54:32.187 INFO:teuthology.misc.health.smithi053.stderr:2023-12-08T20:54:32.187+0000 7f3803d42640 1 -- 172.21.15.53:0/1376751228 wait complete. 2023-12-08T20:54:32.211 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-08T20:54:32.212 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-08T20:54:32.212 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-12-08T20:54:32.212 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-08T20:54:32.212 DEBUG:teuthology.orchestra.run.smithi053:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-12-08T20:54:32.215 INFO:tasks.ceph.mds.a:Started 2023-12-08T20:54:32.215 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-12-08T20:54:32.215 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-08T20:54:32.215 DEBUG:teuthology.orchestra.run.smithi053:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-12-08T20:54:32.217 INFO:tasks.ceph.mds.c:Started 2023-12-08T20:54:32.217 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-12-08T20:54:32.217 INFO:tasks.ceph.mds.e:Restarting daemon 2023-12-08T20:54:32.218 DEBUG:teuthology.orchestra.run.smithi053:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-12-08T20:54:32.220 INFO:tasks.ceph.mds.e:Started 2023-12-08T20:54:32.220 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-12-08T20:54:32.220 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-08T20:54:32.220 DEBUG:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-12-08T20:54:32.223 INFO:tasks.ceph.mds.b:Started 2023-12-08T20:54:32.223 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-12-08T20:54:32.223 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-08T20:54:32.223 DEBUG:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-12-08T20:54:32.226 INFO:tasks.ceph.mds.d:Started 2023-12-08T20:54:32.226 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-12-08T20:54:32.226 INFO:tasks.ceph.mds.f:Restarting daemon 2023-12-08T20:54:32.226 DEBUG:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-12-08T20:54:32.231 INFO:tasks.ceph.mds.f:Started 2023-12-08T20:54:32.231 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-08T20:54:32.231 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:54:32.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.355+0000 7f91c76e7640 1 Processor -- start 2023-12-08T20:54:32.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.355+0000 7f91c76e7640 1 -- start start 2023-12-08T20:54:32.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.355+0000 7f91c76e7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f91c00c3770 0x7f91c0164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:32.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.355+0000 7f91c76e7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c015a5f0 con 0x7f91c00c8820 2023-12-08T20:54:32.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.355+0000 7f91c76e7640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c00c7de0 con 0x7f91c01537a0 2023-12-08T20:54:32.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.355+0000 7f91c76e7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c00c80c0 con 0x7f91c00c3770 2023-12-08T20:54:32.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.355+0000 7f91c5c84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f91c00c3770 0x7f91c0164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:32.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.355+0000 7f91c5c84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f91c00c3770 0x7f91c0164fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48562/0 (socket says 172.21.15.53:48562) 2023-12-08T20:54:32.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.355+0000 7f91c5c84640 1 -- 172.21.15.53:0/3841576767 learned_addr learned my addr 172.21.15.53:0/3841576767 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:32.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.359+0000 7f91c5c84640 1 -- 172.21.15.53:0/3841576767 >> v1:172.21.15.146:6789/0 conn(0x7f91c01537a0 legacy=0x7f91c00c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:32.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.359+0000 7f91c5c84640 1 -- 172.21.15.53:0/3841576767 >> v1:172.21.15.53:6789/0 conn(0x7f91c00c8820 legacy=0x7f91c00ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:32.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.359+0000 7f91c5c84640 1 -- 172.21.15.53:0/3841576767 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c0159830 con 0x7f91c00c3770 2023-12-08T20:54:32.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.363+0000 7f91c5c84640 1 --2- 172.21.15.53:0/3841576767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00c3770 0x7f91c0164fb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009e50 tx=0x7f91b801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f678275cbae3c6d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:32.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.367+0000 7f91b7fff640 1 -- 172.21.15.53:0/3841576767 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80a5600 con 0x7f91c00c3770 2023-12-08T20:54:32.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.367+0000 7f91b7fff640 1 -- 172.21.15.53:0/3841576767 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b80a5760 con 0x7f91c00c3770 2023-12-08T20:54:32.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.367+0000 7f91b7fff640 1 -- 172.21.15.53:0/3841576767 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80a5af0 con 0x7f91c00c3770 2023-12-08T20:54:32.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.371+0000 7f91c76e7640 1 -- 172.21.15.53:0/3841576767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00c3770 msgr2=0x7f91c0164fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:32.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.371+0000 7f91c76e7640 1 --2- 172.21.15.53:0/3841576767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00c3770 0x7f91c0164fb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009e50 tx=0x7f91b801c940 comp rx=0 tx=0).stop 2023-12-08T20:54:32.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.371+0000 7f91c76e7640 1 -- 172.21.15.53:0/3841576767 shutdown_connections 2023-12-08T20:54:32.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.371+0000 7f91c76e7640 1 --2- 172.21.15.53:0/3841576767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00c3770 0x7f91c0164fb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.371+0000 7f91c76e7640 1 -- 172.21.15.53:0/3841576767 >> 172.21.15.53:0/3841576767 conn(0x7f91c0060fd0 msgr2=0x7f91c00613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:32.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.371+0000 7f91c76e7640 1 -- 172.21.15.53:0/3841576767 shutdown_connections 2023-12-08T20:54:32.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.371+0000 7f91c76e7640 1 -- 172.21.15.53:0/3841576767 wait complete. 2023-12-08T20:54:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.371+0000 7f91c76e7640 1 Processor -- start 2023-12-08T20:54:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.371+0000 7f91c76e7640 1 -- start start 2023-12-08T20:54:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.375+0000 7f91c76e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00c3770 0x7f91c0152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.375+0000 7f91c76e7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91c00c8820 0x7f91c00cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.375+0000 7f91c76e7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91c01537a0 0x7f91c01517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.375+0000 7f91c76e7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00c3bc0 con 0x7f91c00c3770 2023-12-08T20:54:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.375+0000 7f91c76e7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00cd5e0 con 0x7f91c01537a0 2023-12-08T20:54:32.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.375+0000 7f91c76e7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00cd160 con 0x7f91c00c8820 2023-12-08T20:54:32.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.375+0000 7f91c5483640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00c3770 0x7f91c0152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:32.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.375+0000 7f91c5483640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00c3770 0x7f91c0152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48572/0 (socket says 172.21.15.53:48572) 2023-12-08T20:54:32.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.375+0000 7f91c5483640 1 -- 172.21.15.53:0/3744283340 learned_addr learned my addr 172.21.15.53:0/3744283340 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:32.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.375+0000 7f91c5c84640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91c01537a0 0x7f91c01517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:32.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.379+0000 7f91c5483640 1 -- 172.21.15.53:0/3744283340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91c00c8820 msgr2=0x7f91c00cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:32.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.379+0000 7f91c5483640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91c00c8820 0x7f91c00cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.379+0000 7f91c5483640 1 -- 172.21.15.53:0/3744283340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91c01537a0 msgr2=0x7f91c01517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:32.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.379+0000 7f91c5483640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91c01537a0 0x7f91c01517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.379+0000 7f91c5483640 1 -- 172.21.15.53:0/3744283340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8009b30 con 0x7f91c00c3770 2023-12-08T20:54:32.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.383+0000 7f91c5483640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00c3770 0x7f91c0152140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00c3f0 tx=0x7f91bc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:32.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.383+0000 7f91b5ffb640 1 -- 172.21.15.53:0/3744283340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc0052d0 con 0x7f91c00c3770 2023-12-08T20:54:32.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.383+0000 7f91c76e7640 1 -- 172.21.15.53:0/3744283340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c00c7260 con 0x7f91c00c3770 2023-12-08T20:54:32.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.383+0000 7f91c76e7640 1 -- 172.21.15.53:0/3744283340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c0151060 con 0x7f91c00c3770 2023-12-08T20:54:32.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.387+0000 7f91c76e7640 1 -- 172.21.15.53:0/3744283340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c0074190 con 0x7f91c00c3770 2023-12-08T20:54:32.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.387+0000 7f91b5ffb640 1 -- 172.21.15.53:0/3744283340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc005430 con 0x7f91c00c3770 2023-12-08T20:54:32.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.387+0000 7f91b5ffb640 1 -- 172.21.15.53:0/3744283340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc007230 con 0x7f91c00c3770 2023-12-08T20:54:32.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.667+0000 7f91b5ffb640 1 -- 172.21.15.53:0/3744283340 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91bc007390 con 0x7f91c00c3770 2023-12-08T20:54:32.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.667+0000 7f91b5ffb640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f91a4066470 0x7f91a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:32.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.667+0000 7f91c4c82640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f91a4066470 0x7f91a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:32.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.671+0000 7f91c4c82640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f91a4066470 0x7f91a4068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91b0007fd0 tx=0x7f91b00079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:32.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.691+0000 7f91b5ffb640 1 -- 172.21.15.53:0/3744283340 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f91bc054a20 con 0x7f91c00c3770 2023-12-08T20:54:32.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.695+0000 7f91b5ffb640 1 -- 172.21.15.53:0/3744283340 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91bc050d60 con 0x7f91c00c3770 2023-12-08T20:54:32.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.859+0000 7f91c76e7640 1 -- 172.21.15.53:0/3744283340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91c00c8600 con 0x7f91c00c3770 2023-12-08T20:54:32.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.963+0000 7f91b5ffb640 1 -- 172.21.15.53:0/3744283340 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f91bc017070 con 0x7f91c00c3770 2023-12-08T20:54:32.965 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:54:32.965 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":18,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:54:16.826803+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:54:32.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.967+0000 7f91c76e7640 1 -- 172.21.15.53:0/3744283340 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f91a4066470 msgr2=0x7f91a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:32.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.967+0000 7f91c76e7640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f91a4066470 0x7f91a4068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91b0007fd0 tx=0x7f91b00079a0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.967+0000 7f91c76e7640 1 -- 172.21.15.53:0/3744283340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00c3770 msgr2=0x7f91c0152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:32.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.967+0000 7f91c76e7640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00c3770 0x7f91c0152140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00c3f0 tx=0x7f91bc00c8b0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.967+0000 7f91c76e7640 1 -- 172.21.15.53:0/3744283340 shutdown_connections 2023-12-08T20:54:32.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.967+0000 7f91c76e7640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f91a4066470 0x7f91a4068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.967+0000 7f91c76e7640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91c01537a0 0x7f91c01517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.967+0000 7f91c76e7640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91c00c8820 0x7f91c00cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.967+0000 7f91c76e7640 1 --2- 172.21.15.53:0/3744283340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c00c3770 0x7f91c0152140 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:32.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.967+0000 7f91c76e7640 1 -- 172.21.15.53:0/3744283340 >> 172.21.15.53:0/3744283340 conn(0x7f91c0060fd0 msgr2=0x7f91c0154cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:32.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.967+0000 7f91c76e7640 1 -- 172.21.15.53:0/3744283340 shutdown_connections 2023-12-08T20:54:32.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:32.967+0000 7f91c76e7640 1 -- 172.21.15.53:0/3744283340 wait complete. 2023-12-08T20:54:32.984 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T20:54:13.707275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T20:54:32.984 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T20:54:33.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.099+0000 7f9f74498640 1 Processor -- start 2023-12-08T20:54:33.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.099+0000 7f9f74498640 1 -- start start 2023-12-08T20:54:33.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.099+0000 7f9f74498640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9f6c1538b0 0x7f9f6c0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:33.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.099+0000 7f9f74498640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c06afc0 0x7f9f6c0c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:33.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.099+0000 7f9f74498640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6c0c7590 con 0x7f9f6c06f010 2023-12-08T20:54:33.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.099+0000 7f9f74498640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6c15a560 con 0x7f9f6c1538b0 2023-12-08T20:54:33.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.099+0000 7f9f74498640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c159720 con 0x7f9f6c06afc0 2023-12-08T20:54:33.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.099+0000 7f9f71a33640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c06afc0 0x7f9f6c0c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:33.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.099+0000 7f9f72234640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9f6c1538b0 0x7f9f6c0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:33.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.099+0000 7f9f71a33640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c06afc0 0x7f9f6c0c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:45884/0 (socket says 172.21.15.53:45884) 2023-12-08T20:54:33.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.099+0000 7f9f71a33640 1 -- 172.21.15.53:0/4157352612 learned_addr learned my addr 172.21.15.53:0/4157352612 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:33.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.103+0000 7f9f71a33640 1 -- 172.21.15.53:0/4157352612 >> v2:172.21.15.146:3300/0 conn(0x7f9f6c1538b0 msgr2=0x7f9f6c0c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:33.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.103+0000 7f9f71a33640 1 --2- 172.21.15.53:0/4157352612 >> v2:172.21.15.146:3300/0 conn(0x7f9f6c1538b0 0x7f9f6c0c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:33.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.103+0000 7f9f71a33640 1 -- 172.21.15.53:0/4157352612 >> v1:172.21.15.146:6789/0 conn(0x7f9f6c06f010 legacy=0x7f9f6c15cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:33.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.103+0000 7f9f71a33640 1 -- 172.21.15.53:0/4157352612 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c1599e0 con 0x7f9f6c06afc0 2023-12-08T20:54:33.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.111+0000 7f9f71a33640 1 --2- 172.21.15.53:0/4157352612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c06afc0 0x7f9f6c0c6f20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009870 tx=0x7f9f5c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ccf0ea5c85b9a60 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:33.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.115+0000 7f9f71232640 1 -- 172.21.15.53:0/4157352612 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0ab600 con 0x7f9f6c06afc0 2023-12-08T20:54:33.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.115+0000 7f9f71232640 1 -- 172.21.15.53:0/4157352612 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c0a7050 con 0x7f9f6c06afc0 2023-12-08T20:54:33.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.115+0000 7f9f71232640 1 -- 172.21.15.53:0/4157352612 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0ab980 con 0x7f9f6c06afc0 2023-12-08T20:54:33.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.115+0000 7f9f74498640 1 -- 172.21.15.53:0/4157352612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c06afc0 msgr2=0x7f9f6c0c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:33.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.115+0000 7f9f74498640 1 --2- 172.21.15.53:0/4157352612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c06afc0 0x7f9f6c0c6f20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009870 tx=0x7f9f5c01c540 comp rx=0 tx=0).stop 2023-12-08T20:54:33.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.115+0000 7f9f74498640 1 -- 172.21.15.53:0/4157352612 shutdown_connections 2023-12-08T20:54:33.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.115+0000 7f9f74498640 1 --2- 172.21.15.53:0/4157352612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c06afc0 0x7f9f6c0c6f20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:33.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.115+0000 7f9f74498640 1 --2- 172.21.15.53:0/4157352612 >> v2:172.21.15.146:3300/0 conn(0x7f9f6c1538b0 0x7f9f6c0c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:33.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.115+0000 7f9f74498640 1 -- 172.21.15.53:0/4157352612 >> 172.21.15.53:0/4157352612 conn(0x7f9f6c0cbfe0 msgr2=0x7f9f6c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:33.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.115+0000 7f9f74498640 1 -- 172.21.15.53:0/4157352612 shutdown_connections 2023-12-08T20:54:33.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.115+0000 7f9f74498640 1 -- 172.21.15.53:0/4157352612 wait complete. 2023-12-08T20:54:33.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f74498640 1 Processor -- start 2023-12-08T20:54:33.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f74498640 1 -- start start 2023-12-08T20:54:33.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f74498640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f6c06afc0 0x7f9f6c1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:33.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f74498640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f6c06f010 0x7f9f6c1f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:33.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f74498640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c1538b0 0x7f9f6c1f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:33.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f74498640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c155000 con 0x7f9f6c06afc0 2023-12-08T20:54:33.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f74498640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c14d7a0 con 0x7f9f6c06f010 2023-12-08T20:54:33.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f74498640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c155b00 con 0x7f9f6c1538b0 2023-12-08T20:54:33.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f72a35640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c1538b0 0x7f9f6c1f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:33.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f71a33640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f6c06f010 0x7f9f6c1f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:33.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f72a35640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c1538b0 0x7f9f6c1f6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:45892/0 (socket says 172.21.15.53:45892) 2023-12-08T20:54:33.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f72a35640 1 -- 172.21.15.53:0/3868389213 learned_addr learned my addr 172.21.15.53:0/3868389213 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:33.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.119+0000 7f9f72234640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f6c06afc0 0x7f9f6c1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:33.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.127+0000 7f9f72a35640 1 -- 172.21.15.53:0/3868389213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f6c06f010 msgr2=0x7f9f6c1f6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:33.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.127+0000 7f9f72a35640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f6c06f010 0x7f9f6c1f6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:33.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.127+0000 7f9f72a35640 1 -- 172.21.15.53:0/3868389213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f6c06afc0 msgr2=0x7f9f6c1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:33.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.127+0000 7f9f72a35640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f6c06afc0 0x7f9f6c1589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:33.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.127+0000 7f9f72a35640 1 -- 172.21.15.53:0/3868389213 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0094d0 con 0x7f9f6c1538b0 2023-12-08T20:54:33.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.131+0000 7f9f72a35640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c1538b0 0x7f9f6c1f6950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400c7a0 tx=0x7f9f6400cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:33.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.131+0000 7f9f62ffd640 1 -- 172.21.15.53:0/3868389213 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f64003b80 con 0x7f9f6c1538b0 2023-12-08T20:54:33.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.131+0000 7f9f74498640 1 -- 172.21.15.53:0/3868389213 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6c154a30 con 0x7f9f6c1538b0 2023-12-08T20:54:33.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.131+0000 7f9f74498640 1 -- 172.21.15.53:0/3868389213 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6c154100 con 0x7f9f6c1538b0 2023-12-08T20:54:33.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.135+0000 7f9f74498640 1 -- 172.21.15.53:0/3868389213 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6c074190 con 0x7f9f6c1538b0 2023-12-08T20:54:33.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.135+0000 7f9f62ffd640 1 -- 172.21.15.53:0/3868389213 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f64003ce0 con 0x7f9f6c1538b0 2023-12-08T20:54:33.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.135+0000 7f9f62ffd640 1 -- 172.21.15.53:0/3868389213 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400aa50 con 0x7f9f6c1538b0 2023-12-08T20:54:33.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.575+0000 7f9f62ffd640 1 -- 172.21.15.53:0/3868389213 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f6400abb0 con 0x7f9f6c1538b0 2023-12-08T20:54:33.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.575+0000 7f9f62ffd640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9f500664a0 0x7f9f50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:33.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.575+0000 7f9f72234640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9f500664a0 0x7f9f50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:33.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.579+0000 7f9f72234640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9f500664a0 0x7f9f50068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009ac0 tx=0x7f9f68009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:33.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.579+0000 7f9f62ffd640 1 -- 172.21.15.53:0/3868389213 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9f64055860 con 0x7f9f6c1538b0 2023-12-08T20:54:33.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.599+0000 7f9f62ffd640 1 -- 172.21.15.53:0/3868389213 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f64051ba0 con 0x7f9f6c1538b0 2023-12-08T20:54:33.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:33.767+0000 7f9f74498640 1 -- 172.21.15.53:0/3868389213 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f6c157020 con 0x7f9f6c1538b0 2023-12-08T20:54:37.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.166+0000 7f9f62ffd640 1 -- 172.21.15.53:0/3868389213 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f6400ae60 con 0x7f9f6c1538b0 2023-12-08T20:54:37.167 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-12-08T20:54:37.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.170+0000 7f9f74498640 1 -- 172.21.15.53:0/3868389213 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9f500664a0 msgr2=0x7f9f50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.170+0000 7f9f74498640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9f500664a0 0x7f9f50068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009ac0 tx=0x7f9f68009190 comp rx=0 tx=0).stop 2023-12-08T20:54:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.170+0000 7f9f74498640 1 -- 172.21.15.53:0/3868389213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c1538b0 msgr2=0x7f9f6c1f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.170+0000 7f9f74498640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c1538b0 0x7f9f6c1f6950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400c7a0 tx=0x7f9f6400cc60 comp rx=0 tx=0).stop 2023-12-08T20:54:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.170+0000 7f9f74498640 1 -- 172.21.15.53:0/3868389213 shutdown_connections 2023-12-08T20:54:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.170+0000 7f9f74498640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9f500664a0 0x7f9f50068960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.170+0000 7f9f74498640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f6c1538b0 0x7f9f6c1f6950 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.170+0000 7f9f74498640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f6c06f010 0x7f9f6c1f6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.170+0000 7f9f74498640 1 --2- 172.21.15.53:0/3868389213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f6c06afc0 0x7f9f6c1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.170+0000 7f9f74498640 1 -- 172.21.15.53:0/3868389213 >> 172.21.15.53:0/3868389213 conn(0x7f9f6c0cbfe0 msgr2=0x7f9f6c06deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.170+0000 7f9f74498640 1 -- 172.21.15.53:0/3868389213 shutdown_connections 2023-12-08T20:54:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.170+0000 7f9f74498640 1 -- 172.21.15.53:0/3868389213 wait complete. 2023-12-08T20:54:37.191 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T20:54:37.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.298+0000 7f791e04b640 1 Processor -- start 2023-12-08T20:54:37.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.298+0000 7f791e04b640 1 -- start start 2023-12-08T20:54:37.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.298+0000 7f791e04b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 0x7f791806a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:37.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.298+0000 7f791e04b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791806b200 con 0x7f7918153840 2023-12-08T20:54:37.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.298+0000 7f791e04b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7918159820 con 0x7f79180c2400 2023-12-08T20:54:37.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.298+0000 7f791e04b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791815a680 con 0x7f791806e250 2023-12-08T20:54:37.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.298+0000 7f79177fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7918153840 0x7f791806db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40682/0 (socket says 172.21.15.53:40682) 2023-12-08T20:54:37.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.298+0000 7f79177fe640 1 -- 172.21.15.53:0/3608079937 learned_addr learned my addr 172.21.15.53:0/3608079937 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:54:37.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.298+0000 7f790ffff640 1 --2- 172.21.15.53:0/3608079937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 0x7f791806a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:37.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.302+0000 7f7916ffd640 1 -- 172.21.15.53:0/3608079937 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418791811 0 0) 0x7f791806b200 con 0x7f7918153840 2023-12-08T20:54:37.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.302+0000 7f790ffff640 1 -- 172.21.15.53:0/3608079937 >> v1:172.21.15.146:6789/0 conn(0x7f79180c2400 legacy=0x7f791806aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:37.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.302+0000 7f790ffff640 1 -- 172.21.15.53:0/3608079937 >> v1:172.21.15.53:6789/0 conn(0x7f7918153840 legacy=0x7f791806db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:37.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.302+0000 7f790ffff640 1 -- 172.21.15.53:0/3608079937 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918159b00 con 0x7f791806e250 2023-12-08T20:54:37.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.306+0000 7f790ffff640 1 --2- 172.21.15.53:0/3608079937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 0x7f791806a5b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f79000097f0 tx=0x7f790001ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b619c463d3158bf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:37.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f7916ffd640 1 -- 172.21.15.53:0/3608079937 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000a89b0 con 0x7f791806e250 2023-12-08T20:54:37.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f7916ffd640 1 -- 172.21.15.53:0/3608079937 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79000a8b10 con 0x7f791806e250 2023-12-08T20:54:37.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f7916ffd640 1 -- 172.21.15.53:0/3608079937 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000a8ea0 con 0x7f791806e250 2023-12-08T20:54:37.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 -- 172.21.15.53:0/3608079937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 msgr2=0x7f791806a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:37.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 --2- 172.21.15.53:0/3608079937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 0x7f791806a5b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f79000097f0 tx=0x7f790001ecb0 comp rx=0 tx=0).stop 2023-12-08T20:54:37.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 -- 172.21.15.53:0/3608079937 shutdown_connections 2023-12-08T20:54:37.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 --2- 172.21.15.53:0/3608079937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 0x7f791806a5b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:37.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 -- 172.21.15.53:0/3608079937 >> 172.21.15.53:0/3608079937 conn(0x7f79180cbfe0 msgr2=0x7f79180cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:37.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 -- 172.21.15.53:0/3608079937 shutdown_connections 2023-12-08T20:54:37.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 -- 172.21.15.53:0/3608079937 wait complete. 2023-12-08T20:54:37.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 Processor -- start 2023-12-08T20:54:37.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 -- start start 2023-12-08T20:54:37.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 0x7f79181e1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:37.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79180c2400 0x7f791814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:37.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7918153840 0x7f79181e0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:37.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79181e0640 con 0x7f7918153840 2023-12-08T20:54:37.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791814bcd0 con 0x7f79180c2400 2023-12-08T20:54:37.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f791e04b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79181df8a0 con 0x7f791806e250 2023-12-08T20:54:37.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f79177fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 0x7f79181e1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:37.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.314+0000 7f7917fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7918153840 0x7f79181e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:37.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.318+0000 7f790ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79180c2400 0x7f791814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:37.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.318+0000 7f79177fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 0x7f79181e1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:45906/0 (socket says 172.21.15.53:45906) 2023-12-08T20:54:37.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.318+0000 7f79177fe640 1 -- 172.21.15.53:0/504779617 learned_addr learned my addr 172.21.15.53:0/504779617 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:37.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.322+0000 7f79177fe640 1 -- 172.21.15.53:0/504779617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79180c2400 msgr2=0x7f791814ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:37.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.322+0000 7f79177fe640 1 --2- 172.21.15.53:0/504779617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79180c2400 0x7f791814ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:37.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.322+0000 7f79177fe640 1 -- 172.21.15.53:0/504779617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7918153840 msgr2=0x7f79181e0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:37.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.322+0000 7f79177fe640 1 --2- 172.21.15.53:0/504779617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7918153840 0x7f79181e0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:37.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.322+0000 7f79177fe640 1 -- 172.21.15.53:0/504779617 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900009420 con 0x7f791806e250 2023-12-08T20:54:37.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.326+0000 7f79177fe640 1 --2- 172.21.15.53:0/504779617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 0x7f79181e1320 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f790800c4e0 tx=0x7f790800c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:37.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.330+0000 7f7914ff9640 1 -- 172.21.15.53:0/504779617 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080074e0 con 0x7f791806e250 2023-12-08T20:54:37.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.330+0000 7f7914ff9640 1 -- 172.21.15.53:0/504779617 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908007660 con 0x7f791806e250 2023-12-08T20:54:37.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.330+0000 7f791e04b640 1 -- 172.21.15.53:0/504779617 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79181dfb80 con 0x7f791806e250 2023-12-08T20:54:37.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.330+0000 7f7914ff9640 1 -- 172.21.15.53:0/504779617 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908004a30 con 0x7f791806e250 2023-12-08T20:54:37.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.330+0000 7f791e04b640 1 -- 172.21.15.53:0/504779617 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791814c220 con 0x7f791806e250 2023-12-08T20:54:37.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.334+0000 7f791e04b640 1 -- 172.21.15.53:0/504779617 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7918074190 con 0x7f791806e250 2023-12-08T20:54:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.366+0000 7f7914ff9640 1 -- 172.21.15.53:0/504779617 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f790801c3b0 con 0x7f791806e250 2023-12-08T20:54:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.366+0000 7f7914ff9640 1 --2- 172.21.15.53:0/504779617 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f78f80664c0 0x7f78f8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.366+0000 7f790ffff640 1 --2- 172.21.15.53:0/504779617 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f78f80664c0 0x7f78f8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:37.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.370+0000 7f790ffff640 1 --2- 172.21.15.53:0/504779617 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f78f80664c0 0x7f78f8068980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79000b2000 tx=0x7f79000aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:37.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.370+0000 7f7914ff9640 1 -- 172.21.15.53:0/504779617 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7908054a00 con 0x7f791806e250 2023-12-08T20:54:37.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:37.786+0000 7f7914ff9640 1 -- 172.21.15.53:0/504779617 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7908050d40 con 0x7f791806e250 2023-12-08T20:54:38.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:38.178+0000 7f791e04b640 1 -- 172.21.15.53:0/504779617 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7918152ee0 con 0x7f791806e250 2023-12-08T20:54:40.267 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-12-08T20:54:40.314 INFO:tasks.ceph.mds.f.smithi146.stdout:starting mds.f at 2023-12-08T20:54:42.130 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-12-08T20:54:42.133 INFO:tasks.ceph.mds.e.smithi053.stdout:starting mds.e at 2023-12-08T20:54:42.137 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-12-08T20:54:42.143 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-12-08T20:54:43.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f7914ff9640 1 -- 172.21.15.53:0/504779617 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f7908018030 con 0x7f791806e250 2023-12-08T20:54:43.254 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:54:43.254 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-08T20:54:43.254 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 1 2023-12-08T20:54:43.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f791e04b640 1 -- 172.21.15.53:0/504779617 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f78f80664c0 msgr2=0x7f78f8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:43.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f791e04b640 1 --2- 172.21.15.53:0/504779617 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f78f80664c0 0x7f78f8068980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79000b2000 tx=0x7f79000aa070 comp rx=0 tx=0).stop 2023-12-08T20:54:43.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f791e04b640 1 -- 172.21.15.53:0/504779617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 msgr2=0x7f79181e1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f791e04b640 1 --2- 172.21.15.53:0/504779617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 0x7f79181e1320 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f790800c4e0 tx=0x7f790800c9a0 comp rx=0 tx=0).stop 2023-12-08T20:54:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f791e04b640 1 -- 172.21.15.53:0/504779617 shutdown_connections 2023-12-08T20:54:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f791e04b640 1 --2- 172.21.15.53:0/504779617 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f78f80664c0 0x7f78f8068980 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f791e04b640 1 --2- 172.21.15.53:0/504779617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7918153840 0x7f79181e0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f791e04b640 1 --2- 172.21.15.53:0/504779617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79180c2400 0x7f791814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f791e04b640 1 --2- 172.21.15.53:0/504779617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f791806e250 0x7f79181e1320 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f791e04b640 1 -- 172.21.15.53:0/504779617 >> 172.21.15.53:0/504779617 conn(0x7f79180cbfe0 msgr2=0x7f791814daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f791e04b640 1 -- 172.21.15.53:0/504779617 shutdown_connections 2023-12-08T20:54:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:43.254+0000 7f791e04b640 1 -- 172.21.15.53:0/504779617 wait complete. 2023-12-08T20:54:45.278 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T20:54:45.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.418+0000 7f8c63539640 1 Processor -- start 2023-12-08T20:54:45.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.418+0000 7f8c63539640 1 -- start start 2023-12-08T20:54:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.418+0000 7f8c63539640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c5c153a80 0x7f8c5c0c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.418+0000 7f8c63539640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c5c06b1d0 0x7f8c5c06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.418+0000 7f8c63539640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5c15a620 con 0x7f8c5c06ec90 2023-12-08T20:54:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.418+0000 7f8c63539640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5c159730 con 0x7f8c5c153a80 2023-12-08T20:54:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.418+0000 7f8c63539640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c159a10 con 0x7f8c5c06b1d0 2023-12-08T20:54:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.418+0000 7f8c612d5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c5c153a80 0x7f8c5c0c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:45.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.418+0000 7f8c612d5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c5c153a80 0x7f8c5c0c2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36568/0 (socket says 172.21.15.53:36568) 2023-12-08T20:54:45.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.418+0000 7f8c612d5640 1 -- 172.21.15.53:0/1343532675 learned_addr learned my addr 172.21.15.53:0/1343532675 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:45.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.418+0000 7f8c60ad4640 1 --2- 172.21.15.53:0/1343532675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c5c06b1d0 0x7f8c5c06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:45.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.422+0000 7f8c612d5640 1 -- 172.21.15.53:0/1343532675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c5c06b1d0 msgr2=0x7f8c5c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:45.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.422+0000 7f8c612d5640 1 --2- 172.21.15.53:0/1343532675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c5c06b1d0 0x7f8c5c06a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:45.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.422+0000 7f8c612d5640 1 -- 172.21.15.53:0/1343532675 >> v1:172.21.15.146:6789/0 conn(0x7f8c5c06ec90 legacy=0x7f8c5c06f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:45.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.422+0000 7f8c612d5640 1 -- 172.21.15.53:0/1343532675 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c159cf0 con 0x7f8c5c153a80 2023-12-08T20:54:45.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.426+0000 7f8c612d5640 1 --2- 172.21.15.53:0/1343532675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c5c153a80 0x7f8c5c0c2ca0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009e50 tx=0x7f8c5801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895d9cd81c5436e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:45.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.430+0000 7f8c53fff640 1 -- 172.21.15.53:0/1343532675 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c580a58a0 con 0x7f8c5c153a80 2023-12-08T20:54:45.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.430+0000 7f8c53fff640 1 -- 172.21.15.53:0/1343532675 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c580a5a00 con 0x7f8c5c153a80 2023-12-08T20:54:45.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.430+0000 7f8c53fff640 1 -- 172.21.15.53:0/1343532675 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c580a5d90 con 0x7f8c5c153a80 2023-12-08T20:54:45.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.430+0000 7f8c63539640 1 -- 172.21.15.53:0/1343532675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c5c153a80 msgr2=0x7f8c5c0c2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:45.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.430+0000 7f8c63539640 1 --2- 172.21.15.53:0/1343532675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c5c153a80 0x7f8c5c0c2ca0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009e50 tx=0x7f8c5801c9e0 comp rx=0 tx=0).stop 2023-12-08T20:54:45.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.430+0000 7f8c63539640 1 -- 172.21.15.53:0/1343532675 shutdown_connections 2023-12-08T20:54:45.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.430+0000 7f8c63539640 1 --2- 172.21.15.53:0/1343532675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c5c06b1d0 0x7f8c5c06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:45.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.430+0000 7f8c63539640 1 --2- 172.21.15.53:0/1343532675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c5c153a80 0x7f8c5c0c2ca0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:45.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.430+0000 7f8c63539640 1 -- 172.21.15.53:0/1343532675 >> 172.21.15.53:0/1343532675 conn(0x7f8c5c06b6c0 msgr2=0x7f8c5c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:45.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.430+0000 7f8c63539640 1 -- 172.21.15.53:0/1343532675 shutdown_connections 2023-12-08T20:54:45.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.430+0000 7f8c63539640 1 -- 172.21.15.53:0/1343532675 wait complete. 2023-12-08T20:54:45.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c63539640 1 Processor -- start 2023-12-08T20:54:45.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c63539640 1 -- start start 2023-12-08T20:54:45.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c63539640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c5c06b1d0 0x7f8c5c14a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:45.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c63539640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c5c06ec90 0x7f8c5c1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:45.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c63539640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c5c153a80 0x7f8c5c143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:45.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c63539640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c15c4a0 con 0x7f8c5c06ec90 2023-12-08T20:54:45.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c63539640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c143550 con 0x7f8c5c06b1d0 2023-12-08T20:54:45.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c63539640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c15bbb0 con 0x7f8c5c153a80 2023-12-08T20:54:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c60ad4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c5c06ec90 0x7f8c5c1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c61ad6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c5c153a80 0x7f8c5c143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c60ad4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c5c06ec90 0x7f8c5c1491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36582/0 (socket says 172.21.15.53:36582) 2023-12-08T20:54:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c60ad4640 1 -- 172.21.15.53:0/990572616 learned_addr learned my addr 172.21.15.53:0/990572616 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.434+0000 7f8c612d5640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c5c06b1d0 0x7f8c5c14a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.438+0000 7f8c60ad4640 1 -- 172.21.15.53:0/990572616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c5c153a80 msgr2=0x7f8c5c143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.438+0000 7f8c60ad4640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c5c153a80 0x7f8c5c143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.438+0000 7f8c60ad4640 1 -- 172.21.15.53:0/990572616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c5c06b1d0 msgr2=0x7f8c5c14a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.438+0000 7f8c60ad4640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c5c06b1d0 0x7f8c5c14a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.438+0000 7f8c60ad4640 1 -- 172.21.15.53:0/990572616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c58009b30 con 0x7f8c5c06ec90 2023-12-08T20:54:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.442+0000 7f8c60ad4640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c5c06ec90 0x7f8c5c1491e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00e840 tx=0x7f8c4c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.446+0000 7f8c51ffb640 1 -- 172.21.15.53:0/990572616 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c009510 con 0x7f8c5c06ec90 2023-12-08T20:54:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.446+0000 7f8c51ffb640 1 -- 172.21.15.53:0/990572616 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c00ee90 con 0x7f8c5c06ec90 2023-12-08T20:54:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.446+0000 7f8c63539640 1 -- 172.21.15.53:0/990572616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5c143270 con 0x7f8c5c06ec90 2023-12-08T20:54:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.446+0000 7f8c51ffb640 1 -- 172.21.15.53:0/990572616 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c00cb60 con 0x7f8c5c06ec90 2023-12-08T20:54:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.446+0000 7f8c63539640 1 -- 172.21.15.53:0/990572616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5c15c130 con 0x7f8c5c06ec90 2023-12-08T20:54:45.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.446+0000 7f8c63539640 1 -- 172.21.15.53:0/990572616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5c15c610 con 0x7f8c5c06ec90 2023-12-08T20:54:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.742+0000 7f8c51ffb640 1 -- 172.21.15.53:0/990572616 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8c4c00ccc0 con 0x7f8c5c06ec90 2023-12-08T20:54:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.742+0000 7f8c51ffb640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8c400664c0 0x7f8c40068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.742+0000 7f8c612d5640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8c400664c0 0x7f8c40068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.746+0000 7f8c612d5640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8c400664c0 0x7f8c40068980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c580ae000 tx=0x7f8c580a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:45.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.778+0000 7f8c51ffb640 1 -- 172.21.15.53:0/990572616 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8c4c055820 con 0x7f8c5c06ec90 2023-12-08T20:54:45.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.778+0000 7f8c51ffb640 1 -- 172.21.15.53:0/990572616 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8c4c051b60 con 0x7f8c5c06ec90 2023-12-08T20:54:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:45.986+0000 7f8c63539640 1 -- 172.21.15.53:0/990572616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c5c074190 con 0x7f8c5c06ec90 2023-12-08T20:54:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.002+0000 7f8c51ffb640 1 -- 172.21.15.53:0/990572616 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f8c4c021090 con 0x7f8c5c06ec90 2023-12-08T20:54:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:54:46.002 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-08T20:54:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 1 2023-12-08T20:54:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.002+0000 7f8c63539640 1 -- 172.21.15.53:0/990572616 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8c400664c0 msgr2=0x7f8c40068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.002+0000 7f8c63539640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8c400664c0 0x7f8c40068980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c580ae000 tx=0x7f8c580a7070 comp rx=0 tx=0).stop 2023-12-08T20:54:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.006+0000 7f8c63539640 1 -- 172.21.15.53:0/990572616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c5c06ec90 msgr2=0x7f8c5c1491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.006+0000 7f8c63539640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c5c06ec90 0x7f8c5c1491e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00e840 tx=0x7f8c4c00ec40 comp rx=0 tx=0).stop 2023-12-08T20:54:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.006+0000 7f8c63539640 1 -- 172.21.15.53:0/990572616 shutdown_connections 2023-12-08T20:54:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.006+0000 7f8c63539640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8c400664c0 0x7f8c40068980 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.006+0000 7f8c63539640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c5c153a80 0x7f8c5c143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.006+0000 7f8c63539640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c5c06ec90 0x7f8c5c1491e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.006+0000 7f8c63539640 1 --2- 172.21.15.53:0/990572616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c5c06b1d0 0x7f8c5c14a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.006+0000 7f8c63539640 1 -- 172.21.15.53:0/990572616 >> 172.21.15.53:0/990572616 conn(0x7f8c5c06b6c0 msgr2=0x7f8c5c14d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.006+0000 7f8c63539640 1 -- 172.21.15.53:0/990572616 shutdown_connections 2023-12-08T20:54:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:46.006+0000 7f8c63539640 1 -- 172.21.15.53:0/990572616 wait complete. 2023-12-08T20:54:48.024 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T20:54:48.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.186+0000 7f22e59c3640 1 Processor -- start 2023-12-08T20:54:48.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.186+0000 7f22e59c3640 1 -- start start 2023-12-08T20:54:48.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.186+0000 7f22e59c3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22e006a810 0x7f22e006b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:48.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.186+0000 7f22e59c3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f22e006abf0 0x7f22e006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:48.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.186+0000 7f22e59c3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e006f7d0 con 0x7f22e006dc10 2023-12-08T20:54:48.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.186+0000 7f22e59c3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e0070350 con 0x7f22e006a810 2023-12-08T20:54:48.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.186+0000 7f22e59c3640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e01583d0 con 0x7f22e006abf0 2023-12-08T20:54:48.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.190+0000 7f22de7fc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f22e006abf0 0x7f22e006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:48.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.190+0000 7f22de7fc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f22e006abf0 0x7f22e006ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:37248/0 (socket says 172.21.15.53:37248) 2023-12-08T20:54:48.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.190+0000 7f22de7fc640 1 -- 172.21.15.53:0/2463030038 learned_addr learned my addr 172.21.15.53:0/2463030038 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:48.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.194+0000 7f22de7fc640 1 -- 172.21.15.53:0/2463030038 >> v2:172.21.15.53:3300/0 conn(0x7f22e006a810 msgr2=0x7f22e006b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:48.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.194+0000 7f22de7fc640 1 --2- 172.21.15.53:0/2463030038 >> v2:172.21.15.53:3300/0 conn(0x7f22e006a810 0x7f22e006b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:48.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.194+0000 7f22de7fc640 1 -- 172.21.15.53:0/2463030038 >> v1:172.21.15.53:6789/0 conn(0x7f22e006dc10 legacy=0x7f22e01512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:48.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.194+0000 7f22de7fc640 1 -- 172.21.15.53:0/2463030038 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e006fa20 con 0x7f22e006abf0 2023-12-08T20:54:48.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.198+0000 7f22de7fc640 1 --2- 172.21.15.53:0/2463030038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e006abf0 0x7f22e006ef60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f22e0068c30 tx=0x7f22d401ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=736cf0b21cac33b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:48.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.210+0000 7f22ddffb640 1 -- 172.21.15.53:0/2463030038 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a89b0 con 0x7f22e006abf0 2023-12-08T20:54:48.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.210+0000 7f22ddffb640 1 -- 172.21.15.53:0/2463030038 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40a8b10 con 0x7f22e006abf0 2023-12-08T20:54:48.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.210+0000 7f22ddffb640 1 -- 172.21.15.53:0/2463030038 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a8ea0 con 0x7f22e006abf0 2023-12-08T20:54:48.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.210+0000 7f22e59c3640 1 -- 172.21.15.53:0/2463030038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e006abf0 msgr2=0x7f22e006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:48.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.210+0000 7f22e59c3640 1 --2- 172.21.15.53:0/2463030038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e006abf0 0x7f22e006ef60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f22e0068c30 tx=0x7f22d401ecb0 comp rx=0 tx=0).stop 2023-12-08T20:54:48.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.210+0000 7f22e59c3640 1 -- 172.21.15.53:0/2463030038 shutdown_connections 2023-12-08T20:54:48.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.210+0000 7f22e59c3640 1 --2- 172.21.15.53:0/2463030038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e006abf0 0x7f22e006ef60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:48.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.210+0000 7f22e59c3640 1 --2- 172.21.15.53:0/2463030038 >> v2:172.21.15.53:3300/0 conn(0x7f22e006a810 0x7f22e006b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:48.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.210+0000 7f22e59c3640 1 -- 172.21.15.53:0/2463030038 >> 172.21.15.53:0/2463030038 conn(0x7f22e00c8a00 msgr2=0x7f22e00c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:48.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.210+0000 7f22e59c3640 1 -- 172.21.15.53:0/2463030038 shutdown_connections 2023-12-08T20:54:48.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.210+0000 7f22e59c3640 1 -- 172.21.15.53:0/2463030038 wait complete. 2023-12-08T20:54:48.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.214+0000 7f22e59c3640 1 Processor -- start 2023-12-08T20:54:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.214+0000 7f22e59c3640 1 -- start start 2023-12-08T20:54:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.214+0000 7f22e59c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22e006a810 0x7f22e01e3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.214+0000 7f22e59c3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e006abf0 0x7f22e00ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.214+0000 7f22e59c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e006dc10 0x7f22e01f0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.214+0000 7f22e59c3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e01e0940 con 0x7f22e006a810 2023-12-08T20:54:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.214+0000 7f22e59c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e01e4240 con 0x7f22e006dc10 2023-12-08T20:54:48.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.214+0000 7f22e59c3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e01e44b0 con 0x7f22e006abf0 2023-12-08T20:54:48.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.250+0000 7f22de7fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e006abf0 0x7f22e00ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:48.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.250+0000 7f22de7fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e006abf0 0x7f22e00ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:38302/0 (socket says 172.21.15.53:38302) 2023-12-08T20:54:48.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.250+0000 7f22de7fc640 1 -- 172.21.15.53:0/369837420 learned_addr learned my addr 172.21.15.53:0/369837420 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:48.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.254+0000 7f22df7fe640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e006dc10 0x7f22e01f0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:48.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.258+0000 7f22de7fc640 1 -- 172.21.15.53:0/369837420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e006dc10 msgr2=0x7f22e01f0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:48.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.258+0000 7f22de7fc640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e006dc10 0x7f22e01f0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:48.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.258+0000 7f22de7fc640 1 -- 172.21.15.53:0/369837420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22e006a810 msgr2=0x7f22e01e3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:48.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.258+0000 7f22de7fc640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22e006a810 0x7f22e01e3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.258+0000 7f22de7fc640 1 -- 172.21.15.53:0/369837420 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d4009480 con 0x7f22e006abf0 2023-12-08T20:54:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.262+0000 7f22de7fc640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e006abf0 0x7f22e00ca8b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f22d401b8c0 tx=0x7f22d401ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:48.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.378+0000 7f22c7fff640 1 -- 172.21.15.53:0/369837420 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4004220 con 0x7f22e006abf0 2023-12-08T20:54:48.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.378+0000 7f22c7fff640 1 -- 172.21.15.53:0/369837420 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d4004380 con 0x7f22e006abf0 2023-12-08T20:54:48.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.378+0000 7f22c7fff640 1 -- 172.21.15.53:0/369837420 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4006490 con 0x7f22e006abf0 2023-12-08T20:54:48.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.378+0000 7f22e59c3640 1 -- 172.21.15.53:0/369837420 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e01ed180 con 0x7f22e006abf0 2023-12-08T20:54:48.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.378+0000 7f22e59c3640 1 -- 172.21.15.53:0/369837420 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e01ed700 con 0x7f22e006abf0 2023-12-08T20:54:48.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.378+0000 7f22e59c3640 1 -- 172.21.15.53:0/369837420 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e0074190 con 0x7f22e006abf0 2023-12-08T20:54:48.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.666+0000 7f22c7fff640 1 -- 172.21.15.53:0/369837420 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f22d40065f0 con 0x7f22e006abf0 2023-12-08T20:54:48.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.666+0000 7f22c7fff640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f22cc0664c0 0x7f22cc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:48.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.666+0000 7f22deffd640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f22cc0664c0 0x7f22cc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:48.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.666+0000 7f22deffd640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f22cc0664c0 0x7f22cc068980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f22d000ab90 tx=0x7f22d0009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:48.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.670+0000 7f22c7fff640 1 -- 172.21.15.53:0/369837420 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f22d40f3370 con 0x7f22e006abf0 2023-12-08T20:54:48.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.698+0000 7f22c7fff640 1 -- 172.21.15.53:0/369837420 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22d414b280 con 0x7f22e006abf0 2023-12-08T20:54:48.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:48.930+0000 7f22e59c3640 1 -- 172.21.15.53:0/369837420 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22e00c94f0 con 0x7f22e006abf0 2023-12-08T20:54:49.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.406+0000 7f22c7fff640 1 -- 172.21.15.53:0/369837420 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5283 (secure 0 0 0) 0x7f22d40eefb0 con 0x7f22e006abf0 2023-12-08T20:54:49.408 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:54:49.408 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6838/3541484412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3541484412},{"type":"v1","addr":"172.21.15.53:6838","nonce":3541484412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/2329639389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6837","nonce":2329639389},{"type":"v1","addr":"172.21.15.53:6839","nonce":2329639389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3938297948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3938297948},{"type":"v1","addr":"172.21.15.146:6833","nonce":3938297948}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2026540331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2026540331},{"type":"v1","addr":"172.21.15.146:6836","nonce":2026540331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/4236922545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4236922545},{"type":"v1","addr":"172.21.15.146:6837","nonce":4236922545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3454931938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3454931938},{"type":"v1","addr":"172.21.15.53:6835","nonce":3454931938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-08T20:54:49.408 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 3 2023-12-08T20:54:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.410+0000 7f22e59c3640 1 -- 172.21.15.53:0/369837420 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f22cc0664c0 msgr2=0x7f22cc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.410+0000 7f22e59c3640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f22cc0664c0 0x7f22cc068980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f22d000ab90 tx=0x7f22d0009250 comp rx=0 tx=0).stop 2023-12-08T20:54:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.410+0000 7f22e59c3640 1 -- 172.21.15.53:0/369837420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e006abf0 msgr2=0x7f22e00ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.410+0000 7f22e59c3640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e006abf0 0x7f22e00ca8b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f22d401b8c0 tx=0x7f22d401ba50 comp rx=0 tx=0).stop 2023-12-08T20:54:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.410+0000 7f22e59c3640 1 -- 172.21.15.53:0/369837420 shutdown_connections 2023-12-08T20:54:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.410+0000 7f22e59c3640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f22cc0664c0 0x7f22cc068980 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.410+0000 7f22e59c3640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e006dc10 0x7f22e01f0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.410+0000 7f22e59c3640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e006abf0 0x7f22e00ca8b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.410+0000 7f22e59c3640 1 --2- 172.21.15.53:0/369837420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22e006a810 0x7f22e01e3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.410+0000 7f22e59c3640 1 -- 172.21.15.53:0/369837420 >> 172.21.15.53:0/369837420 conn(0x7f22e00c8a00 msgr2=0x7f22e00c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.410+0000 7f22e59c3640 1 -- 172.21.15.53:0/369837420 shutdown_connections 2023-12-08T20:54:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.410+0000 7f22e59c3640 1 -- 172.21.15.53:0/369837420 wait complete. 2023-12-08T20:54:49.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:54:49.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.574+0000 7f8a350f1640 1 Processor -- start 2023-12-08T20:54:49.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.574+0000 7f8a350f1640 1 -- start start 2023-12-08T20:54:49.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.578+0000 7f8a350f1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a3006e320 0x7f8a3006b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:49.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.578+0000 7f8a350f1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8a3006abf0 0x7f8a3006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:49.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.578+0000 7f8a350f1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3006f7d0 con 0x7f8a3006a810 2023-12-08T20:54:49.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.578+0000 7f8a350f1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a30070350 con 0x7f8a3006abf0 2023-12-08T20:54:49.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.578+0000 7f8a350f1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a301583d0 con 0x7f8a3006e320 2023-12-08T20:54:49.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.586+0000 7f8a2e59c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a3006e320 0x7f8a3006b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:49.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.586+0000 7f8a2ed9d640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8a3006a810 0x7f8a3006dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.53:49188/0 (socket says 172.21.15.53:49188) 2023-12-08T20:54:49.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.586+0000 7f8a2ed9d640 1 -- 172.21.15.53:0/137928018 learned_addr learned my addr 172.21.15.53:0/137928018 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:54:49.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.590+0000 7f8a2e59c640 1 -- 172.21.15.53:0/137928018 >> v2:172.21.15.53:3300/0 conn(0x7f8a3006abf0 msgr2=0x7f8a3006ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:49.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.590+0000 7f8a2e59c640 1 --2- 172.21.15.53:0/137928018 >> v2:172.21.15.53:3300/0 conn(0x7f8a3006abf0 0x7f8a3006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:49.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.590+0000 7f8a2e59c640 1 -- 172.21.15.53:0/137928018 >> v1:172.21.15.146:6789/0 conn(0x7f8a3006a810 legacy=0x7f8a3006dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:49.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.590+0000 7f8a2e59c640 1 -- 172.21.15.53:0/137928018 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3006fa20 con 0x7f8a3006e320 2023-12-08T20:54:49.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.598+0000 7f8a2e59c640 1 --2- 172.21.15.53:0/137928018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a3006e320 0x7f8a3006b0f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8a30068c30 tx=0x7f8a2401ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd2cb8b791776305 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:49.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.606+0000 7f8a2dd9b640 1 -- 172.21.15.53:0/137928018 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240a8930 con 0x7f8a3006e320 2023-12-08T20:54:49.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.606+0000 7f8a2dd9b640 1 -- 172.21.15.53:0/137928018 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a240a8a90 con 0x7f8a3006e320 2023-12-08T20:54:49.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.606+0000 7f8a2dd9b640 1 -- 172.21.15.53:0/137928018 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240a8e20 con 0x7f8a3006e320 2023-12-08T20:54:49.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.606+0000 7f8a350f1640 1 -- 172.21.15.53:0/137928018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a3006e320 msgr2=0x7f8a3006b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:49.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.606+0000 7f8a350f1640 1 --2- 172.21.15.53:0/137928018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a3006e320 0x7f8a3006b0f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8a30068c30 tx=0x7f8a2401ec30 comp rx=0 tx=0).stop 2023-12-08T20:54:49.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.606+0000 7f8a350f1640 1 -- 172.21.15.53:0/137928018 shutdown_connections 2023-12-08T20:54:49.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.606+0000 7f8a350f1640 1 --2- 172.21.15.53:0/137928018 >> v2:172.21.15.53:3300/0 conn(0x7f8a3006abf0 0x7f8a3006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:49.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.606+0000 7f8a350f1640 1 --2- 172.21.15.53:0/137928018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a3006e320 0x7f8a3006b0f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:49.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.606+0000 7f8a350f1640 1 -- 172.21.15.53:0/137928018 >> 172.21.15.53:0/137928018 conn(0x7f8a300c8a00 msgr2=0x7f8a300c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:49.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.606+0000 7f8a350f1640 1 -- 172.21.15.53:0/137928018 shutdown_connections 2023-12-08T20:54:49.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.606+0000 7f8a350f1640 1 -- 172.21.15.53:0/137928018 wait complete. 2023-12-08T20:54:49.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.606+0000 7f8a350f1640 1 Processor -- start 2023-12-08T20:54:49.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.610+0000 7f8a350f1640 1 -- start start 2023-12-08T20:54:49.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.610+0000 7f8a350f1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a3006a810 0x7f8a3014db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:49.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.610+0000 7f8a350f1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a3006abf0 0x7f8a301ef140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:49.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.610+0000 7f8a350f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a301e1a80 0x7f8a301f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:49.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.610+0000 7f8a350f1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a30157cf0 con 0x7f8a301e1a80 2023-12-08T20:54:49.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.610+0000 7f8a350f1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a301eecb0 con 0x7f8a3006abf0 2023-12-08T20:54:49.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.610+0000 7f8a350f1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3014e0a0 con 0x7f8a3006a810 2023-12-08T20:54:49.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.610+0000 7f8a2f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a301e1a80 0x7f8a301f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:49.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.610+0000 7f8a2f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a301e1a80 0x7f8a301f22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36624/0 (socket says 172.21.15.53:36624) 2023-12-08T20:54:49.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.610+0000 7f8a2f59e640 1 -- 172.21.15.53:0/3559976326 learned_addr learned my addr 172.21.15.53:0/3559976326 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:49.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.610+0000 7f8a2e59c640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a3006abf0 0x7f8a301ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:49.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.614+0000 7f8a2f59e640 1 -- 172.21.15.53:0/3559976326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a3006a810 msgr2=0x7f8a3014db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:49.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.614+0000 7f8a2f59e640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a3006a810 0x7f8a3014db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:49.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.614+0000 7f8a2f59e640 1 -- 172.21.15.53:0/3559976326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a3006abf0 msgr2=0x7f8a301ef140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:49.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.614+0000 7f8a2f59e640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a3006abf0 0x7f8a301ef140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:49.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.614+0000 7f8a2f59e640 1 -- 172.21.15.53:0/3559976326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a240093b0 con 0x7f8a301e1a80 2023-12-08T20:54:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.618+0000 7f8a2f59e640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a301e1a80 0x7f8a301f22c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800b970 tx=0x7f8a2800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:49.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.622+0000 7f8a177fe640 1 -- 172.21.15.53:0/3559976326 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2800cb40 con 0x7f8a301e1a80 2023-12-08T20:54:49.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.622+0000 7f8a177fe640 1 -- 172.21.15.53:0/3559976326 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2800ccc0 con 0x7f8a301e1a80 2023-12-08T20:54:49.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.622+0000 7f8a350f1640 1 -- 172.21.15.53:0/3559976326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a300c5970 con 0x7f8a301e1a80 2023-12-08T20:54:49.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.622+0000 7f8a177fe640 1 -- 172.21.15.53:0/3559976326 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a28014680 con 0x7f8a301e1a80 2023-12-08T20:54:49.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.622+0000 7f8a350f1640 1 -- 172.21.15.53:0/3559976326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a300c5f30 con 0x7f8a301e1a80 2023-12-08T20:54:49.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.622+0000 7f8a350f1640 1 -- 172.21.15.53:0/3559976326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a30074190 con 0x7f8a301e1a80 2023-12-08T20:54:49.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.958+0000 7f8a177fe640 1 -- 172.21.15.53:0/3559976326 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8a28007370 con 0x7f8a301e1a80 2023-12-08T20:54:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.958+0000 7f8a177fe640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8a1c0664c0 0x7f8a1c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.958+0000 7f8a2ed9d640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8a1c0664c0 0x7f8a1c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:49.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.958+0000 7f8a2ed9d640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8a1c0664c0 0x7f8a1c068980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8a20001600 tx=0x7f8a20007a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:49.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.986+0000 7f8a177fe640 1 -- 172.21.15.53:0/3559976326 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8a2800ce30 con 0x7f8a301e1a80 2023-12-08T20:54:49.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:49.986+0000 7f8a177fe640 1 -- 172.21.15.53:0/3559976326 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a280516d0 con 0x7f8a301e1a80 2023-12-08T20:54:50.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.166+0000 7f8a350f1640 1 -- 172.21.15.53:0/3559976326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a301eee20 con 0x7f8a301e1a80 2023-12-08T20:54:50.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.342+0000 7f8a177fe640 1 -- 172.21.15.53:0/3559976326 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f8a28019070 con 0x7f8a301e1a80 2023-12-08T20:54:50.344 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:54:50.344 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":18,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:54:16.826803+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:54:50.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.346+0000 7f8a350f1640 1 -- 172.21.15.53:0/3559976326 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8a1c0664c0 msgr2=0x7f8a1c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:50.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.346+0000 7f8a350f1640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8a1c0664c0 0x7f8a1c068980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8a20001600 tx=0x7f8a20007a50 comp rx=0 tx=0).stop 2023-12-08T20:54:50.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.346+0000 7f8a350f1640 1 -- 172.21.15.53:0/3559976326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a301e1a80 msgr2=0x7f8a301f22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:50.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.346+0000 7f8a350f1640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a301e1a80 0x7f8a301f22c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800b970 tx=0x7f8a2800be30 comp rx=0 tx=0).stop 2023-12-08T20:54:50.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.346+0000 7f8a350f1640 1 -- 172.21.15.53:0/3559976326 shutdown_connections 2023-12-08T20:54:50.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.346+0000 7f8a350f1640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8a1c0664c0 0x7f8a1c068980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:50.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.346+0000 7f8a350f1640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a301e1a80 0x7f8a301f22c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:50.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.346+0000 7f8a350f1640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a3006abf0 0x7f8a301ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:50.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.346+0000 7f8a350f1640 1 --2- 172.21.15.53:0/3559976326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a3006a810 0x7f8a3014db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:50.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.346+0000 7f8a350f1640 1 -- 172.21.15.53:0/3559976326 >> 172.21.15.53:0/3559976326 conn(0x7f8a300c8a00 msgr2=0x7f8a3014b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:50.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.346+0000 7f8a350f1640 1 -- 172.21.15.53:0/3559976326 shutdown_connections 2023-12-08T20:54:50.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.346+0000 7f8a350f1640 1 -- 172.21.15.53:0/3559976326 wait complete. 2023-12-08T20:54:50.368 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T20:54:13.707275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T20:54:50.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T20:54:50.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.546+0000 7f0133801640 1 Processor -- start 2023-12-08T20:54:50.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.546+0000 7f0133801640 1 -- start start 2023-12-08T20:54:50.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.550+0000 7f0133801640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f012c0c8e60 0x7f012c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:50.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.550+0000 7f0133801640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012c0c9fd0 con 0x7f012c151770 2023-12-08T20:54:50.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.550+0000 7f0133801640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012c0cd9b0 con 0x7f012c15b400 2023-12-08T20:54:50.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.550+0000 7f0133801640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012c0b0920 con 0x7f012c0c8e60 2023-12-08T20:54:50.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.550+0000 7f0131d9e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f012c0c8e60 0x7f012c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:50.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.550+0000 7f013159d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f012c151770 0x7f012c0cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40676/0 (socket says 172.21.15.53:40676) 2023-12-08T20:54:50.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.550+0000 7f013159d640 1 -- 172.21.15.53:0/735705273 learned_addr learned my addr 172.21.15.53:0/735705273 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:54:50.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.554+0000 7f0131d9e640 1 -- 172.21.15.53:0/735705273 >> v1:172.21.15.146:6789/0 conn(0x7f012c15b400 legacy=0x7f012c15fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:50.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.554+0000 7f0131d9e640 1 -- 172.21.15.53:0/735705273 >> v1:172.21.15.53:6789/0 conn(0x7f012c151770 legacy=0x7f012c0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:50.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.554+0000 7f0131d9e640 1 -- 172.21.15.53:0/735705273 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c15b920 con 0x7f012c0c8e60 2023-12-08T20:54:50.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.562+0000 7f0131d9e640 1 --2- 172.21.15.53:0/735705273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012c0c8e60 0x7f012c0ca460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0124009d90 tx=0x7f012401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48dd9b6176932006 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.570+0000 7f0123fff640 1 -- 172.21.15.53:0/735705273 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01240a59a0 con 0x7f012c0c8e60 2023-12-08T20:54:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.570+0000 7f0123fff640 1 -- 172.21.15.53:0/735705273 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01240a5b00 con 0x7f012c0c8e60 2023-12-08T20:54:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.570+0000 7f0123fff640 1 -- 172.21.15.53:0/735705273 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01240a5e90 con 0x7f012c0c8e60 2023-12-08T20:54:50.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.570+0000 7f0133801640 1 -- 172.21.15.53:0/735705273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012c0c8e60 msgr2=0x7f012c0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:50.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.570+0000 7f0133801640 1 --2- 172.21.15.53:0/735705273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012c0c8e60 0x7f012c0ca460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0124009d90 tx=0x7f012401c8e0 comp rx=0 tx=0).stop 2023-12-08T20:54:50.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.570+0000 7f0133801640 1 -- 172.21.15.53:0/735705273 shutdown_connections 2023-12-08T20:54:50.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.570+0000 7f0133801640 1 --2- 172.21.15.53:0/735705273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012c0c8e60 0x7f012c0ca460 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:50.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.570+0000 7f0133801640 1 -- 172.21.15.53:0/735705273 >> 172.21.15.53:0/735705273 conn(0x7f012c070c20 msgr2=0x7f012c071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:50.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.570+0000 7f0133801640 1 -- 172.21.15.53:0/735705273 shutdown_connections 2023-12-08T20:54:50.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.570+0000 7f0133801640 1 -- 172.21.15.53:0/735705273 wait complete. 2023-12-08T20:54:50.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.570+0000 7f0133801640 1 Processor -- start 2023-12-08T20:54:50.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.570+0000 7f0133801640 1 -- start start 2023-12-08T20:54:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.574+0000 7f0133801640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012c0c8e60 0x7f012c06ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.574+0000 7f0133801640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f012c151770 0x7f012c14a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.574+0000 7f0133801640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f012c15b400 0x7f012c14a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.574+0000 7f0133801640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c0af600 con 0x7f012c0c8e60 2023-12-08T20:54:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.574+0000 7f0133801640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c1458a0 con 0x7f012c151770 2023-12-08T20:54:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.574+0000 7f0133801640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c0c7690 con 0x7f012c15b400 2023-12-08T20:54:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.574+0000 7f013159d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012c0c8e60 0x7f012c06ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.574+0000 7f013159d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012c0c8e60 0x7f012c06ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36648/0 (socket says 172.21.15.53:36648) 2023-12-08T20:54:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.574+0000 7f013159d640 1 -- 172.21.15.53:0/670268201 learned_addr learned my addr 172.21.15.53:0/670268201 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.574+0000 7f0130d9c640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f012c151770 0x7f012c14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.578+0000 7f013159d640 1 -- 172.21.15.53:0/670268201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f012c15b400 msgr2=0x7f012c14a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.578+0000 7f013159d640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f012c15b400 0x7f012c14a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.578+0000 7f013159d640 1 -- 172.21.15.53:0/670268201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f012c151770 msgr2=0x7f012c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.578+0000 7f013159d640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f012c151770 0x7f012c14a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.578+0000 7f013159d640 1 -- 172.21.15.53:0/670268201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0124009a70 con 0x7f012c0c8e60 2023-12-08T20:54:50.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.578+0000 7f013159d640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012c0c8e60 0x7f012c06ca60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f012800c420 tx=0x7f012800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:50.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.582+0000 7f0121ffb640 1 -- 172.21.15.53:0/670268201 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128005cf0 con 0x7f012c0c8e60 2023-12-08T20:54:50.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.582+0000 7f0121ffb640 1 -- 172.21.15.53:0/670268201 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0128005e50 con 0x7f012c0c8e60 2023-12-08T20:54:50.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.582+0000 7f0133801640 1 -- 172.21.15.53:0/670268201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012c145af0 con 0x7f012c0c8e60 2023-12-08T20:54:50.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.582+0000 7f0121ffb640 1 -- 172.21.15.53:0/670268201 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01280072f0 con 0x7f012c0c8e60 2023-12-08T20:54:50.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.582+0000 7f0133801640 1 -- 172.21.15.53:0/670268201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c1460b0 con 0x7f012c0c8e60 2023-12-08T20:54:50.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.586+0000 7f0133801640 1 -- 172.21.15.53:0/670268201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f012c074190 con 0x7f012c0c8e60 2023-12-08T20:54:50.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.606+0000 7f0121ffb640 1 -- 172.21.15.53:0/670268201 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0128007450 con 0x7f012c0c8e60 2023-12-08T20:54:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.606+0000 7f0121ffb640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f01100664c0 0x7f0110068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.606+0000 7f0130d9c640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f01100664c0 0x7f0110068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.606+0000 7f0130d9c640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f01100664c0 0x7f0110068980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f011c0098e0 tx=0x7f011c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:50.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.882+0000 7f0121ffb640 1 -- 172.21.15.53:0/670268201 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0128054a10 con 0x7f012c0c8e60 2023-12-08T20:54:50.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:50.882+0000 7f0121ffb640 1 -- 172.21.15.53:0/670268201 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0128081e60 con 0x7f012c0c8e60 2023-12-08T20:54:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.122+0000 7f0133801640 1 -- 172.21.15.53:0/670268201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f012c0c83f0 con 0x7f012c0c8e60 2023-12-08T20:54:51.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.234+0000 7f0121ffb640 1 -- 172.21.15.53:0/670268201 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01280170a0 con 0x7f012c0c8e60 2023-12-08T20:54:51.233 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-12-08T20:54:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.238+0000 7f0133801640 1 -- 172.21.15.53:0/670268201 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f01100664c0 msgr2=0x7f0110068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.238+0000 7f0133801640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f01100664c0 0x7f0110068980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f011c0098e0 tx=0x7f011c009060 comp rx=0 tx=0).stop 2023-12-08T20:54:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.238+0000 7f0133801640 1 -- 172.21.15.53:0/670268201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012c0c8e60 msgr2=0x7f012c06ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.238+0000 7f0133801640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012c0c8e60 0x7f012c06ca60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f012800c420 tx=0x7f012800c8e0 comp rx=0 tx=0).stop 2023-12-08T20:54:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.238+0000 7f0133801640 1 -- 172.21.15.53:0/670268201 shutdown_connections 2023-12-08T20:54:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.238+0000 7f0133801640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f01100664c0 0x7f0110068980 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.238+0000 7f0133801640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f012c15b400 0x7f012c14a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.238+0000 7f0133801640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f012c151770 0x7f012c14a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.238+0000 7f0133801640 1 --2- 172.21.15.53:0/670268201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012c0c8e60 0x7f012c06ca60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.238+0000 7f0133801640 1 -- 172.21.15.53:0/670268201 >> 172.21.15.53:0/670268201 conn(0x7f012c070c20 msgr2=0x7f012c146b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.238+0000 7f0133801640 1 -- 172.21.15.53:0/670268201 shutdown_connections 2023-12-08T20:54:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.238+0000 7f0133801640 1 -- 172.21.15.53:0/670268201 wait complete. 2023-12-08T20:54:51.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T20:54:51.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.390+0000 7fa3a96d9640 1 Processor -- start 2023-12-08T20:54:51.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.390+0000 7fa3a96d9640 1 -- start start 2023-12-08T20:54:51.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.390+0000 7fa3a96d9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a4153910 0x7fa3a40ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:51.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.390+0000 7fa3a96d9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa3a40ceed0 0x7fa3a40cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:51.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.390+0000 7fa3a96d9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a40cb190 con 0x7fa3a415a180 2023-12-08T20:54:51.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.390+0000 7fa3a96d9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a40ca120 con 0x7fa3a40ceed0 2023-12-08T20:54:51.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.390+0000 7fa3a96d9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40cc2d0 con 0x7fa3a4153910 2023-12-08T20:54:51.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.390+0000 7fa3a27fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa3a415a180 0x7fa3a40c3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52134/0 (socket says 172.21.15.53:52134) 2023-12-08T20:54:51.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.390+0000 7fa3a27fc640 1 -- 172.21.15.53:0/2688401828 learned_addr learned my addr 172.21.15.53:0/2688401828 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:54:51.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.390+0000 7fa3a2ffd640 1 --2- 172.21.15.53:0/2688401828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a4153910 0x7fa3a40ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:51.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.390+0000 7fa3a37fe640 1 --2- 172.21.15.53:0/2688401828 >> v2:172.21.15.146:3300/0 conn(0x7fa3a40ceed0 0x7fa3a40cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:51.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.394+0000 7fa3a1ffb640 1 -- 172.21.15.53:0/2688401828 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667046161 0 0) 0x7fa3a40cb190 con 0x7fa3a415a180 2023-12-08T20:54:51.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.394+0000 7fa3a1ffb640 1 -- 172.21.15.53:0/2688401828 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa38c003530 con 0x7fa3a415a180 2023-12-08T20:54:51.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.398+0000 7fa3a2ffd640 1 -- 172.21.15.53:0/2688401828 >> v2:172.21.15.146:3300/0 conn(0x7fa3a40ceed0 msgr2=0x7fa3a40cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:51.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.398+0000 7fa3a2ffd640 1 --2- 172.21.15.53:0/2688401828 >> v2:172.21.15.146:3300/0 conn(0x7fa3a40ceed0 0x7fa3a40cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:51.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.398+0000 7fa3a2ffd640 1 -- 172.21.15.53:0/2688401828 >> v1:172.21.15.53:6789/0 conn(0x7fa3a415a180 legacy=0x7fa3a40c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:51.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.398+0000 7fa3a2ffd640 1 -- 172.21.15.53:0/2688401828 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40c4530 con 0x7fa3a4153910 2023-12-08T20:54:51.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.398+0000 7fa3a37fe640 1 --2- 172.21.15.53:0/2688401828 >> v2:172.21.15.146:3300/0 conn(0x7fa3a40ceed0 0x7fa3a40cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:54:51.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.406+0000 7fa3a2ffd640 1 --2- 172.21.15.53:0/2688401828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a4153910 0x7fa3a40ca2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa3940097c0 tx=0x7fa39401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dbd6427630186da server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:51.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a1ffb640 1 -- 172.21.15.53:0/2688401828 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940a8970 con 0x7fa3a4153910 2023-12-08T20:54:51.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a1ffb640 1 -- 172.21.15.53:0/2688401828 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3940a8ad0 con 0x7fa3a4153910 2023-12-08T20:54:51.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a1ffb640 1 -- 172.21.15.53:0/2688401828 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940a8e60 con 0x7fa3a4153910 2023-12-08T20:54:51.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2688401828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a4153910 msgr2=0x7fa3a40ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:51.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 --2- 172.21.15.53:0/2688401828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a4153910 0x7fa3a40ca2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa3940097c0 tx=0x7fa39401ec70 comp rx=0 tx=0).stop 2023-12-08T20:54:51.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2688401828 shutdown_connections 2023-12-08T20:54:51.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 --2- 172.21.15.53:0/2688401828 >> v2:172.21.15.146:3300/0 conn(0x7fa3a40ceed0 0x7fa3a40cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:51.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 --2- 172.21.15.53:0/2688401828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a4153910 0x7fa3a40ca2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:51.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2688401828 >> 172.21.15.53:0/2688401828 conn(0x7fa3a408afc0 msgr2=0x7fa3a408b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:51.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2688401828 shutdown_connections 2023-12-08T20:54:51.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2688401828 wait complete. 2023-12-08T20:54:51.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 Processor -- start 2023-12-08T20:54:51.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 -- start start 2023-12-08T20:54:51.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a40ceed0 0x7fa3a4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:51.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a4153910 0x7fa3a40b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:51.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a415a180 0x7fa3a415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:51.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a415c0f0 con 0x7fa3a40ceed0 2023-12-08T20:54:51.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40b4e10 con 0x7fa3a4153910 2023-12-08T20:54:51.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.414+0000 7fa3a96d9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40b4440 con 0x7fa3a415a180 2023-12-08T20:54:51.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.418+0000 7fa3a2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a40ceed0 0x7fa3a4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:51.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.418+0000 7fa3a2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a40ceed0 0x7fa3a4156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53112/0 (socket says 172.21.15.53:53112) 2023-12-08T20:54:51.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.418+0000 7fa3a2ffd640 1 -- 172.21.15.53:0/2365617464 learned_addr learned my addr 172.21.15.53:0/2365617464 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:51.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.418+0000 7fa3a27fc640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a4153910 0x7fa3a40b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:51.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.418+0000 7fa3a37fe640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a415a180 0x7fa3a415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:51.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.422+0000 7fa3a2ffd640 1 -- 172.21.15.53:0/2365617464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a415a180 msgr2=0x7fa3a415cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:51.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.422+0000 7fa3a2ffd640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a415a180 0x7fa3a415cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:51.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.422+0000 7fa3a2ffd640 1 -- 172.21.15.53:0/2365617464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a4153910 msgr2=0x7fa3a40b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:51.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.422+0000 7fa3a2ffd640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a4153910 0x7fa3a40b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:51.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.422+0000 7fa3a2ffd640 1 -- 172.21.15.53:0/2365617464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c009a70 con 0x7fa3a40ceed0 2023-12-08T20:54:51.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.422+0000 7fa3a2ffd640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a40ceed0 0x7fa3a4156b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa3940097c0 tx=0x7fa39401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:51.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.426+0000 7fa38b7fe640 1 -- 172.21.15.53:0/2365617464 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940b0ce0 con 0x7fa3a40ceed0 2023-12-08T20:54:51.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.426+0000 7fa38b7fe640 1 -- 172.21.15.53:0/2365617464 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3940b0e40 con 0x7fa3a40ceed0 2023-12-08T20:54:51.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.426+0000 7fa38b7fe640 1 -- 172.21.15.53:0/2365617464 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940b9640 con 0x7fa3a40ceed0 2023-12-08T20:54:51.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.426+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2365617464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa394009420 con 0x7fa3a40ceed0 2023-12-08T20:54:51.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.426+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2365617464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a415b490 con 0x7fa3a40ceed0 2023-12-08T20:54:51.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.426+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2365617464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a41547f0 con 0x7fa3a40ceed0 2023-12-08T20:54:51.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.726+0000 7fa38b7fe640 1 -- 172.21.15.53:0/2365617464 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa3940b7040 con 0x7fa3a40ceed0 2023-12-08T20:54:51.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.726+0000 7fa38b7fe640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa3900664f0 0x7fa3900689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:51.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.726+0000 7fa3a27fc640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa3900664f0 0x7fa3900689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:51.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.730+0000 7fa3a27fc640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa3900664f0 0x7fa3900689b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa398007fd0 tx=0x7fa398009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:51.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.766+0000 7fa38b7fe640 1 -- 172.21.15.53:0/2365617464 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3940f3900 con 0x7fa3a40ceed0 2023-12-08T20:54:51.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.766+0000 7fa38b7fe640 1 -- 172.21.15.53:0/2365617464 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3940ef540 con 0x7fa3a40ceed0 2023-12-08T20:54:51.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:51.930+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2365617464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa3a40675b0 con 0x7fa3a40ceed0 2023-12-08T20:54:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.074+0000 7fa38b7fe640 1 -- 172.21.15.53:0/2365617464 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa3940b5030 con 0x7fa3a40ceed0 2023-12-08T20:54:52.077 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:54:52.077 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-12-08T20:54:52.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-12-08T20:54:52.077 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-12-08T20:54:52.077 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-12-08T20:54:52.077 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-12-08T20:54:52.077 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-12-08T20:54:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.078+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2365617464 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa3900664f0 msgr2=0x7fa3900689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.078+0000 7fa3a96d9640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa3900664f0 0x7fa3900689b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa398007fd0 tx=0x7fa398009040 comp rx=0 tx=0).stop 2023-12-08T20:54:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.078+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2365617464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a40ceed0 msgr2=0x7fa3a4156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.078+0000 7fa3a96d9640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a40ceed0 0x7fa3a4156b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa3940097c0 tx=0x7fa39401ba10 comp rx=0 tx=0).stop 2023-12-08T20:54:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.078+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2365617464 shutdown_connections 2023-12-08T20:54:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.078+0000 7fa3a96d9640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa3900664f0 0x7fa3900689b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.078+0000 7fa3a96d9640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a415a180 0x7fa3a415cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.078+0000 7fa3a96d9640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a4153910 0x7fa3a40b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.078+0000 7fa3a96d9640 1 --2- 172.21.15.53:0/2365617464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a40ceed0 0x7fa3a4156b30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.078+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2365617464 >> 172.21.15.53:0/2365617464 conn(0x7fa3a408afc0 msgr2=0x7fa3a40c4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.078+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2365617464 shutdown_connections 2023-12-08T20:54:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.078+0000 7fa3a96d9640 1 -- 172.21.15.53:0/2365617464 wait complete. 2023-12-08T20:54:52.099 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-08T20:54:52.099 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-08T20:54:52.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.226+0000 7f8eab07f640 1 Processor -- start 2023-12-08T20:54:52.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.226+0000 7f8eab07f640 1 -- start start 2023-12-08T20:54:52.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.226+0000 7f8eab07f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8ea406df30 0x7f8ea40c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:52.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.226+0000 7f8eab07f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ea4153730 0x7f8ea406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:52.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.226+0000 7f8eab07f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea415a410 con 0x7f8ea406e310 2023-12-08T20:54:52.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.226+0000 7f8eab07f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea415d7f0 con 0x7f8ea406df30 2023-12-08T20:54:52.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.226+0000 7f8eab07f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea415cb70 con 0x7f8ea4153730 2023-12-08T20:54:52.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.230+0000 7f8ea961c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ea4153730 0x7f8ea406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:52.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.230+0000 7f8ea961c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ea4153730 0x7f8ea406ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:49994/0 (socket says 172.21.15.53:49994) 2023-12-08T20:54:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.230+0000 7f8ea961c640 1 -- 172.21.15.53:0/1050668695 learned_addr learned my addr 172.21.15.53:0/1050668695 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:52.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.234+0000 7f8ea8e1b640 1 --2- 172.21.15.53:0/1050668695 >> v2:172.21.15.53:3300/0 conn(0x7f8ea406df30 0x7f8ea40c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.238+0000 7f8ea961c640 1 -- 172.21.15.53:0/1050668695 >> v2:172.21.15.53:3300/0 conn(0x7f8ea406df30 msgr2=0x7f8ea40c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.238+0000 7f8ea961c640 1 --2- 172.21.15.53:0/1050668695 >> v2:172.21.15.53:3300/0 conn(0x7f8ea406df30 0x7f8ea40c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.238+0000 7f8ea961c640 1 -- 172.21.15.53:0/1050668695 >> v1:172.21.15.146:6789/0 conn(0x7f8ea406e310 legacy=0x7f8ea4153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.238+0000 7f8ea961c640 1 -- 172.21.15.53:0/1050668695 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea415ce50 con 0x7f8ea4153730 2023-12-08T20:54:52.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.242+0000 7f8ea961c640 1 --2- 172.21.15.53:0/1050668695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4153730 0x7f8ea406ebf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40c9a90 tx=0x7f8e9c01c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=528509bbee715f96 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:52.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.342+0000 7f8ea37fe640 1 -- 172.21.15.53:0/1050668695 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0a56b0 con 0x7f8ea4153730 2023-12-08T20:54:52.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.342+0000 7f8ea37fe640 1 -- 172.21.15.53:0/1050668695 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c0a5810 con 0x7f8ea4153730 2023-12-08T20:54:52.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.342+0000 7f8ea37fe640 1 -- 172.21.15.53:0/1050668695 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0a5ba0 con 0x7f8ea4153730 2023-12-08T20:54:52.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 -- 172.21.15.53:0/1050668695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4153730 msgr2=0x7f8ea406ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:52.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 --2- 172.21.15.53:0/1050668695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4153730 0x7f8ea406ebf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40c9a90 tx=0x7f8e9c01c900 comp rx=0 tx=0).stop 2023-12-08T20:54:52.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 -- 172.21.15.53:0/1050668695 shutdown_connections 2023-12-08T20:54:52.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 --2- 172.21.15.53:0/1050668695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4153730 0x7f8ea406ebf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:52.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 --2- 172.21.15.53:0/1050668695 >> v2:172.21.15.53:3300/0 conn(0x7f8ea406df30 0x7f8ea40c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:52.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 -- 172.21.15.53:0/1050668695 >> 172.21.15.53:0/1050668695 conn(0x7f8ea40c8a00 msgr2=0x7f8ea40c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:52.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 -- 172.21.15.53:0/1050668695 shutdown_connections 2023-12-08T20:54:52.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 -- 172.21.15.53:0/1050668695 wait complete. 2023-12-08T20:54:52.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 Processor -- start 2023-12-08T20:54:52.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 -- start start 2023-12-08T20:54:52.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea406df30 0x7f8ea414bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:52.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea406e310 0x7f8ea414c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:52.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ea4153730 0x7f8ea4146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:52.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea414eed0 con 0x7f8ea4153730 2023-12-08T20:54:52.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea414ab50 con 0x7f8ea406df30 2023-12-08T20:54:52.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.346+0000 7f8eab07f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea414e340 con 0x7f8ea406e310 2023-12-08T20:54:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.350+0000 7f8ea3fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea406e310 0x7f8ea414c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.350+0000 7f8ea8e1b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea406df30 0x7f8ea414bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.350+0000 7f8ea3fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea406e310 0x7f8ea414c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:56466/0 (socket says 172.21.15.53:56466) 2023-12-08T20:54:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.350+0000 7f8ea3fff640 1 -- 172.21.15.53:0/2635468367 learned_addr learned my addr 172.21.15.53:0/2635468367 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.358+0000 7f8ea3fff640 1 -- 172.21.15.53:0/2635468367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea406df30 msgr2=0x7f8ea414bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.358+0000 7f8ea3fff640 1 --2- 172.21.15.53:0/2635468367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea406df30 0x7f8ea414bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.358+0000 7f8ea3fff640 1 -- 172.21.15.53:0/2635468367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ea4153730 msgr2=0x7f8ea4146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.358+0000 7f8ea3fff640 1 --2- 172.21.15.53:0/2635468367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ea4153730 0x7f8ea4146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.358+0000 7f8ea3fff640 1 -- 172.21.15.53:0/2635468367 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c009b30 con 0x7f8ea406e310 2023-12-08T20:54:52.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.362+0000 7f8ea3fff640 1 --2- 172.21.15.53:0/2635468367 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea406e310 0x7f8ea414c0f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c410 tx=0x7f8e9800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:52.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.378+0000 7f8ea17fa640 1 -- 172.21.15.53:0/2635468367 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98011790 con 0x7f8ea406e310 2023-12-08T20:54:52.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.378+0000 7f8ea17fa640 1 -- 172.21.15.53:0/2635468367 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e980118f0 con 0x7f8ea406e310 2023-12-08T20:54:52.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.378+0000 7f8eab07f640 1 -- 172.21.15.53:0/2635468367 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea414adf0 con 0x7f8ea406e310 2023-12-08T20:54:52.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.378+0000 7f8ea17fa640 1 -- 172.21.15.53:0/2635468367 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98011ce0 con 0x7f8ea406e310 2023-12-08T20:54:52.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.378+0000 7f8eab07f640 1 -- 172.21.15.53:0/2635468367 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea414b3b0 con 0x7f8ea406e310 2023-12-08T20:54:52.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.382+0000 7f8eab07f640 1 -- 172.21.15.53:0/2635468367 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea4074190 con 0x7f8ea406e310 2023-12-08T20:54:52.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.650+0000 7f8ea17fa640 1 -- 172.21.15.53:0/2635468367 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8e98007020 con 0x7f8ea406e310 2023-12-08T20:54:52.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.650+0000 7f8ea17fa640 1 --2- 172.21.15.53:0/2635468367 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8e900664c0 0x7f8e90068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:52.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.650+0000 7f8ea8e1b640 1 --2- 172.21.15.53:0/2635468367 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8e900664c0 0x7f8e90068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:52.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.650+0000 7f8ea8e1b640 1 --2- 172.21.15.53:0/2635468367 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8e900664c0 0x7f8e90068980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8e94007a60 tx=0x7f8e94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.658+0000 7f8ea17fa640 1 -- 172.21.15.53:0/2635468367 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8e98011e40 con 0x7f8ea406e310 2023-12-08T20:54:52.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.686+0000 7f8ea17fa640 1 -- 172.21.15.53:0/2635468367 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8e98051ce0 con 0x7f8ea406e310 2023-12-08T20:54:52.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:52.878+0000 7f8eab07f640 1 -- 172.21.15.53:0/2635468367 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8ea40c9670 con 0x7f8ea406e310 2023-12-08T20:54:53.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.810+0000 7f8ea17fa640 1 -- 172.21.15.53:0/2635468367 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8e98055300 con 0x7f8ea406e310 2023-12-08T20:54:53.810 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-12-08T20:54:53.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.814+0000 7f8eab07f640 1 -- 172.21.15.53:0/2635468367 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8e900664c0 msgr2=0x7f8e90068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:53.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.814+0000 7f8eab07f640 1 --2- 172.21.15.53:0/2635468367 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8e900664c0 0x7f8e90068980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8e94007a60 tx=0x7f8e94008040 comp rx=0 tx=0).stop 2023-12-08T20:54:53.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.814+0000 7f8eab07f640 1 -- 172.21.15.53:0/2635468367 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea406e310 msgr2=0x7f8ea414c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:53.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.814+0000 7f8eab07f640 1 --2- 172.21.15.53:0/2635468367 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea406e310 0x7f8ea414c0f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c410 tx=0x7f8e9800c8d0 comp rx=0 tx=0).stop 2023-12-08T20:54:53.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.814+0000 7f8eab07f640 1 -- 172.21.15.53:0/2635468367 shutdown_connections 2023-12-08T20:54:53.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.814+0000 7f8eab07f640 1 --2- 172.21.15.53:0/2635468367 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8e900664c0 0x7f8e90068980 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:53.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.814+0000 7f8eab07f640 1 --2- 172.21.15.53:0/2635468367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ea4153730 0x7f8ea4146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:53.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.814+0000 7f8eab07f640 1 --2- 172.21.15.53:0/2635468367 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea406e310 0x7f8ea414c0f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:53.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.814+0000 7f8eab07f640 1 --2- 172.21.15.53:0/2635468367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea406df30 0x7f8ea414bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:53.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.814+0000 7f8eab07f640 1 -- 172.21.15.53:0/2635468367 >> 172.21.15.53:0/2635468367 conn(0x7f8ea40c8a00 msgr2=0x7f8ea406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:53.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.814+0000 7f8eab07f640 1 -- 172.21.15.53:0/2635468367 shutdown_connections 2023-12-08T20:54:53.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.814+0000 7f8eab07f640 1 -- 172.21.15.53:0/2635468367 wait complete. 2023-12-08T20:54:53.841 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-08T20:54:53.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.966+0000 7f4ea3da9640 1 Processor -- start 2023-12-08T20:54:53.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.966+0000 7f4ea3da9640 1 -- start start 2023-12-08T20:54:53.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.966+0000 7f4ea3da9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e9c153960 0x7f4e9c06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.966+0000 7f4ea3da9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e9c0c2de0 0x7f4e9c06aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.966+0000 7f4ea3da9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9c159610 con 0x7f4e9c06edd0 2023-12-08T20:54:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.966+0000 7f4ea3da9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9c153d40 con 0x7f4e9c0c2de0 2023-12-08T20:54:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.966+0000 7f4ea3da9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9c1598d0 con 0x7f4e9c153960 2023-12-08T20:54:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.966+0000 7f4ea2346640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e9c0c2de0 0x7f4e9c06aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:53.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.970+0000 7f4ea1b45640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e9c153960 0x7f4e9c06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:53.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.970+0000 7f4ea2346640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e9c0c2de0 0x7f4e9c06aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53140/0 (socket says 172.21.15.53:53140) 2023-12-08T20:54:53.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.970+0000 7f4ea2346640 1 -- 172.21.15.53:0/1519824387 learned_addr learned my addr 172.21.15.53:0/1519824387 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:53.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.974+0000 7f4ea2346640 1 -- 172.21.15.53:0/1519824387 >> v2:172.21.15.146:3300/0 conn(0x7f4e9c153960 msgr2=0x7f4e9c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:53.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.974+0000 7f4ea2346640 1 --2- 172.21.15.53:0/1519824387 >> v2:172.21.15.146:3300/0 conn(0x7f4e9c153960 0x7f4e9c06a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:53.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.974+0000 7f4ea2346640 1 -- 172.21.15.53:0/1519824387 >> v1:172.21.15.53:6789/0 conn(0x7f4e9c06edd0 legacy=0x7f4e9c15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:53.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.974+0000 7f4ea2346640 1 -- 172.21.15.53:0/1519824387 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c159bb0 con 0x7f4e9c0c2de0 2023-12-08T20:54:53.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.978+0000 7f4ea2346640 1 --2- 172.21.15.53:0/1519824387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c0c2de0 0x7f4e9c06aaf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c06c7f0 tx=0x7f4e9401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a538653d9e22cf0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:53.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.986+0000 7f4ea0b43640 1 -- 172.21.15.53:0/1519824387 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940af400 con 0x7f4e9c0c2de0 2023-12-08T20:54:53.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.986+0000 7f4ea0b43640 1 -- 172.21.15.53:0/1519824387 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e940ab050 con 0x7f4e9c0c2de0 2023-12-08T20:54:53.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.986+0000 7f4ea0b43640 1 -- 172.21.15.53:0/1519824387 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940af780 con 0x7f4e9c0c2de0 2023-12-08T20:54:53.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.986+0000 7f4ea3da9640 1 -- 172.21.15.53:0/1519824387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c0c2de0 msgr2=0x7f4e9c06aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:53.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.986+0000 7f4ea3da9640 1 --2- 172.21.15.53:0/1519824387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c0c2de0 0x7f4e9c06aaf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c06c7f0 tx=0x7f4e9401f1c0 comp rx=0 tx=0).stop 2023-12-08T20:54:53.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.986+0000 7f4ea3da9640 1 -- 172.21.15.53:0/1519824387 shutdown_connections 2023-12-08T20:54:53.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.986+0000 7f4ea3da9640 1 --2- 172.21.15.53:0/1519824387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c0c2de0 0x7f4e9c06aaf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:53.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.986+0000 7f4ea3da9640 1 --2- 172.21.15.53:0/1519824387 >> v2:172.21.15.146:3300/0 conn(0x7f4e9c153960 0x7f4e9c06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:53.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.986+0000 7f4ea3da9640 1 -- 172.21.15.53:0/1519824387 >> 172.21.15.53:0/1519824387 conn(0x7f4e9c0c8a00 msgr2=0x7f4e9c0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:53.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.986+0000 7f4ea3da9640 1 -- 172.21.15.53:0/1519824387 shutdown_connections 2023-12-08T20:54:53.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.986+0000 7f4ea3da9640 1 -- 172.21.15.53:0/1519824387 wait complete. 2023-12-08T20:54:53.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea3da9640 1 Processor -- start 2023-12-08T20:54:53.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea3da9640 1 -- start start 2023-12-08T20:54:53.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea3da9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e9c06edd0 0x7f4e9c14f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:53.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea3da9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e9c0c2de0 0x7f4e9c14f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:53.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea3da9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c153960 0x7f4e9c149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:53.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea3da9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c14c530 con 0x7f4e9c153960 2023-12-08T20:54:53.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea3da9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c1ef970 con 0x7f4e9c0c2de0 2023-12-08T20:54:53.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea3da9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c1efea0 con 0x7f4e9c06edd0 2023-12-08T20:54:53.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea2346640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c153960 0x7f4e9c149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:53.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea2346640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c153960 0x7f4e9c149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53152/0 (socket says 172.21.15.53:53152) 2023-12-08T20:54:53.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea2346640 1 -- 172.21.15.53:0/2757933566 learned_addr learned my addr 172.21.15.53:0/2757933566 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:53.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea1b45640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e9c06edd0 0x7f4e9c14f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:53.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.990+0000 7f4ea1344640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e9c0c2de0 0x7f4e9c14f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:53.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.994+0000 7f4ea2346640 1 -- 172.21.15.53:0/2757933566 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e9c06edd0 msgr2=0x7f4e9c14f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:53.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.994+0000 7f4ea2346640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e9c06edd0 0x7f4e9c14f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:53.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.994+0000 7f4ea2346640 1 -- 172.21.15.53:0/2757933566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e9c0c2de0 msgr2=0x7f4e9c14f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:53.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.994+0000 7f4ea2346640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e9c0c2de0 0x7f4e9c14f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:53.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.994+0000 7f4ea2346640 1 -- 172.21.15.53:0/2757933566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e94009b30 con 0x7f4e9c153960 2023-12-08T20:54:53.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:53.998+0000 7f4ea2346640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c153960 0x7f4e9c149780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4e9401cdf0 tx=0x7f4e9401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:54.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.002+0000 7f4e927fc640 1 -- 172.21.15.53:0/2757933566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940afc90 con 0x7f4e9c153960 2023-12-08T20:54:54.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.002+0000 7f4e927fc640 1 -- 172.21.15.53:0/2757933566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e940afdf0 con 0x7f4e9c153960 2023-12-08T20:54:54.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.002+0000 7f4e927fc640 1 -- 172.21.15.53:0/2757933566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940b9650 con 0x7f4e9c153960 2023-12-08T20:54:54.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.002+0000 7f4ea3da9640 1 -- 172.21.15.53:0/2757933566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c14d7d0 con 0x7f4e9c153960 2023-12-08T20:54:54.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.002+0000 7f4ea3da9640 1 -- 172.21.15.53:0/2757933566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c14a850 con 0x7f4e9c153960 2023-12-08T20:54:54.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.002+0000 7f4ea3da9640 1 -- 172.21.15.53:0/2757933566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c14a9e0 con 0x7f4e9c153960 2023-12-08T20:54:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.022+0000 7f4e927fc640 1 -- 172.21.15.53:0/2757933566 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e940b6070 con 0x7f4e9c153960 2023-12-08T20:54:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.022+0000 7f4e927fc640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4e800664c0 0x7f4e80068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.026+0000 7f4ea1b45640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4e800664c0 0x7f4e80068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.026+0000 7f4ea1b45640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4e800664c0 0x7f4e80068980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009ac0 tx=0x7f4e98009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:54.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.310+0000 7f4e927fc640 1 -- 172.21.15.53:0/2757933566 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4e940f39d0 con 0x7f4e9c153960 2023-12-08T20:54:54.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.310+0000 7f4e927fc640 1 -- 172.21.15.53:0/2757933566 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e940efd10 con 0x7f4e9c153960 2023-12-08T20:54:54.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.478+0000 7f4ea3da9640 1 -- 172.21.15.53:0/2757933566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f4e9c074190 con 0x7f4e9c153960 2023-12-08T20:54:54.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.870+0000 7f4e927fc640 1 -- 172.21.15.53:0/2757933566 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f4e940b40d0 con 0x7f4e9c153960 2023-12-08T20:54:54.869 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-12-08T20:54:54.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.870+0000 7f4ea3da9640 1 -- 172.21.15.53:0/2757933566 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4e800664c0 msgr2=0x7f4e80068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:54.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.870+0000 7f4ea3da9640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4e800664c0 0x7f4e80068980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009ac0 tx=0x7f4e98009190 comp rx=0 tx=0).stop 2023-12-08T20:54:54.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.870+0000 7f4ea3da9640 1 -- 172.21.15.53:0/2757933566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c153960 msgr2=0x7f4e9c149780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:54.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.870+0000 7f4ea3da9640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c153960 0x7f4e9c149780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4e9401cdf0 tx=0x7f4e9401bf60 comp rx=0 tx=0).stop 2023-12-08T20:54:54.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.870+0000 7f4ea3da9640 1 -- 172.21.15.53:0/2757933566 shutdown_connections 2023-12-08T20:54:54.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.870+0000 7f4ea3da9640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4e800664c0 0x7f4e80068980 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:54.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.870+0000 7f4ea3da9640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c153960 0x7f4e9c149780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:54.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.870+0000 7f4ea3da9640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e9c0c2de0 0x7f4e9c14f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:54.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.874+0000 7f4ea3da9640 1 --2- 172.21.15.53:0/2757933566 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e9c06edd0 0x7f4e9c14f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:54.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.874+0000 7f4ea3da9640 1 -- 172.21.15.53:0/2757933566 >> 172.21.15.53:0/2757933566 conn(0x7f4e9c0c8a00 msgr2=0x7f4e9c06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:54.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.874+0000 7f4ea3da9640 1 -- 172.21.15.53:0/2757933566 shutdown_connections 2023-12-08T20:54:54.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:54.874+0000 7f4ea3da9640 1 -- 172.21.15.53:0/2757933566 wait complete. 2023-12-08T20:54:54.897 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-08T20:54:55.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.038+0000 7f49318e9640 1 Processor -- start 2023-12-08T20:54:55.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.038+0000 7f49318e9640 1 -- start start 2023-12-08T20:54:55.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.042+0000 7f49318e9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f492c06a810 0x7f492c06b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:55.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.042+0000 7f49318e9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f492c15d870 0x7f492c153520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:55.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.042+0000 7f49318e9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c15d3e0 con 0x7f492c06abf0 2023-12-08T20:54:55.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.042+0000 7f49318e9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c0c1260 con 0x7f492c15d870 2023-12-08T20:54:55.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.042+0000 7f49318e9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c0c2ba0 con 0x7f492c06a810 2023-12-08T20:54:55.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.042+0000 7f492b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f492c15d870 0x7f492c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:55.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.042+0000 7f492b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f492c15d870 0x7f492c153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53156/0 (socket says 172.21.15.53:53156) 2023-12-08T20:54:55.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.042+0000 7f492b7fe640 1 -- 172.21.15.53:0/607636473 learned_addr learned my addr 172.21.15.53:0/607636473 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:55.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.046+0000 7f492b7fe640 1 -- 172.21.15.53:0/607636473 >> v2:172.21.15.146:3300/0 conn(0x7f492c06a810 msgr2=0x7f492c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:55.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.046+0000 7f492b7fe640 1 --2- 172.21.15.53:0/607636473 >> v2:172.21.15.146:3300/0 conn(0x7f492c06a810 0x7f492c06b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:55.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.046+0000 7f492b7fe640 1 -- 172.21.15.53:0/607636473 >> v1:172.21.15.146:6789/0 conn(0x7f492c06abf0 legacy=0x7f492c06d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:55.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.046+0000 7f492b7fe640 1 -- 172.21.15.53:0/607636473 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c0c2e80 con 0x7f492c15d870 2023-12-08T20:54:55.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.046+0000 7f492b7fe640 1 --2- 172.21.15.53:0/607636473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f492c15d870 0x7f492c153520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f492c068c30 tx=0x7f492401f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688ea98cba019b9b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:55.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.050+0000 7f4929ffb640 1 -- 172.21.15.53:0/607636473 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49240af400 con 0x7f492c15d870 2023-12-08T20:54:55.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.050+0000 7f4929ffb640 1 -- 172.21.15.53:0/607636473 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49240ab050 con 0x7f492c15d870 2023-12-08T20:54:55.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.050+0000 7f4929ffb640 1 -- 172.21.15.53:0/607636473 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49240af780 con 0x7f492c15d870 2023-12-08T20:54:55.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.050+0000 7f49318e9640 1 -- 172.21.15.53:0/607636473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f492c15d870 msgr2=0x7f492c153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:55.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.050+0000 7f49318e9640 1 --2- 172.21.15.53:0/607636473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f492c15d870 0x7f492c153520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f492c068c30 tx=0x7f492401f180 comp rx=0 tx=0).stop 2023-12-08T20:54:55.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.050+0000 7f49318e9640 1 -- 172.21.15.53:0/607636473 shutdown_connections 2023-12-08T20:54:55.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.050+0000 7f49318e9640 1 --2- 172.21.15.53:0/607636473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f492c15d870 0x7f492c153520 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:55.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.050+0000 7f49318e9640 1 --2- 172.21.15.53:0/607636473 >> v2:172.21.15.146:3300/0 conn(0x7f492c06a810 0x7f492c06b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:55.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.050+0000 7f49318e9640 1 -- 172.21.15.53:0/607636473 >> 172.21.15.53:0/607636473 conn(0x7f492c0c8990 msgr2=0x7f492c0c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:55.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.054+0000 7f49318e9640 1 -- 172.21.15.53:0/607636473 shutdown_connections 2023-12-08T20:54:55.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.054+0000 7f49318e9640 1 -- 172.21.15.53:0/607636473 wait complete. 2023-12-08T20:54:55.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.054+0000 7f49318e9640 1 Processor -- start 2023-12-08T20:54:55.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.054+0000 7f49318e9640 1 -- start start 2023-12-08T20:54:55.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.054+0000 7f49318e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492c06a810 0x7f492c0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:55.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.054+0000 7f49318e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f492c06abf0 0x7f492c157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:55.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.054+0000 7f49318e9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f492c15d870 0x7f492c158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:55.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.054+0000 7f49318e9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c148460 con 0x7f492c06abf0 2023-12-08T20:54:55.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.054+0000 7f49318e9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c148690 con 0x7f492c06a810 2023-12-08T20:54:55.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.054+0000 7f49318e9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1f2fb0 con 0x7f492c15d870 2023-12-08T20:54:55.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.066+0000 7f492a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f492c06abf0 0x7f492c157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:55.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.066+0000 7f492a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f492c06abf0 0x7f492c157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53160/0 (socket says 172.21.15.53:53160) 2023-12-08T20:54:55.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.066+0000 7f492a7fc640 1 -- 172.21.15.53:0/3108284944 learned_addr learned my addr 172.21.15.53:0/3108284944 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:55.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.082+0000 7f492affd640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492c06a810 0x7f492c0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:55.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.090+0000 7f492affd640 1 -- 172.21.15.53:0/3108284944 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f492c15d870 msgr2=0x7f492c158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:55.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.090+0000 7f492affd640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f492c15d870 0x7f492c158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:55.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.090+0000 7f492affd640 1 -- 172.21.15.53:0/3108284944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f492c06abf0 msgr2=0x7f492c157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:55.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.090+0000 7f492affd640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f492c06abf0 0x7f492c157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:55.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.090+0000 7f492affd640 1 -- 172.21.15.53:0/3108284944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4924009b30 con 0x7f492c06a810 2023-12-08T20:54:55.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.094+0000 7f492affd640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492c06a810 0x7f492c0c7080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b3f0 tx=0x7f491c00b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.114+0000 7f4913fff640 1 -- 172.21.15.53:0/3108284944 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c011830 con 0x7f492c06a810 2023-12-08T20:54:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.114+0000 7f4913fff640 1 -- 172.21.15.53:0/3108284944 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c011990 con 0x7f492c06a810 2023-12-08T20:54:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.114+0000 7f4913fff640 1 -- 172.21.15.53:0/3108284944 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c011d40 con 0x7f492c06a810 2023-12-08T20:54:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.114+0000 7f49318e9640 1 -- 172.21.15.53:0/3108284944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492c0c3410 con 0x7f492c06a810 2023-12-08T20:54:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.114+0000 7f49318e9640 1 -- 172.21.15.53:0/3108284944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c1f2c80 con 0x7f492c06a810 2023-12-08T20:54:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.118+0000 7f49318e9640 1 -- 172.21.15.53:0/3108284944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c0714e0 con 0x7f492c06a810 2023-12-08T20:54:55.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.438+0000 7f4913fff640 1 -- 172.21.15.53:0/3108284944 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f491c01a400 con 0x7f492c06a810 2023-12-08T20:54:55.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.442+0000 7f4913fff640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f49180664c0 0x7f4918068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:55.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.442+0000 7f492a7fc640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f49180664c0 0x7f4918068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:55.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.442+0000 7f492a7fc640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f49180664c0 0x7f4918068980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f492c06b600 tx=0x7f4920009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:55.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.454+0000 7f4913fff640 1 -- 172.21.15.53:0/3108284944 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f491c055d70 con 0x7f492c06a810 2023-12-08T20:54:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.502+0000 7f4913fff640 1 -- 172.21.15.53:0/3108284944 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f491c0519b0 con 0x7f492c06a810 2023-12-08T20:54:55.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:55.718+0000 7f49318e9640 1 -- 172.21.15.53:0/3108284944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f492c0c3930 con 0x7f492c06a810 2023-12-08T20:54:56.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:54:56.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:54:58.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.074+0000 7f4913fff640 1 -- 172.21.15.53:0/3108284944 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f492c0c3930 con 0x7f492c06a810 2023-12-08T20:54:58.077 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 2 and data pool 3 2023-12-08T20:54:58.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.078+0000 7f49318e9640 1 -- 172.21.15.53:0/3108284944 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f49180664c0 msgr2=0x7f4918068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:58.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.078+0000 7f49318e9640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f49180664c0 0x7f4918068980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f492c06b600 tx=0x7f4920009040 comp rx=0 tx=0).stop 2023-12-08T20:54:58.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.078+0000 7f49318e9640 1 -- 172.21.15.53:0/3108284944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492c06a810 msgr2=0x7f492c0c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:58.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.078+0000 7f49318e9640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492c06a810 0x7f492c0c7080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b3f0 tx=0x7f491c00b8b0 comp rx=0 tx=0).stop 2023-12-08T20:54:58.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.078+0000 7f49318e9640 1 -- 172.21.15.53:0/3108284944 shutdown_connections 2023-12-08T20:54:58.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.078+0000 7f49318e9640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f49180664c0 0x7f4918068980 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:58.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.078+0000 7f49318e9640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f492c15d870 0x7f492c158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.078+0000 7f49318e9640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f492c06abf0 0x7f492c157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.078+0000 7f49318e9640 1 --2- 172.21.15.53:0/3108284944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492c06a810 0x7f492c0c7080 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.078+0000 7f49318e9640 1 -- 172.21.15.53:0/3108284944 >> 172.21.15.53:0/3108284944 conn(0x7f492c0c8990 msgr2=0x7f492c0cb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.078+0000 7f49318e9640 1 -- 172.21.15.53:0/3108284944 shutdown_connections 2023-12-08T20:54:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.078+0000 7f49318e9640 1 -- 172.21.15.53:0/3108284944 wait complete. 2023-12-08T20:54:58.103 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-08T20:54:58.103 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-08T20:54:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.238+0000 7f281bc7e640 1 Processor -- start 2023-12-08T20:54:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.238+0000 7f281bc7e640 1 -- start start 2023-12-08T20:54:58.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.238+0000 7f281bc7e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28141597c0 0x7f281406f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:58.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.238+0000 7f281bc7e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28140c86d0 0x7f281406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:58.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.238+0000 7f281bc7e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2814159ba0 0x7f2814153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:58.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.238+0000 7f281bc7e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281406eee0 con 0x7f2814159ba0 2023-12-08T20:54:58.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.238+0000 7f281bc7e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28140c3f50 con 0x7f28141597c0 2023-12-08T20:54:58.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.238+0000 7f281bc7e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281406e8b0 con 0x7f28140c86d0 2023-12-08T20:54:58.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.238+0000 7f281a21b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2814159ba0 0x7f2814153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:58.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.242+0000 7f281a21b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2814159ba0 0x7f2814153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53170/0 (socket says 172.21.15.53:53170) 2023-12-08T20:54:58.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.242+0000 7f281a21b640 1 -- 172.21.15.53:0/2101869735 learned_addr learned my addr 172.21.15.53:0/2101869735 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:58.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.242+0000 7f281a21b640 1 -- 172.21.15.53:0/2101869735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28140c86d0 msgr2=0x7f281406c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:58.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.242+0000 7f281a21b640 1 --2- 172.21.15.53:0/2101869735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28140c86d0 0x7f281406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:58.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.242+0000 7f281a21b640 1 -- 172.21.15.53:0/2101869735 >> v2:172.21.15.146:3300/0 conn(0x7f28141597c0 msgr2=0x7f281406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:54:58.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.242+0000 7f281a21b640 1 --2- 172.21.15.53:0/2101869735 >> v2:172.21.15.146:3300/0 conn(0x7f28141597c0 0x7f281406f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:58.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.242+0000 7f281a21b640 1 -- 172.21.15.53:0/2101869735 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281406f8b0 con 0x7f2814159ba0 2023-12-08T20:54:58.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.246+0000 7f281a21b640 1 --2- 172.21.15.53:0/2101869735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2814159ba0 0x7f2814153390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f28140ca620 tx=0x7f280001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274ed1fc323d5276 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:58.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.250+0000 7f2818a18640 1 -- 172.21.15.53:0/2101869735 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000ab600 con 0x7f2814159ba0 2023-12-08T20:54:58.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.250+0000 7f2818a18640 1 -- 172.21.15.53:0/2101869735 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28000ab760 con 0x7f2814159ba0 2023-12-08T20:54:58.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.250+0000 7f2818a18640 1 -- 172.21.15.53:0/2101869735 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000abaf0 con 0x7f2814159ba0 2023-12-08T20:54:58.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.250+0000 7f281bc7e640 1 -- 172.21.15.53:0/2101869735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2814159ba0 msgr2=0x7f2814153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:58.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.250+0000 7f281bc7e640 1 --2- 172.21.15.53:0/2101869735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2814159ba0 0x7f2814153390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f28140ca620 tx=0x7f280001c440 comp rx=0 tx=0).stop 2023-12-08T20:54:58.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.250+0000 7f281bc7e640 1 -- 172.21.15.53:0/2101869735 shutdown_connections 2023-12-08T20:54:58.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.250+0000 7f281bc7e640 1 --2- 172.21.15.53:0/2101869735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2814159ba0 0x7f2814153390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:58.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.250+0000 7f281bc7e640 1 --2- 172.21.15.53:0/2101869735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28140c86d0 0x7f281406c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:58.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.250+0000 7f281bc7e640 1 --2- 172.21.15.53:0/2101869735 >> v2:172.21.15.146:3300/0 conn(0x7f28141597c0 0x7f281406f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:58.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.250+0000 7f281bc7e640 1 -- 172.21.15.53:0/2101869735 >> 172.21.15.53:0/2101869735 conn(0x7f2814070c60 msgr2=0x7f2814071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:54:58.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.250+0000 7f281bc7e640 1 -- 172.21.15.53:0/2101869735 shutdown_connections 2023-12-08T20:54:58.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.250+0000 7f281bc7e640 1 -- 172.21.15.53:0/2101869735 wait complete. 2023-12-08T20:54:58.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.254+0000 7f281bc7e640 1 Processor -- start 2023-12-08T20:54:58.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.254+0000 7f281bc7e640 1 -- start start 2023-12-08T20:54:58.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.254+0000 7f281bc7e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28140c86d0 0x7f28140c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:58.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.254+0000 7f281bc7e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28141597c0 0x7f28141f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:58.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.254+0000 7f281bc7e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2814159ba0 0x7f281414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:58.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.254+0000 7f281bc7e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28140cae50 con 0x7f2814159ba0 2023-12-08T20:54:58.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.254+0000 7f281bc7e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28140cabb0 con 0x7f28140c86d0 2023-12-08T20:54:58.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.254+0000 7f281bc7e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28140c5060 con 0x7f28141597c0 2023-12-08T20:54:58.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.258+0000 7f281a21b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2814159ba0 0x7f281414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:58.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.258+0000 7f281a21b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2814159ba0 0x7f281414f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53180/0 (socket says 172.21.15.53:53180) 2023-12-08T20:54:58.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.258+0000 7f281a21b640 1 -- 172.21.15.53:0/2227857207 learned_addr learned my addr 172.21.15.53:0/2227857207 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:54:58.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.258+0000 7f2819a1a640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28140c86d0 0x7f28140c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.262+0000 7f281a21b640 1 -- 172.21.15.53:0/2227857207 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28141597c0 msgr2=0x7f28141f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.262+0000 7f281a21b640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28141597c0 0x7f28141f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.262+0000 7f281a21b640 1 -- 172.21.15.53:0/2227857207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28140c86d0 msgr2=0x7f28140c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:54:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.262+0000 7f281a21b640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28140c86d0 0x7f28140c23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:54:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.262+0000 7f281a21b640 1 -- 172.21.15.53:0/2227857207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000094d0 con 0x7f2814159ba0 2023-12-08T20:54:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.262+0000 7f281a21b640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2814159ba0 0x7f281414f500 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f28000ad040 tx=0x7f280001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.266+0000 7f28127fc640 1 -- 172.21.15.53:0/2227857207 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000b4800 con 0x7f2814159ba0 2023-12-08T20:54:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.266+0000 7f28127fc640 1 -- 172.21.15.53:0/2227857207 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28000b4960 con 0x7f2814159ba0 2023-12-08T20:54:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.266+0000 7f281bc7e640 1 -- 172.21.15.53:0/2227857207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28141f1f70 con 0x7f2814159ba0 2023-12-08T20:54:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.266+0000 7f28127fc640 1 -- 172.21.15.53:0/2227857207 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000b4cf0 con 0x7f2814159ba0 2023-12-08T20:54:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.270+0000 7f281bc7e640 1 -- 172.21.15.53:0/2227857207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28140c4a80 con 0x7f2814159ba0 2023-12-08T20:54:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.270+0000 7f281bc7e640 1 -- 172.21.15.53:0/2227857207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2814074190 con 0x7f2814159ba0 2023-12-08T20:54:58.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.294+0000 7f28127fc640 1 -- 172.21.15.53:0/2227857207 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28000c8420 con 0x7f2814159ba0 2023-12-08T20:54:58.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.298+0000 7f28127fc640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f27f80664c0 0x7f27f8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:54:58.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.298+0000 7f2819a1a640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f27f80664c0 0x7f27f8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:54:58.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.298+0000 7f2819a1a640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f27f80664c0 0x7f27f8068980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f280c009f20 tx=0x7f280c0094f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:54:58.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.598+0000 7f28127fc640 1 -- 172.21.15.53:0/2227857207 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28000f0200 con 0x7f2814159ba0 2023-12-08T20:54:58.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.598+0000 7f28127fc640 1 -- 172.21.15.53:0/2227857207 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f28000ebe40 con 0x7f2814159ba0 2023-12-08T20:54:58.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:54:58.782+0000 7f281bc7e640 1 -- 172.21.15.53:0/2227857207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f281415c840 con 0x7f2814159ba0 2023-12-08T20:55:00.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.090+0000 7f28127fc640 1 -- 172.21.15.53:0/2227857207 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7f28000ab5c0 con 0x7f2814159ba0 2023-12-08T20:55:00.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.094+0000 7f281bc7e640 1 -- 172.21.15.53:0/2227857207 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f27f80664c0 msgr2=0x7f27f8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:00.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.094+0000 7f281bc7e640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f27f80664c0 0x7f27f8068980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f280c009f20 tx=0x7f280c0094f0 comp rx=0 tx=0).stop 2023-12-08T20:55:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.094+0000 7f281bc7e640 1 -- 172.21.15.53:0/2227857207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2814159ba0 msgr2=0x7f281414f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.094+0000 7f281bc7e640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2814159ba0 0x7f281414f500 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f28000ad040 tx=0x7f280001ac80 comp rx=0 tx=0).stop 2023-12-08T20:55:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.094+0000 7f281bc7e640 1 -- 172.21.15.53:0/2227857207 shutdown_connections 2023-12-08T20:55:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.094+0000 7f281bc7e640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f27f80664c0 0x7f27f8068980 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.094+0000 7f281bc7e640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2814159ba0 0x7f281414f500 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.094+0000 7f281bc7e640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28141597c0 0x7f28141f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.094+0000 7f281bc7e640 1 --2- 172.21.15.53:0/2227857207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28140c86d0 0x7f28140c23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.094+0000 7f281bc7e640 1 -- 172.21.15.53:0/2227857207 >> 172.21.15.53:0/2227857207 conn(0x7f2814070c60 msgr2=0x7f28140c2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.094+0000 7f281bc7e640 1 -- 172.21.15.53:0/2227857207 shutdown_connections 2023-12-08T20:55:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.098+0000 7f281bc7e640 1 -- 172.21.15.53:0/2227857207 wait complete. 2023-12-08T20:55:00.117 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T20:55:00.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.250+0000 7f445ee29640 1 Processor -- start 2023-12-08T20:55:00.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.250+0000 7f445ee29640 1 -- start start 2023-12-08T20:55:00.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.254+0000 7f445ee29640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f445815b4a0 0x7f44580c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:00.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.254+0000 7f445ee29640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4458157ee0 con 0x7f445806f900 2023-12-08T20:55:00.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.254+0000 7f445ee29640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4458158150 con 0x7f4458151360 2023-12-08T20:55:00.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.254+0000 7f445ee29640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445806b440 con 0x7f445815b4a0 2023-12-08T20:55:00.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.254+0000 7f445d3c6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f445815b4a0 0x7f44580c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.254+0000 7f445d3c6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f445815b4a0 0x7f44580c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:50054/0 (socket says 172.21.15.53:50054) 2023-12-08T20:55:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.254+0000 7f445d3c6640 1 -- 172.21.15.53:0/245307225 learned_addr learned my addr 172.21.15.53:0/245307225 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.258+0000 7f44577fe640 1 -- 172.21.15.53:0/245307225 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795192236 0 0) 0x7f4458157ee0 con 0x7f445806f900 2023-12-08T20:55:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.258+0000 7f44577fe640 1 -- 172.21.15.53:0/245307225 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4438003530 con 0x7f445806f900 2023-12-08T20:55:00.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.262+0000 7f445d3c6640 1 -- 172.21.15.53:0/245307225 >> v1:172.21.15.146:6789/0 conn(0x7f4458151360 legacy=0x7f4458071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:00.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.262+0000 7f445d3c6640 1 -- 172.21.15.53:0/245307225 >> v1:172.21.15.53:6789/0 conn(0x7f445806f900 legacy=0x7f445815ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:00.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.262+0000 7f445d3c6640 1 -- 172.21.15.53:0/245307225 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445806ae80 con 0x7f445815b4a0 2023-12-08T20:55:00.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.266+0000 7f445d3c6640 1 --2- 172.21.15.53:0/245307225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445815b4a0 0x7f44580c9470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4448009870 tx=0x7f444801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5046bd4c6752368e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:00.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.278+0000 7f44577fe640 1 -- 172.21.15.53:0/245307225 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44480a8a30 con 0x7f445815b4a0 2023-12-08T20:55:00.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.278+0000 7f44577fe640 1 -- 172.21.15.53:0/245307225 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44480a8b90 con 0x7f445815b4a0 2023-12-08T20:55:00.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.278+0000 7f44577fe640 1 -- 172.21.15.53:0/245307225 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44480b0440 con 0x7f445815b4a0 2023-12-08T20:55:00.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.278+0000 7f445ee29640 1 -- 172.21.15.53:0/245307225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445815b4a0 msgr2=0x7f44580c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:00.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.278+0000 7f445ee29640 1 --2- 172.21.15.53:0/245307225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445815b4a0 0x7f44580c9470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4448009870 tx=0x7f444801ed30 comp rx=0 tx=0).stop 2023-12-08T20:55:00.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.278+0000 7f445ee29640 1 -- 172.21.15.53:0/245307225 shutdown_connections 2023-12-08T20:55:00.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.278+0000 7f445ee29640 1 --2- 172.21.15.53:0/245307225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445815b4a0 0x7f44580c9470 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:00.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.278+0000 7f445ee29640 1 -- 172.21.15.53:0/245307225 >> 172.21.15.53:0/245307225 conn(0x7f445806df20 msgr2=0x7f445806e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:00.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.278+0000 7f445ee29640 1 -- 172.21.15.53:0/245307225 shutdown_connections 2023-12-08T20:55:00.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.278+0000 7f445ee29640 1 -- 172.21.15.53:0/245307225 wait complete. 2023-12-08T20:55:00.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.278+0000 7f445ee29640 1 Processor -- start 2023-12-08T20:55:00.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.278+0000 7f445ee29640 1 -- start start 2023-12-08T20:55:00.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.282+0000 7f445ee29640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445806f900 0x7f44580c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:00.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.282+0000 7f445ee29640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4458151360 0x7f445814ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:00.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.282+0000 7f445ee29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f445815b4a0 0x7f445814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:00.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.282+0000 7f445ee29640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44580c99b0 con 0x7f445815b4a0 2023-12-08T20:55:00.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.282+0000 7f445ee29640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44580c4670 con 0x7f445806f900 2023-12-08T20:55:00.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.282+0000 7f445ee29640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44580b1280 con 0x7f4458151360 2023-12-08T20:55:00.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.282+0000 7f4457fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4458151360 0x7f445814ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:00.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.282+0000 7f4457fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4458151360 0x7f445814ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:56512/0 (socket says 172.21.15.53:56512) 2023-12-08T20:55:00.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.282+0000 7f4457fff640 1 -- 172.21.15.53:0/583436660 learned_addr learned my addr 172.21.15.53:0/583436660 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:00.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.282+0000 7f445cbc5640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445806f900 0x7f44580c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:00.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.286+0000 7f4457fff640 1 -- 172.21.15.53:0/583436660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445806f900 msgr2=0x7f44580c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:00.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.286+0000 7f4457fff640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445806f900 0x7f44580c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:00.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.286+0000 7f4457fff640 1 -- 172.21.15.53:0/583436660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f445815b4a0 msgr2=0x7f445814f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:00.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.286+0000 7f4457fff640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f445815b4a0 0x7f445814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:00.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.286+0000 7f4457fff640 1 -- 172.21.15.53:0/583436660 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44480094d0 con 0x7f4458151360 2023-12-08T20:55:00.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.290+0000 7f4457fff640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4458151360 0x7f445814ea50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f444000c530 tx=0x7f444000c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.294+0000 7f44557fa640 1 -- 172.21.15.53:0/583436660 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44400052d0 con 0x7f4458151360 2023-12-08T20:55:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.294+0000 7f44557fa640 1 -- 172.21.15.53:0/583436660 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4440005450 con 0x7f4458151360 2023-12-08T20:55:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.294+0000 7f445ee29640 1 -- 172.21.15.53:0/583436660 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44581efb10 con 0x7f4458151360 2023-12-08T20:55:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.294+0000 7f44557fa640 1 -- 172.21.15.53:0/583436660 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440012870 con 0x7f4458151360 2023-12-08T20:55:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.294+0000 7f445ee29640 1 -- 172.21.15.53:0/583436660 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44580b0c30 con 0x7f4458151360 2023-12-08T20:55:00.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.298+0000 7f445ee29640 1 -- 172.21.15.53:0/583436660 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44580b13c0 con 0x7f4458151360 2023-12-08T20:55:00.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.558+0000 7f44557fa640 1 -- 172.21.15.53:0/583436660 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44400129d0 con 0x7f4458151360 2023-12-08T20:55:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.558+0000 7f44557fa640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f443c0664c0 0x7f443c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.558+0000 7f445cbc5640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f443c0664c0 0x7f443c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.558+0000 7f44557fa640 1 -- 172.21.15.53:0/583436660 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f4440055b10 con 0x7f4458151360 2023-12-08T20:55:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.562+0000 7f445cbc5640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f443c0664c0 0x7f443c068980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f44500012f0 tx=0x7f4450009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:00.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.578+0000 7f44557fa640 1 -- 172.21.15.53:0/583436660 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4440051750 con 0x7f4458151360 2023-12-08T20:55:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:00.758+0000 7f445ee29640 1 -- 172.21.15.53:0/583436660 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f44580b13c0 con 0x7f4458151360 2023-12-08T20:55:03.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.146+0000 7f44557fa640 1 -- 172.21.15.53:0/583436660 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7f44580b13c0 con 0x7f4458151360 2023-12-08T20:55:03.146 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data_ec' created 2023-12-08T20:55:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.150+0000 7f445ee29640 1 -- 172.21.15.53:0/583436660 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f443c0664c0 msgr2=0x7f443c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.150+0000 7f445ee29640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f443c0664c0 0x7f443c068980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f44500012f0 tx=0x7f4450009040 comp rx=0 tx=0).stop 2023-12-08T20:55:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.150+0000 7f445ee29640 1 -- 172.21.15.53:0/583436660 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4458151360 msgr2=0x7f445814ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.150+0000 7f445ee29640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4458151360 0x7f445814ea50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f444000c530 tx=0x7f444000c9f0 comp rx=0 tx=0).stop 2023-12-08T20:55:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.150+0000 7f445ee29640 1 -- 172.21.15.53:0/583436660 shutdown_connections 2023-12-08T20:55:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.150+0000 7f445ee29640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f443c0664c0 0x7f443c068980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.150+0000 7f445ee29640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f445815b4a0 0x7f445814f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:03.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.150+0000 7f445ee29640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4458151360 0x7f445814ea50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:03.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.150+0000 7f445ee29640 1 --2- 172.21.15.53:0/583436660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445806f900 0x7f44580c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:03.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.150+0000 7f445ee29640 1 -- 172.21.15.53:0/583436660 >> 172.21.15.53:0/583436660 conn(0x7f445806df20 msgr2=0x7f4458155070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:03.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.150+0000 7f445ee29640 1 -- 172.21.15.53:0/583436660 shutdown_connections 2023-12-08T20:55:03.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.150+0000 7f445ee29640 1 -- 172.21.15.53:0/583436660 wait complete. 2023-12-08T20:55:03.174 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-08T20:55:03.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.314+0000 7f5472a05640 1 Processor -- start 2023-12-08T20:55:03.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.314+0000 7f5472a05640 1 -- start start 2023-12-08T20:55:03.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.314+0000 7f5472a05640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f546c150590 0x7f546c060fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:03.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.314+0000 7f5472a05640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f546c0c4fc0 0x7f546c0c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:03.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.314+0000 7f5472a05640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546c159d00 con 0x7f546c159730 2023-12-08T20:55:03.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.314+0000 7f5472a05640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546c0c5920 con 0x7f546c0c4fc0 2023-12-08T20:55:03.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.314+0000 7f5472a05640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546c13eca0 con 0x7f546c150590 2023-12-08T20:55:03.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.314+0000 7f5470fa2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f546c0c4fc0 0x7f546c0c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:03.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.314+0000 7f5470fa2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f546c0c4fc0 0x7f546c0c53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42662/0 (socket says 172.21.15.53:42662) 2023-12-08T20:55:03.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.314+0000 7f5470fa2640 1 -- 172.21.15.53:0/1490181712 learned_addr learned my addr 172.21.15.53:0/1490181712 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:03.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.314+0000 7f546bfff640 1 --2- 172.21.15.53:0/1490181712 >> v2:172.21.15.146:3300/0 conn(0x7f546c150590 0x7f546c060fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.318+0000 7f5470fa2640 1 -- 172.21.15.53:0/1490181712 >> v2:172.21.15.146:3300/0 conn(0x7f546c150590 msgr2=0x7f546c060fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.318+0000 7f5470fa2640 1 --2- 172.21.15.53:0/1490181712 >> v2:172.21.15.146:3300/0 conn(0x7f546c150590 0x7f546c060fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.318+0000 7f5470fa2640 1 -- 172.21.15.53:0/1490181712 >> v1:172.21.15.146:6789/0 conn(0x7f546c159730 legacy=0x7f546c1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.318+0000 7f5470fa2640 1 -- 172.21.15.53:0/1490181712 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c159fe0 con 0x7f546c0c4fc0 2023-12-08T20:55:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.322+0000 7f5470fa2640 1 --2- 172.21.15.53:0/1490181712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c0c4fc0 0x7f546c0c53e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f546c070c90 tx=0x7f546401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a5e2714cd4ebdd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.326+0000 7f546affd640 1 -- 172.21.15.53:0/1490181712 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640a5820 con 0x7f546c0c4fc0 2023-12-08T20:55:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.326+0000 7f546affd640 1 -- 172.21.15.53:0/1490181712 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54640a5980 con 0x7f546c0c4fc0 2023-12-08T20:55:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.326+0000 7f546affd640 1 -- 172.21.15.53:0/1490181712 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640a5d10 con 0x7f546c0c4fc0 2023-12-08T20:55:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 -- 172.21.15.53:0/1490181712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c0c4fc0 msgr2=0x7f546c0c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 --2- 172.21.15.53:0/1490181712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c0c4fc0 0x7f546c0c53e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f546c070c90 tx=0x7f546401c960 comp rx=0 tx=0).stop 2023-12-08T20:55:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 -- 172.21.15.53:0/1490181712 shutdown_connections 2023-12-08T20:55:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 --2- 172.21.15.53:0/1490181712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c0c4fc0 0x7f546c0c53e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 --2- 172.21.15.53:0/1490181712 >> v2:172.21.15.146:3300/0 conn(0x7f546c150590 0x7f546c060fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 -- 172.21.15.53:0/1490181712 >> 172.21.15.53:0/1490181712 conn(0x7f546c0cb5c0 msgr2=0x7f546c0cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 -- 172.21.15.53:0/1490181712 shutdown_connections 2023-12-08T20:55:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 -- 172.21.15.53:0/1490181712 wait complete. 2023-12-08T20:55:03.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 Processor -- start 2023-12-08T20:55:03.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 -- start start 2023-12-08T20:55:03.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0c4fc0 0x7f546c15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:03.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f546c150590 0x7f546c1f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:03.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c159730 0x7f546c15f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:03.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c158eb0 con 0x7f546c159730 2023-12-08T20:55:03.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c14fc60 con 0x7f546c0c4fc0 2023-12-08T20:55:03.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5472a05640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546c1f5fe0 con 0x7f546c150590 2023-12-08T20:55:03.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5470fa2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c159730 0x7f546c15f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:03.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5470fa2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c159730 0x7f546c15f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42678/0 (socket says 172.21.15.53:42678) 2023-12-08T20:55:03.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f5470fa2640 1 -- 172.21.15.53:0/99711322 learned_addr learned my addr 172.21.15.53:0/99711322 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:03.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.330+0000 7f546b7fe640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f546c150590 0x7f546c1f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:03.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.334+0000 7f546bfff640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0c4fc0 0x7f546c15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:03.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.334+0000 7f5470fa2640 1 -- 172.21.15.53:0/99711322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f546c150590 msgr2=0x7f546c1f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:03.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.334+0000 7f5470fa2640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f546c150590 0x7f546c1f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:03.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.334+0000 7f5470fa2640 1 -- 172.21.15.53:0/99711322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0c4fc0 msgr2=0x7f546c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:03.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.334+0000 7f5470fa2640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0c4fc0 0x7f546c15feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:03.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.334+0000 7f5470fa2640 1 -- 172.21.15.53:0/99711322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464009b30 con 0x7f546c159730 2023-12-08T20:55:03.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.338+0000 7f5470fa2640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c159730 0x7f546c15f660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f546401b010 tx=0x7f5464019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:03.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.342+0000 7f5468ff9640 1 -- 172.21.15.53:0/99711322 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640bd070 con 0x7f546c159730 2023-12-08T20:55:03.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.342+0000 7f5468ff9640 1 -- 172.21.15.53:0/99711322 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54640b8470 con 0x7f546c159730 2023-12-08T20:55:03.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.342+0000 7f5468ff9640 1 -- 172.21.15.53:0/99711322 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640b8800 con 0x7f546c159730 2023-12-08T20:55:03.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.342+0000 7f5472a05640 1 -- 172.21.15.53:0/99711322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546c1f1e70 con 0x7f546c159730 2023-12-08T20:55:03.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.342+0000 7f5472a05640 1 -- 172.21.15.53:0/99711322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546c15ebf0 con 0x7f546c159730 2023-12-08T20:55:03.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.342+0000 7f5472a05640 1 -- 172.21.15.53:0/99711322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546c0617e0 con 0x7f546c159730 2023-12-08T20:55:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.614+0000 7f5468ff9640 1 -- 172.21.15.53:0/99711322 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f54640b8960 con 0x7f546c159730 2023-12-08T20:55:03.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.618+0000 7f5468ff9640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f54580664c0 0x7f5458068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:03.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.618+0000 7f546bfff640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f54580664c0 0x7f5458068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:03.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.618+0000 7f546bfff640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f54580664c0 0x7f5458068980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5460009af0 tx=0x7f5460008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:03.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.630+0000 7f5468ff9640 1 -- 172.21.15.53:0/99711322 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f54640f13f0 con 0x7f546c159730 2023-12-08T20:55:03.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.634+0000 7f5468ff9640 1 -- 172.21.15.53:0/99711322 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f54640ed030 con 0x7f546c159730 2023-12-08T20:55:03.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:03.814+0000 7f5472a05640 1 -- 172.21.15.53:0/99711322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f546c0c45b0 con 0x7f546c159730 2023-12-08T20:55:04.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.282+0000 7f5468ff9640 1 -- 172.21.15.53:0/99711322 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f54640f0650 con 0x7f546c159730 2023-12-08T20:55:04.284 INFO:teuthology.orchestra.run.smithi053.stderr:set pool 4 allow_ec_overwrites to true 2023-12-08T20:55:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.286+0000 7f5472a05640 1 -- 172.21.15.53:0/99711322 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f54580664c0 msgr2=0x7f5458068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.286+0000 7f5472a05640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f54580664c0 0x7f5458068980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5460009af0 tx=0x7f5460008040 comp rx=0 tx=0).stop 2023-12-08T20:55:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.286+0000 7f5472a05640 1 -- 172.21.15.53:0/99711322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c159730 msgr2=0x7f546c15f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.286+0000 7f5472a05640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c159730 0x7f546c15f660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f546401b010 tx=0x7f5464019700 comp rx=0 tx=0).stop 2023-12-08T20:55:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.286+0000 7f5472a05640 1 -- 172.21.15.53:0/99711322 shutdown_connections 2023-12-08T20:55:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.286+0000 7f5472a05640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f54580664c0 0x7f5458068980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:04.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.286+0000 7f5472a05640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c159730 0x7f546c15f660 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:04.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.286+0000 7f5472a05640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f546c150590 0x7f546c1f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:04.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.286+0000 7f5472a05640 1 --2- 172.21.15.53:0/99711322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0c4fc0 0x7f546c15feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:04.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.286+0000 7f5472a05640 1 -- 172.21.15.53:0/99711322 >> 172.21.15.53:0/99711322 conn(0x7f546c0cb5c0 msgr2=0x7f546c073900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:04.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.286+0000 7f5472a05640 1 -- 172.21.15.53:0/99711322 shutdown_connections 2023-12-08T20:55:04.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.286+0000 7f5472a05640 1 -- 172.21.15.53:0/99711322 wait complete. 2023-12-08T20:55:04.319 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-08T20:55:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.458+0000 7f0faf16f640 1 Processor -- start 2023-12-08T20:55:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.458+0000 7f0faf16f640 1 -- start start 2023-12-08T20:55:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.458+0000 7f0faf16f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fa8150750 0x7f0fa8156400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.458+0000 7f0faf16f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fa80c6120 0x7f0fa80c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.458+0000 7f0faf16f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa806d000 con 0x7f0fa8156940 2023-12-08T20:55:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.458+0000 7f0faf16f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa80c8010 con 0x7f0fa80c6120 2023-12-08T20:55:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.458+0000 7f0faf16f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa80703a0 con 0x7f0fa8150750 2023-12-08T20:55:04.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.458+0000 7f0fa7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fa80c6120 0x7f0fa80c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:04.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.462+0000 7f0fa7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fa80c6120 0x7f0fa80c0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42684/0 (socket says 172.21.15.53:42684) 2023-12-08T20:55:04.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.462+0000 7f0fa7fff640 1 -- 172.21.15.53:0/3109772388 learned_addr learned my addr 172.21.15.53:0/3109772388 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:04.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.462+0000 7f0fa7fff640 1 -- 172.21.15.53:0/3109772388 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fa8150750 msgr2=0x7f0fa8156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:04.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.462+0000 7f0fa7fff640 1 --2- 172.21.15.53:0/3109772388 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fa8150750 0x7f0fa8156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:04.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.462+0000 7f0fa7fff640 1 -- 172.21.15.53:0/3109772388 >> v1:172.21.15.53:6789/0 conn(0x7f0fa8156940 legacy=0x7f0fa81599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:04.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.462+0000 7f0fa7fff640 1 -- 172.21.15.53:0/3109772388 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa806f2a0 con 0x7f0fa80c6120 2023-12-08T20:55:04.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.466+0000 7f0fa7fff640 1 --2- 172.21.15.53:0/3109772388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fa80c6120 0x7f0fa80c0eb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400bb10 tx=0x7f0f9401eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7959154429a3f805 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:04.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0fa77fe640 1 -- 172.21.15.53:0/3109772388 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f940a79c0 con 0x7f0fa80c6120 2023-12-08T20:55:04.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0fa77fe640 1 -- 172.21.15.53:0/3109772388 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f940a7b20 con 0x7f0fa80c6120 2023-12-08T20:55:04.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0fa77fe640 1 -- 172.21.15.53:0/3109772388 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f940af440 con 0x7f0fa80c6120 2023-12-08T20:55:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 -- 172.21.15.53:0/3109772388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fa80c6120 msgr2=0x7f0fa80c0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 --2- 172.21.15.53:0/3109772388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fa80c6120 0x7f0fa80c0eb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400bb10 tx=0x7f0f9401eaf0 comp rx=0 tx=0).stop 2023-12-08T20:55:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 -- 172.21.15.53:0/3109772388 shutdown_connections 2023-12-08T20:55:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 --2- 172.21.15.53:0/3109772388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fa80c6120 0x7f0fa80c0eb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 --2- 172.21.15.53:0/3109772388 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fa8150750 0x7f0fa8156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 -- 172.21.15.53:0/3109772388 >> 172.21.15.53:0/3109772388 conn(0x7f0fa806f880 msgr2=0x7f0fa806fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 -- 172.21.15.53:0/3109772388 shutdown_connections 2023-12-08T20:55:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 -- 172.21.15.53:0/3109772388 wait complete. 2023-12-08T20:55:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 Processor -- start 2023-12-08T20:55:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 -- start start 2023-12-08T20:55:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fa80c6120 0x7f0fa815f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fa8150750 0x7f0fa8149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fa8156940 0x7f0fa81f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa814e7a0 con 0x7f0fa80c6120 2023-12-08T20:55:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa815fcd0 con 0x7f0fa8156940 2023-12-08T20:55:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0faf16f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81f2f20 con 0x7f0fa8150750 2023-12-08T20:55:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.474+0000 7f0facf0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fa80c6120 0x7f0fa815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.478+0000 7f0facf0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fa80c6120 0x7f0fa815f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42700/0 (socket says 172.21.15.53:42700) 2023-12-08T20:55:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.478+0000 7f0facf0b640 1 -- 172.21.15.53:0/3981172795 learned_addr learned my addr 172.21.15.53:0/3981172795 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:04.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.482+0000 7f0facf0b640 1 -- 172.21.15.53:0/3981172795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fa8150750 msgr2=0x7f0fa8149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:04.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.482+0000 7f0facf0b640 1 --2- 172.21.15.53:0/3981172795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fa8150750 0x7f0fa8149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:04.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.482+0000 7f0facf0b640 1 -- 172.21.15.53:0/3981172795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fa8156940 msgr2=0x7f0fa81f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:04.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.482+0000 7f0facf0b640 1 --2- 172.21.15.53:0/3981172795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fa8156940 0x7f0fa81f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:04.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.482+0000 7f0facf0b640 1 -- 172.21.15.53:0/3981172795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9400b770 con 0x7f0fa80c6120 2023-12-08T20:55:04.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.482+0000 7f0facf0b640 1 --2- 172.21.15.53:0/3981172795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fa80c6120 0x7f0fa815f790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00b410 tx=0x7f0f9c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:04.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.486+0000 7f0fa57fa640 1 -- 172.21.15.53:0/3981172795 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c011830 con 0x7f0fa80c6120 2023-12-08T20:55:04.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.486+0000 7f0fa57fa640 1 -- 172.21.15.53:0/3981172795 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c011990 con 0x7f0fa80c6120 2023-12-08T20:55:04.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.486+0000 7f0fa57fa640 1 -- 172.21.15.53:0/3981172795 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c011d40 con 0x7f0fa80c6120 2023-12-08T20:55:04.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.486+0000 7f0faf16f640 1 -- 172.21.15.53:0/3981172795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa81f3200 con 0x7f0fa80c6120 2023-12-08T20:55:04.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.486+0000 7f0faf16f640 1 -- 172.21.15.53:0/3981172795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa814ecd0 con 0x7f0fa80c6120 2023-12-08T20:55:04.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.486+0000 7f0faf16f640 1 -- 172.21.15.53:0/3981172795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa80711d0 con 0x7f0fa80c6120 2023-12-08T20:55:04.729 INFO:tasks.ceph.mds.a.smithi053.stderr:2023-12-08T20:55:04.714+0000 f9b4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T20:55:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.806+0000 7f0fa57fa640 1 -- 172.21.15.53:0/3981172795 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0f9c01a400 con 0x7f0fa80c6120 2023-12-08T20:55:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.810+0000 7f0fa57fa640 1 --2- 172.21.15.53:0/3981172795 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0f8c066470 0x7f0f8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:04.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.810+0000 7f0fa7fff640 1 --2- 172.21.15.53:0/3981172795 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0f8c066470 0x7f0f8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:04.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.810+0000 7f0fa7fff640 1 --2- 172.21.15.53:0/3981172795 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0f8c066470 0x7f0f8c068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f940b1000 tx=0x7f0f94004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:04.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.906+0000 7f0fa57fa640 1 -- 172.21.15.53:0/3981172795 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f0f9c055e10 con 0x7f0fa80c6120 2023-12-08T20:55:04.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:04.906+0000 7f0fa57fa640 1 -- 172.21.15.53:0/3981172795 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0f9c051a50 con 0x7f0fa80c6120 2023-12-08T20:55:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.114+0000 7f0faf16f640 1 -- 172.21.15.53:0/3981172795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f0fa8074200 con 0x7f0fa80c6120 2023-12-08T20:55:05.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.746+0000 7f0fa57fa640 1 -- 172.21.15.53:0/3981172795 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f0f9c015070 con 0x7f0fa80c6120 2023-12-08T20:55:05.749 INFO:teuthology.orchestra.run.smithi053.stderr:added data pool 4 to fsmap 2023-12-08T20:55:05.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.750+0000 7f0faf16f640 1 -- 172.21.15.53:0/3981172795 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0f8c066470 msgr2=0x7f0f8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:05.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.750+0000 7f0faf16f640 1 --2- 172.21.15.53:0/3981172795 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0f8c066470 0x7f0f8c068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f940b1000 tx=0x7f0f94004740 comp rx=0 tx=0).stop 2023-12-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.750+0000 7f0faf16f640 1 -- 172.21.15.53:0/3981172795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fa80c6120 msgr2=0x7f0fa815f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.750+0000 7f0faf16f640 1 --2- 172.21.15.53:0/3981172795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fa80c6120 0x7f0fa815f790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00b410 tx=0x7f0f9c00b8d0 comp rx=0 tx=0).stop 2023-12-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.750+0000 7f0faf16f640 1 -- 172.21.15.53:0/3981172795 shutdown_connections 2023-12-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.750+0000 7f0faf16f640 1 --2- 172.21.15.53:0/3981172795 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0f8c066470 0x7f0f8c068930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.750+0000 7f0faf16f640 1 --2- 172.21.15.53:0/3981172795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fa8156940 0x7f0fa81f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.750+0000 7f0faf16f640 1 --2- 172.21.15.53:0/3981172795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fa8150750 0x7f0fa8149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.750+0000 7f0faf16f640 1 --2- 172.21.15.53:0/3981172795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fa80c6120 0x7f0fa815f790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.750+0000 7f0faf16f640 1 -- 172.21.15.53:0/3981172795 >> 172.21.15.53:0/3981172795 conn(0x7f0fa806f880 msgr2=0x7f0fa8154ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.750+0000 7f0faf16f640 1 -- 172.21.15.53:0/3981172795 shutdown_connections 2023-12-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.750+0000 7f0faf16f640 1 -- 172.21.15.53:0/3981172795 wait complete. 2023-12-08T20:55:05.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T20:55:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.906+0000 7f71b7af5640 1 Processor -- start 2023-12-08T20:55:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.906+0000 7f71b7af5640 1 -- start start 2023-12-08T20:55:05.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.906+0000 7f71b7af5640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71b01516b0 0x7f71b00c3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:05.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.906+0000 7f71b7af5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71b00c3940 0x7f71b015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:05.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.906+0000 7f71b7af5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b00c2f70 con 0x7f71b00c2030 2023-12-08T20:55:05.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.906+0000 7f71b7af5640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b015b980 con 0x7f71b01516b0 2023-12-08T20:55:05.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.906+0000 7f71b7af5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b015b6a0 con 0x7f71b00c3940 2023-12-08T20:55:05.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.906+0000 7f71b6092640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71b00c3940 0x7f71b015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.906+0000 7f71b5891640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71b01516b0 0x7f71b00c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.906+0000 7f71b6092640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71b00c3940 0x7f71b015a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:43356/0 (socket says 172.21.15.53:43356) 2023-12-08T20:55:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.906+0000 7f71b6092640 1 -- 172.21.15.53:0/2231664998 learned_addr learned my addr 172.21.15.53:0/2231664998 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.914+0000 7f71b6092640 1 -- 172.21.15.53:0/2231664998 >> v2:172.21.15.146:3300/0 conn(0x7f71b01516b0 msgr2=0x7f71b00c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.914+0000 7f71b6092640 1 --2- 172.21.15.53:0/2231664998 >> v2:172.21.15.146:3300/0 conn(0x7f71b01516b0 0x7f71b00c3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.914+0000 7f71b6092640 1 -- 172.21.15.53:0/2231664998 >> v1:172.21.15.53:6789/0 conn(0x7f71b00c2030 legacy=0x7f71b00c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.914+0000 7f71b6092640 1 -- 172.21.15.53:0/2231664998 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b00c2640 con 0x7f71b00c3940 2023-12-08T20:55:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.918+0000 7f71b6092640 1 --2- 172.21.15.53:0/2231664998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71b00c3940 0x7f71b015a9f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009870 tx=0x7f71a801c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5900090b3ea4e1b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:05.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.926+0000 7f71b488f640 1 -- 172.21.15.53:0/2231664998 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80ac410 con 0x7f71b00c3940 2023-12-08T20:55:05.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.926+0000 7f71b488f640 1 -- 172.21.15.53:0/2231664998 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a80ac570 con 0x7f71b00c3940 2023-12-08T20:55:05.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.926+0000 7f71b488f640 1 -- 172.21.15.53:0/2231664998 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80ac900 con 0x7f71b00c3940 2023-12-08T20:55:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 -- 172.21.15.53:0/2231664998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71b00c3940 msgr2=0x7f71b015a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 --2- 172.21.15.53:0/2231664998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71b00c3940 0x7f71b015a9f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009870 tx=0x7f71a801c500 comp rx=0 tx=0).stop 2023-12-08T20:55:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 -- 172.21.15.53:0/2231664998 shutdown_connections 2023-12-08T20:55:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 --2- 172.21.15.53:0/2231664998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71b00c3940 0x7f71b015a9f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 --2- 172.21.15.53:0/2231664998 >> v2:172.21.15.146:3300/0 conn(0x7f71b01516b0 0x7f71b00c3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 -- 172.21.15.53:0/2231664998 >> 172.21.15.53:0/2231664998 conn(0x7f71b0070b20 msgr2=0x7f71b0070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 -- 172.21.15.53:0/2231664998 shutdown_connections 2023-12-08T20:55:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 -- 172.21.15.53:0/2231664998 wait complete. 2023-12-08T20:55:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 Processor -- start 2023-12-08T20:55:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 -- start start 2023-12-08T20:55:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b00c2030 0x7f71b0160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71b00c3940 0x7f71b0159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71b01516b0 0x7f71b014ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b0156c00 con 0x7f71b00c2030 2023-12-08T20:55:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b01605c0 con 0x7f71b00c3940 2023-12-08T20:55:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:05.930+0000 7f71b7af5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b01552f0 con 0x7f71b01516b0 2023-12-08T20:55:06.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.022+0000 7f71b5891640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b00c2030 0x7f71b0160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:06.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.022+0000 7f71b5891640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b00c2030 0x7f71b0160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42708/0 (socket says 172.21.15.53:42708) 2023-12-08T20:55:06.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.022+0000 7f71b5891640 1 -- 172.21.15.53:0/3389485581 learned_addr learned my addr 172.21.15.53:0/3389485581 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.026+0000 7f71b6092640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71b01516b0 0x7f71b014ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.030+0000 7f71b5090640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71b00c3940 0x7f71b0159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.034+0000 7f71b5891640 1 -- 172.21.15.53:0/3389485581 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71b01516b0 msgr2=0x7f71b014ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.034+0000 7f71b5891640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71b01516b0 0x7f71b014ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.034+0000 7f71b5891640 1 -- 172.21.15.53:0/3389485581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71b00c3940 msgr2=0x7f71b0159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.034+0000 7f71b5891640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71b00c3940 0x7f71b0159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.034+0000 7f71b5891640 1 -- 172.21.15.53:0/3389485581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a80094d0 con 0x7f71b00c2030 2023-12-08T20:55:06.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.042+0000 7f71b5891640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b00c2030 0x7f71b0160a50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009d10 tx=0x7f71a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:06.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.058+0000 7f71ae7fc640 1 -- 172.21.15.53:0/3389485581 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0009b80 con 0x7f71b00c2030 2023-12-08T20:55:06.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.058+0000 7f71ae7fc640 1 -- 172.21.15.53:0/3389485581 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a000f040 con 0x7f71b00c2030 2023-12-08T20:55:06.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.058+0000 7f71ae7fc640 1 -- 172.21.15.53:0/3389485581 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0014680 con 0x7f71b00c2030 2023-12-08T20:55:06.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.058+0000 7f71b7af5640 1 -- 172.21.15.53:0/3389485581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b01555b0 con 0x7f71b00c2030 2023-12-08T20:55:06.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.058+0000 7f71b7af5640 1 -- 172.21.15.53:0/3389485581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b0160250 con 0x7f71b00c2030 2023-12-08T20:55:06.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.058+0000 7f71b7af5640 1 -- 172.21.15.53:0/3389485581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b0160410 con 0x7f71b00c2030 2023-12-08T20:55:06.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.426+0000 7f71ae7fc640 1 -- 172.21.15.53:0/3389485581 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71a00147e0 con 0x7f71b00c2030 2023-12-08T20:55:06.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.426+0000 7f71ae7fc640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f719c0664c0 0x7f719c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:06.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.426+0000 7f71b5090640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f719c0664c0 0x7f719c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:06.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.426+0000 7f71b5090640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f719c0664c0 0x7f719c068980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f71b015aad0 tx=0x7f71a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:06.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.466+0000 7f71ae7fc640 1 -- 172.21.15.53:0/3389485581 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71a00569a0 con 0x7f71b00c2030 2023-12-08T20:55:06.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.466+0000 7f71ae7fc640 1 -- 172.21.15.53:0/3389485581 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71a00525e0 con 0x7f71b00c2030 2023-12-08T20:55:06.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.682+0000 7f71b7af5640 1 -- 172.21.15.53:0/3389485581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71b0074190 con 0x7f71b00c2030 2023-12-08T20:55:06.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71ae7fc640 1 -- 172.21.15.53:0/3389485581 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6498 (secure 0 0 0) 0x7f71a0055c00 con 0x7f71b00c2030 2023-12-08T20:55:06.726 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:06.726 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6838/3541484412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3541484412},{"type":"v1","addr":"172.21.15.53:6838","nonce":3541484412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/2329639389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6837","nonce":2329639389},{"type":"v1","addr":"172.21.15.53:6839","nonce":2329639389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3938297948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3938297948},{"type":"v1","addr":"172.21.15.146:6833","nonce":3938297948}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2026540331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2026540331},{"type":"v1","addr":"172.21.15.146:6836","nonce":2026540331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/4236922545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4236922545},{"type":"v1","addr":"172.21.15.146:6837","nonce":4236922545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T20:54:56.254252+0000","modified":"2023-12-08T20:55:05.181353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6835/3454931938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3454931938},{"type":"v1","addr":"172.21.15.53:6835","nonce":3454931938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-08T20:55:06.726 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2023-12-08T20:55:06.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71b7af5640 1 -- 172.21.15.53:0/3389485581 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f719c0664c0 msgr2=0x7f719c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71b7af5640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f719c0664c0 0x7f719c068980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f71b015aad0 tx=0x7f71a4009040 comp rx=0 tx=0).stop 2023-12-08T20:55:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71b7af5640 1 -- 172.21.15.53:0/3389485581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b00c2030 msgr2=0x7f71b0160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71b7af5640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b00c2030 0x7f71b0160a50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009d10 tx=0x7f71a000c490 comp rx=0 tx=0).stop 2023-12-08T20:55:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71b7af5640 1 -- 172.21.15.53:0/3389485581 shutdown_connections 2023-12-08T20:55:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71b7af5640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f719c0664c0 0x7f719c068980 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71b7af5640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71b01516b0 0x7f71b014ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71b7af5640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71b00c3940 0x7f71b0159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71b7af5640 1 --2- 172.21.15.53:0/3389485581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b00c2030 0x7f71b0160a50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71b7af5640 1 -- 172.21.15.53:0/3389485581 >> 172.21.15.53:0/3389485581 conn(0x7f71b0070b20 msgr2=0x7f71b014bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71b7af5640 1 -- 172.21.15.53:0/3389485581 shutdown_connections 2023-12-08T20:55:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.726+0000 7f71b7af5640 1 -- 172.21.15.53:0/3389485581 wait complete. 2023-12-08T20:55:06.747 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:55:06.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.870+0000 7f83af8e6640 1 Processor -- start 2023-12-08T20:55:06.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.870+0000 7f83af8e6640 1 -- start start 2023-12-08T20:55:06.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.870+0000 7f83af8e6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83a81537f0 0x7f83a8159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:06.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.870+0000 7f83af8e6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83a806da80 0x7f83a806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:06.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.870+0000 7f83af8e6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a815a460 con 0x7f83a815ca90 2023-12-08T20:55:06.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.870+0000 7f83af8e6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a80c58f0 con 0x7f83a806da80 2023-12-08T20:55:06.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.870+0000 7f83af8e6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a8153bd0 con 0x7f83a81537f0 2023-12-08T20:55:06.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.870+0000 7f83ace81640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83a806da80 0x7f83a806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:06.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.874+0000 7f83ad682640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83a81537f0 0x7f83a8159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:06.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.874+0000 7f83ade83640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f83a815ca90 0x7f83a80c6020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49978/0 (socket says 172.21.15.53:49978) 2023-12-08T20:55:06.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.874+0000 7f83ade83640 1 -- 172.21.15.53:0/4097957006 learned_addr learned my addr 172.21.15.53:0/4097957006 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:06.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.878+0000 7f83ace81640 1 -- 172.21.15.53:0/4097957006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83a81537f0 msgr2=0x7f83a8159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:06.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.878+0000 7f83ace81640 1 --2- 172.21.15.53:0/4097957006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83a81537f0 0x7f83a8159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:06.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.878+0000 7f83ace81640 1 -- 172.21.15.53:0/4097957006 >> v1:172.21.15.53:6789/0 conn(0x7f83a815ca90 legacy=0x7f83a80c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:06.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.878+0000 7f83ace81640 1 -- 172.21.15.53:0/4097957006 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a815cfb0 con 0x7f83a806da80 2023-12-08T20:55:06.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.882+0000 7f83ace81640 1 --2- 172.21.15.53:0/4097957006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a806da80 0x7f83a806e7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83980097c0 tx=0x7f839801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8200b371f04338c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:06.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.886+0000 7f839ffff640 1 -- 172.21.15.53:0/4097957006 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83980a8970 con 0x7f83a806da80 2023-12-08T20:55:06.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.886+0000 7f839ffff640 1 -- 172.21.15.53:0/4097957006 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83980a8ad0 con 0x7f83a806da80 2023-12-08T20:55:06.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.886+0000 7f839ffff640 1 -- 172.21.15.53:0/4097957006 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83980a8e60 con 0x7f83a806da80 2023-12-08T20:55:06.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 -- 172.21.15.53:0/4097957006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a806da80 msgr2=0x7f83a806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:06.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 --2- 172.21.15.53:0/4097957006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a806da80 0x7f83a806e7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83980097c0 tx=0x7f839801ec70 comp rx=0 tx=0).stop 2023-12-08T20:55:06.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 -- 172.21.15.53:0/4097957006 shutdown_connections 2023-12-08T20:55:06.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 --2- 172.21.15.53:0/4097957006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a806da80 0x7f83a806e7a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:06.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 --2- 172.21.15.53:0/4097957006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83a81537f0 0x7f83a8159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:06.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 -- 172.21.15.53:0/4097957006 >> 172.21.15.53:0/4097957006 conn(0x7f83a80caef0 msgr2=0x7f83a80cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:06.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 -- 172.21.15.53:0/4097957006 shutdown_connections 2023-12-08T20:55:06.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 -- 172.21.15.53:0/4097957006 wait complete. 2023-12-08T20:55:06.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 Processor -- start 2023-12-08T20:55:06.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 -- start start 2023-12-08T20:55:06.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a806da80 0x7f83a815c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:06.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83a81537f0 0x7f83a81ef400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:06.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a815ca90 0x7f83a81ef940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:06.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a81f3500 con 0x7f83a806da80 2023-12-08T20:55:06.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a81f28f0 con 0x7f83a815ca90 2023-12-08T20:55:06.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83af8e6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a81f2bd0 con 0x7f83a81537f0 2023-12-08T20:55:06.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83ad682640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a806da80 0x7f83a815c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:06.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83ad682640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a806da80 0x7f83a815c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42714/0 (socket says 172.21.15.53:42714) 2023-12-08T20:55:06.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83ad682640 1 -- 172.21.15.53:0/1798737508 learned_addr learned my addr 172.21.15.53:0/1798737508 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:06.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83ace81640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83a81537f0 0x7f83a81ef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:06.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.890+0000 7f83ade83640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a815ca90 0x7f83a81ef940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:06.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.894+0000 7f83ad682640 1 -- 172.21.15.53:0/1798737508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83a81537f0 msgr2=0x7f83a81ef400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:06.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.894+0000 7f83ad682640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83a81537f0 0x7f83a81ef400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:06.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.894+0000 7f83ad682640 1 -- 172.21.15.53:0/1798737508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a815ca90 msgr2=0x7f83a81ef940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:06.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.894+0000 7f83ad682640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a815ca90 0x7f83a81ef940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:06.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.894+0000 7f83ad682640 1 -- 172.21.15.53:0/1798737508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398009420 con 0x7f83a806da80 2023-12-08T20:55:06.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.898+0000 7f83ad682640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a806da80 0x7f83a815c0e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83a400e930 tx=0x7f83a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:06.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.902+0000 7f839dffb640 1 -- 172.21.15.53:0/1798737508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a4009690 con 0x7f83a806da80 2023-12-08T20:55:06.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.902+0000 7f839dffb640 1 -- 172.21.15.53:0/1798737508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a400ca00 con 0x7f83a806da80 2023-12-08T20:55:06.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.902+0000 7f839dffb640 1 -- 172.21.15.53:0/1798737508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a400cd70 con 0x7f83a806da80 2023-12-08T20:55:06.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.902+0000 7f83af8e6640 1 -- 172.21.15.53:0/1798737508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a81f2eb0 con 0x7f83a806da80 2023-12-08T20:55:06.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.902+0000 7f83af8e6640 1 -- 172.21.15.53:0/1798737508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a80afc00 con 0x7f83a806da80 2023-12-08T20:55:06.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.902+0000 7f83af8e6640 1 -- 172.21.15.53:0/1798737508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a80c6a10 con 0x7f83a806da80 2023-12-08T20:55:06.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.922+0000 7f839dffb640 1 -- 172.21.15.53:0/1798737508 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83a4013470 con 0x7f83a806da80 2023-12-08T20:55:06.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.922+0000 7f839dffb640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f838c066470 0x7f838c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:06.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.922+0000 7f83ace81640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f838c066470 0x7f838c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:06.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:06.922+0000 7f83ace81640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f838c066470 0x7f838c068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f83980b2000 tx=0x7f83980aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:07.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.210+0000 7f839dffb640 1 -- 172.21.15.53:0/1798737508 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83a4055b50 con 0x7f83a806da80 2023-12-08T20:55:07.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.210+0000 7f839dffb640 1 -- 172.21.15.53:0/1798737508 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83a4051e90 con 0x7f83a806da80 2023-12-08T20:55:07.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.382+0000 7f83af8e6640 1 -- 172.21.15.53:0/1798737508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83a80675b0 con 0x7f83a806da80 2023-12-08T20:55:07.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.442+0000 7f839dffb640 1 -- 172.21.15.53:0/1798737508 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f83a4021070 con 0x7f83a806da80 2023-12-08T20:55:07.443 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:07.443 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:05.168215+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:55:07.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.446+0000 7f83af8e6640 1 -- 172.21.15.53:0/1798737508 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f838c066470 msgr2=0x7f838c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:07.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.446+0000 7f83af8e6640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f838c066470 0x7f838c068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f83980b2000 tx=0x7f83980aa070 comp rx=0 tx=0).stop 2023-12-08T20:55:07.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.446+0000 7f83af8e6640 1 -- 172.21.15.53:0/1798737508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a806da80 msgr2=0x7f83a815c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:07.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.446+0000 7f83af8e6640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a806da80 0x7f83a815c0e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83a400e930 tx=0x7f83a400edf0 comp rx=0 tx=0).stop 2023-12-08T20:55:07.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.446+0000 7f83af8e6640 1 -- 172.21.15.53:0/1798737508 shutdown_connections 2023-12-08T20:55:07.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.446+0000 7f83af8e6640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f838c066470 0x7f838c068930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:07.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.446+0000 7f83af8e6640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a815ca90 0x7f83a81ef940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:07.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.446+0000 7f83af8e6640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83a81537f0 0x7f83a81ef400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:07.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.446+0000 7f83af8e6640 1 --2- 172.21.15.53:0/1798737508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a806da80 0x7f83a815c0e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:07.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.446+0000 7f83af8e6640 1 -- 172.21.15.53:0/1798737508 >> 172.21.15.53:0/1798737508 conn(0x7f83a80caef0 msgr2=0x7f83a80c06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:07.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.446+0000 7f83af8e6640 1 -- 172.21.15.53:0/1798737508 shutdown_connections 2023-12-08T20:55:07.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.446+0000 7f83af8e6640 1 -- 172.21.15.53:0/1798737508 wait complete. 2023-12-08T20:55:07.463 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:55:07.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.582+0000 7fb0a7528640 1 Processor -- start 2023-12-08T20:55:07.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.582+0000 7fb0a7528640 1 -- start start 2023-12-08T20:55:07.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.586+0000 7fb0a7528640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0a006dff0 0x7fb0a006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:07.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.586+0000 7fb0a7528640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a006f7d0 con 0x7fb0a0150630 2023-12-08T20:55:07.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.586+0000 7fb0a7528640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a006fa90 con 0x7fb0a01599e0 2023-12-08T20:55:07.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.586+0000 7fb0a7528640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a006fd70 con 0x7fb0a006dff0 2023-12-08T20:55:07.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.586+0000 7fb0a5ac5640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb0a01599e0 0x7fb0a0159e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.53:39372/0 (socket says 172.21.15.53:39372) 2023-12-08T20:55:07.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.586+0000 7fb0a5ac5640 1 -- 172.21.15.53:0/1057822871 learned_addr learned my addr 172.21.15.53:0/1057822871 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.638+0000 7fb0a4ac3640 1 --2- 172.21.15.53:0/1057822871 >> v2:172.21.15.53:3300/0 conn(0x7fb0a006dff0 0x7fb0a006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.646+0000 7fb0a4ac3640 1 -- 172.21.15.53:0/1057822871 >> v1:172.21.15.146:6789/0 conn(0x7fb0a01599e0 legacy=0x7fb0a0159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.646+0000 7fb0a4ac3640 1 -- 172.21.15.53:0/1057822871 >> v1:172.21.15.53:6789/0 conn(0x7fb0a0150630 legacy=0x7fb0a00c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.646+0000 7fb0a4ac3640 1 -- 172.21.15.53:0/1057822871 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a0070050 con 0x7fb0a006dff0 2023-12-08T20:55:07.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.654+0000 7fb0a4ac3640 1 --2- 172.21.15.53:0/1057822871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a006dff0 0x7fb0a006e410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb0900097a0 tx=0x7fb09001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db8beb400ff990 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.662+0000 7fb097fff640 1 -- 172.21.15.53:0/1057822871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0900a8950 con 0x7fb0a006dff0 2023-12-08T20:55:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.662+0000 7fb097fff640 1 -- 172.21.15.53:0/1057822871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0900a8ab0 con 0x7fb0a006dff0 2023-12-08T20:55:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.662+0000 7fb097fff640 1 -- 172.21.15.53:0/1057822871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0900a8e40 con 0x7fb0a006dff0 2023-12-08T20:55:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.666+0000 7fb0a7528640 1 -- 172.21.15.53:0/1057822871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a006dff0 msgr2=0x7fb0a006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.666+0000 7fb0a7528640 1 --2- 172.21.15.53:0/1057822871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a006dff0 0x7fb0a006e410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb0900097a0 tx=0x7fb09001ec50 comp rx=0 tx=0).stop 2023-12-08T20:55:07.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.666+0000 7fb0a7528640 1 -- 172.21.15.53:0/1057822871 shutdown_connections 2023-12-08T20:55:07.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.666+0000 7fb0a7528640 1 --2- 172.21.15.53:0/1057822871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a006dff0 0x7fb0a006e410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:07.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.666+0000 7fb0a7528640 1 -- 172.21.15.53:0/1057822871 >> 172.21.15.53:0/1057822871 conn(0x7fb0a00c8a00 msgr2=0x7fb0a00c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:07.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.666+0000 7fb0a7528640 1 -- 172.21.15.53:0/1057822871 shutdown_connections 2023-12-08T20:55:07.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.666+0000 7fb0a7528640 1 -- 172.21.15.53:0/1057822871 wait complete. 2023-12-08T20:55:07.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.666+0000 7fb0a7528640 1 Processor -- start 2023-12-08T20:55:07.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.666+0000 7fb0a7528640 1 -- start start 2023-12-08T20:55:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.670+0000 7fb0a7528640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0a006dff0 0x7fb0a0158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.670+0000 7fb0a7528640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0150630 0x7fb0a00cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.670+0000 7fb0a7528640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0a01599e0 0x7fb0a0144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.670+0000 7fb0a7528640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a01ed840 con 0x7fb0a0150630 2023-12-08T20:55:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.670+0000 7fb0a7528640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a01eccc0 con 0x7fb0a01599e0 2023-12-08T20:55:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.670+0000 7fb0a7528640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a01ecfa0 con 0x7fb0a006dff0 2023-12-08T20:55:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.670+0000 7fb0a4ac3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0150630 0x7fb0a00cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.670+0000 7fb0a4ac3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0150630 0x7fb0a00cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42736/0 (socket says 172.21.15.53:42736) 2023-12-08T20:55:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.670+0000 7fb0a4ac3640 1 -- 172.21.15.53:0/1575390014 learned_addr learned my addr 172.21.15.53:0/1575390014 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:07.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.674+0000 7fb0a4ac3640 1 -- 172.21.15.53:0/1575390014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0a006dff0 msgr2=0x7fb0a0158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:07.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.674+0000 7fb0a4ac3640 1 --2- 172.21.15.53:0/1575390014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0a006dff0 0x7fb0a0158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:07.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.674+0000 7fb0a4ac3640 1 -- 172.21.15.53:0/1575390014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0a01599e0 msgr2=0x7fb0a0144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:07.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.674+0000 7fb0a4ac3640 1 --2- 172.21.15.53:0/1575390014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0a01599e0 0x7fb0a0144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:07.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.674+0000 7fb0a4ac3640 1 -- 172.21.15.53:0/1575390014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0900093b0 con 0x7fb0a0150630 2023-12-08T20:55:07.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.678+0000 7fb0a4ac3640 1 --2- 172.21.15.53:0/1575390014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0150630 0x7fb0a00cb070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb09001c880 tx=0x7fb09001b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:07.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.682+0000 7fb095ffb640 1 -- 172.21.15.53:0/1575390014 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0900a88f0 con 0x7fb0a0150630 2023-12-08T20:55:07.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.682+0000 7fb095ffb640 1 -- 172.21.15.53:0/1575390014 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0900059a0 con 0x7fb0a0150630 2023-12-08T20:55:07.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.682+0000 7fb095ffb640 1 -- 172.21.15.53:0/1575390014 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090005d30 con 0x7fb0a0150630 2023-12-08T20:55:07.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.682+0000 7fb0a7528640 1 -- 172.21.15.53:0/1575390014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a01ed280 con 0x7fb0a0150630 2023-12-08T20:55:07.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.682+0000 7fb0a7528640 1 -- 172.21.15.53:0/1575390014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a0157770 con 0x7fb0a0150630 2023-12-08T20:55:07.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:07.682+0000 7fb0a7528640 1 -- 172.21.15.53:0/1575390014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a01575d0 con 0x7fb0a0150630 2023-12-08T20:55:08.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.006+0000 7fb095ffb640 1 -- 172.21.15.53:0/1575390014 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb0900b7040 con 0x7fb0a0150630 2023-12-08T20:55:08.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.006+0000 7fb095ffb640 1 --2- 172.21.15.53:0/1575390014 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb0840664c0 0x7fb084068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:08.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.006+0000 7fb0a52c4640 1 --2- 172.21.15.53:0/1575390014 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb0840664c0 0x7fb084068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:08.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.010+0000 7fb0a52c4640 1 --2- 172.21.15.53:0/1575390014 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb0840664c0 0x7fb084068980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb09c000f70 tx=0x7fb09c0079e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:08.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.050+0000 7fb095ffb640 1 -- 172.21.15.53:0/1575390014 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb0900aee20 con 0x7fb0a0150630 2023-12-08T20:55:08.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.050+0000 7fb095ffb640 1 -- 172.21.15.53:0/1575390014 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0900ee970 con 0x7fb0a0150630 2023-12-08T20:55:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.226+0000 7fb0a7528640 1 -- 172.21.15.53:0/1575390014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0a01575d0 con 0x7fb0a0150630 2023-12-08T20:55:08.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.302+0000 7fb095ffb640 1 -- 172.21.15.53:0/1575390014 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fb0a01575d0 con 0x7fb0a0150630 2023-12-08T20:55:08.303 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:08.303 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:05.168215+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:55:08.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.306+0000 7fb0a7528640 1 -- 172.21.15.53:0/1575390014 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb0840664c0 msgr2=0x7fb084068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:08.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.306+0000 7fb0a7528640 1 --2- 172.21.15.53:0/1575390014 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb0840664c0 0x7fb084068980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb09c000f70 tx=0x7fb09c0079e0 comp rx=0 tx=0).stop 2023-12-08T20:55:08.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.306+0000 7fb0a7528640 1 -- 172.21.15.53:0/1575390014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0150630 msgr2=0x7fb0a00cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:08.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.306+0000 7fb0a7528640 1 --2- 172.21.15.53:0/1575390014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0150630 0x7fb0a00cb070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb09001c880 tx=0x7fb09001b9f0 comp rx=0 tx=0).stop 2023-12-08T20:55:08.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.306+0000 7fb0a7528640 1 -- 172.21.15.53:0/1575390014 shutdown_connections 2023-12-08T20:55:08.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.306+0000 7fb0a7528640 1 --2- 172.21.15.53:0/1575390014 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb0840664c0 0x7fb084068980 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:08.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.306+0000 7fb0a7528640 1 --2- 172.21.15.53:0/1575390014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0a01599e0 0x7fb0a0144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:08.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.306+0000 7fb0a7528640 1 --2- 172.21.15.53:0/1575390014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0150630 0x7fb0a00cb070 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:08.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.306+0000 7fb0a7528640 1 --2- 172.21.15.53:0/1575390014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0a006dff0 0x7fb0a0158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:08.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.306+0000 7fb0a7528640 1 -- 172.21.15.53:0/1575390014 >> 172.21.15.53:0/1575390014 conn(0x7fb0a00c8a00 msgr2=0x7fb0a014d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:08.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.306+0000 7fb0a7528640 1 -- 172.21.15.53:0/1575390014 shutdown_connections 2023-12-08T20:55:08.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.306+0000 7fb0a7528640 1 -- 172.21.15.53:0/1575390014 wait complete. 2023-12-08T20:55:08.345 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T20:55:08.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.474+0000 7f56b90df640 1 Processor -- start 2023-12-08T20:55:08.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.474+0000 7f56b90df640 1 -- start start 2023-12-08T20:55:08.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.474+0000 7f56b90df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56b4151350 0x7f56b4151730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:08.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.474+0000 7f56b90df640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56b40c7d20 0x7f56b40c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:08.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.474+0000 7f56b90df640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b40b0c50 con 0x7f56b40cceb0 2023-12-08T20:55:08.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.474+0000 7f56b90df640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b40b0380 con 0x7f56b40c7d20 2023-12-08T20:55:08.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.474+0000 7f56b90df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b40ca830 con 0x7f56b4151350 2023-12-08T20:55:08.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.478+0000 7f56b259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56b40c7d20 0x7f56b40c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:08.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.478+0000 7f56b259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56b40c7d20 0x7f56b40c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42742/0 (socket says 172.21.15.53:42742) 2023-12-08T20:55:08.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.478+0000 7f56b259c640 1 -- 172.21.15.53:0/4231834725 learned_addr learned my addr 172.21.15.53:0/4231834725 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:08.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.478+0000 7f56b2d9d640 1 --2- 172.21.15.53:0/4231834725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56b4151350 0x7f56b4151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:08.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.482+0000 7f56b259c640 1 -- 172.21.15.53:0/4231834725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56b4151350 msgr2=0x7f56b4151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:08.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.482+0000 7f56b259c640 1 --2- 172.21.15.53:0/4231834725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56b4151350 0x7f56b4151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:08.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.482+0000 7f56b259c640 1 -- 172.21.15.53:0/4231834725 >> v1:172.21.15.53:6789/0 conn(0x7f56b40cceb0 legacy=0x7f56b40c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:08.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.482+0000 7f56b259c640 1 -- 172.21.15.53:0/4231834725 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b40c26c0 con 0x7f56b40c7d20 2023-12-08T20:55:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.486+0000 7f56b259c640 1 --2- 172.21.15.53:0/4231834725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b40c7d20 0x7f56b40c97e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f569c009870 tx=0x7f569c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fed2c0598162e23 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:08.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.494+0000 7f56b1d9b640 1 -- 172.21.15.53:0/4231834725 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0aa430 con 0x7f56b40c7d20 2023-12-08T20:55:08.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.494+0000 7f56b1d9b640 1 -- 172.21.15.53:0/4231834725 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c0aa590 con 0x7f56b40c7d20 2023-12-08T20:55:08.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.494+0000 7f56b1d9b640 1 -- 172.21.15.53:0/4231834725 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0aa920 con 0x7f56b40c7d20 2023-12-08T20:55:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.494+0000 7f56b90df640 1 -- 172.21.15.53:0/4231834725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b40c7d20 msgr2=0x7f56b40c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.494+0000 7f56b90df640 1 --2- 172.21.15.53:0/4231834725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b40c7d20 0x7f56b40c97e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f569c009870 tx=0x7f569c01c4b0 comp rx=0 tx=0).stop 2023-12-08T20:55:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.494+0000 7f56b90df640 1 -- 172.21.15.53:0/4231834725 shutdown_connections 2023-12-08T20:55:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.494+0000 7f56b90df640 1 --2- 172.21.15.53:0/4231834725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b40c7d20 0x7f56b40c97e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.494+0000 7f56b90df640 1 --2- 172.21.15.53:0/4231834725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56b4151350 0x7f56b4151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.494+0000 7f56b90df640 1 -- 172.21.15.53:0/4231834725 >> 172.21.15.53:0/4231834725 conn(0x7f56b4060fd0 msgr2=0x7f56b40613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:08.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.494+0000 7f56b90df640 1 -- 172.21.15.53:0/4231834725 shutdown_connections 2023-12-08T20:55:08.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.494+0000 7f56b90df640 1 -- 172.21.15.53:0/4231834725 wait complete. 2023-12-08T20:55:08.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b90df640 1 Processor -- start 2023-12-08T20:55:08.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b90df640 1 -- start start 2023-12-08T20:55:08.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b90df640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56b40c7d20 0x7f56b41491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:08.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b90df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b40cceb0 0x7f56b4143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:08.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b90df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56b4151350 0x7f56b406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:08.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b90df640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b4147a50 con 0x7f56b40cceb0 2023-12-08T20:55:08.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b90df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b4149c70 con 0x7f56b4151350 2023-12-08T20:55:08.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b90df640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b4147770 con 0x7f56b40c7d20 2023-12-08T20:55:08.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b40cceb0 0x7f56b4143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:08.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b40cceb0 0x7f56b4143270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42758/0 (socket says 172.21.15.53:42758) 2023-12-08T20:55:08.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b259c640 1 -- 172.21.15.53:0/3324511480 learned_addr learned my addr 172.21.15.53:0/3324511480 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:08.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b2d9d640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56b40c7d20 0x7f56b41491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:08.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.498+0000 7f56b359e640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56b4151350 0x7f56b406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:08.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.502+0000 7f56b259c640 1 -- 172.21.15.53:0/3324511480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56b40c7d20 msgr2=0x7f56b41491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:08.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.502+0000 7f56b259c640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56b40c7d20 0x7f56b41491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:08.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.502+0000 7f56b259c640 1 -- 172.21.15.53:0/3324511480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56b4151350 msgr2=0x7f56b406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:08.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.502+0000 7f56b259c640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56b4151350 0x7f56b406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:08.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.502+0000 7f56b259c640 1 -- 172.21.15.53:0/3324511480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c0094d0 con 0x7f56b40cceb0 2023-12-08T20:55:08.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.506+0000 7f56b259c640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b40cceb0 0x7f56b4143270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f569c0ac040 tx=0x7f569c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:08.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.510+0000 7f56ab7fe640 1 -- 172.21.15.53:0/3324511480 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0aa430 con 0x7f56b40cceb0 2023-12-08T20:55:08.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.510+0000 7f56ab7fe640 1 -- 172.21.15.53:0/3324511480 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c0b3800 con 0x7f56b40cceb0 2023-12-08T20:55:08.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.510+0000 7f56ab7fe640 1 -- 172.21.15.53:0/3324511480 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0b3bb0 con 0x7f56b40cceb0 2023-12-08T20:55:08.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.510+0000 7f56b90df640 1 -- 172.21.15.53:0/3324511480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b41489c0 con 0x7f56b40cceb0 2023-12-08T20:55:08.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.510+0000 7f56b90df640 1 -- 172.21.15.53:0/3324511480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b40cb1a0 con 0x7f56b40cceb0 2023-12-08T20:55:08.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.510+0000 7f56b90df640 1 -- 172.21.15.53:0/3324511480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b4074190 con 0x7f56b40cceb0 2023-12-08T20:55:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.814+0000 7f56ab7fe640 1 -- 172.21.15.53:0/3324511480 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f569c0b3d10 con 0x7f56b40cceb0 2023-12-08T20:55:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.818+0000 7f56ab7fe640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f56940664f0 0x7f56940689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.818+0000 7f56b2d9d640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f56940664f0 0x7f56940689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:08.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.818+0000 7f56b2d9d640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f56940664f0 0x7f56940689b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009b60 tx=0x7f56a4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:08.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.854+0000 7f56ab7fe640 1 -- 172.21.15.53:0/3324511480 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f569c0ef750 con 0x7f56b40cceb0 2023-12-08T20:55:08.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:08.854+0000 7f56ab7fe640 1 -- 172.21.15.53:0/3324511480 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f569c0eba90 con 0x7f56b40cceb0 2023-12-08T20:55:09.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.058+0000 7f56b90df640 1 -- 172.21.15.53:0/3324511480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56b4148e70 con 0x7f56b40cceb0 2023-12-08T20:55:09.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.094+0000 7f56ab7fe640 1 -- 172.21.15.53:0/3324511480 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6498 (secure 0 0 0) 0x7f569c0ef0b0 con 0x7f56b40cceb0 2023-12-08T20:55:09.095 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:09.096 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6838/3541484412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3541484412},{"type":"v1","addr":"172.21.15.53:6838","nonce":3541484412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/2329639389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6837","nonce":2329639389},{"type":"v1","addr":"172.21.15.53:6839","nonce":2329639389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3938297948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3938297948},{"type":"v1","addr":"172.21.15.146:6833","nonce":3938297948}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2026540331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2026540331},{"type":"v1","addr":"172.21.15.146:6836","nonce":2026540331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/4236922545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4236922545},{"type":"v1","addr":"172.21.15.146:6837","nonce":4236922545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T20:54:56.254252+0000","modified":"2023-12-08T20:55:05.181353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6835/3454931938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3454931938},{"type":"v1","addr":"172.21.15.53:6835","nonce":3454931938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-08T20:55:09.096 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2023-12-08T20:55:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.098+0000 7f56b90df640 1 -- 172.21.15.53:0/3324511480 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f56940664f0 msgr2=0x7f56940689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.098+0000 7f56b90df640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f56940664f0 0x7f56940689b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009b60 tx=0x7f56a4009190 comp rx=0 tx=0).stop 2023-12-08T20:55:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.098+0000 7f56b90df640 1 -- 172.21.15.53:0/3324511480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b40cceb0 msgr2=0x7f56b4143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.098+0000 7f56b90df640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b40cceb0 0x7f56b4143270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f569c0ac040 tx=0x7f569c01acf0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.098+0000 7f56b90df640 1 -- 172.21.15.53:0/3324511480 shutdown_connections 2023-12-08T20:55:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.098+0000 7f56b90df640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f56940664f0 0x7f56940689b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.098+0000 7f56b90df640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56b4151350 0x7f56b406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.098+0000 7f56b90df640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b40cceb0 0x7f56b4143270 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.098+0000 7f56b90df640 1 --2- 172.21.15.53:0/3324511480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56b40c7d20 0x7f56b41491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.098+0000 7f56b90df640 1 -- 172.21.15.53:0/3324511480 >> 172.21.15.53:0/3324511480 conn(0x7f56b4060fd0 msgr2=0x7f56b414c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.098+0000 7f56b90df640 1 -- 172.21.15.53:0/3324511480 shutdown_connections 2023-12-08T20:55:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.098+0000 7f56b90df640 1 -- 172.21.15.53:0/3324511480 wait complete. 2023-12-08T20:55:09.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:55:09.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.250+0000 7f5c4fa53640 1 Processor -- start 2023-12-08T20:55:09.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.250+0000 7f5c4fa53640 1 -- start start 2023-12-08T20:55:09.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.250+0000 7f5c4fa53640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c4806a810 0x7f5c4806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:09.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.250+0000 7f5c4fa53640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4806abf0 0x7f5c4806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:09.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.250+0000 7f5c4fa53640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4815d3e0 con 0x7f5c4815d870 2023-12-08T20:55:09.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.250+0000 7f5c4fa53640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c480c1260 con 0x7f5c4806a810 2023-12-08T20:55:09.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.250+0000 7f5c4fa53640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4806dc00 con 0x7f5c4806abf0 2023-12-08T20:55:09.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.278+0000 7f5c4d7ef640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c4806a810 0x7f5c4806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:09.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.282+0000 7f5c4d7ef640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c4806a810 0x7f5c4806b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:52454/0 (socket says 172.21.15.53:52454) 2023-12-08T20:55:09.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.282+0000 7f5c4d7ef640 1 -- 172.21.15.53:0/2665705284 learned_addr learned my addr 172.21.15.53:0/2665705284 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:09.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.286+0000 7f5c4d7ef640 1 -- 172.21.15.53:0/2665705284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4806abf0 msgr2=0x7f5c4806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:09.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.286+0000 7f5c4d7ef640 1 --2- 172.21.15.53:0/2665705284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4806abf0 0x7f5c4806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.286+0000 7f5c4d7ef640 1 -- 172.21.15.53:0/2665705284 >> v1:172.21.15.53:6789/0 conn(0x7f5c4815d870 legacy=0x7f5c48153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:09.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.286+0000 7f5c4d7ef640 1 -- 172.21.15.53:0/2665705284 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c480c2ba0 con 0x7f5c4806a810 2023-12-08T20:55:09.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.290+0000 7f5c4d7ef640 1 --2- 172.21.15.53:0/2665705284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c4806a810 0x7f5c4806b120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009870 tx=0x7f5c4401ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=831fb65c217e1ca3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:09.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.298+0000 7f5c3ffff640 1 -- 172.21.15.53:0/2665705284 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440a89b0 con 0x7f5c4806a810 2023-12-08T20:55:09.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.298+0000 7f5c3ffff640 1 -- 172.21.15.53:0/2665705284 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c440a8b10 con 0x7f5c4806a810 2023-12-08T20:55:09.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.298+0000 7f5c3ffff640 1 -- 172.21.15.53:0/2665705284 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440a8ea0 con 0x7f5c4806a810 2023-12-08T20:55:09.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 -- 172.21.15.53:0/2665705284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c4806a810 msgr2=0x7f5c4806b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:09.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 --2- 172.21.15.53:0/2665705284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c4806a810 0x7f5c4806b120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009870 tx=0x7f5c4401ecf0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 -- 172.21.15.53:0/2665705284 shutdown_connections 2023-12-08T20:55:09.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 --2- 172.21.15.53:0/2665705284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4806abf0 0x7f5c4806d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 --2- 172.21.15.53:0/2665705284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c4806a810 0x7f5c4806b120 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 -- 172.21.15.53:0/2665705284 >> 172.21.15.53:0/2665705284 conn(0x7f5c480c8990 msgr2=0x7f5c480c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:09.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 -- 172.21.15.53:0/2665705284 shutdown_connections 2023-12-08T20:55:09.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 -- 172.21.15.53:0/2665705284 wait complete. 2023-12-08T20:55:09.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 Processor -- start 2023-12-08T20:55:09.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 -- start start 2023-12-08T20:55:09.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c4806a810 0x7f5c481e4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:09.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c4806abf0 0x7f5c481e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:09.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4815d870 0x7f5c481e2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:09.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c481f0290 con 0x7f5c4806abf0 2023-12-08T20:55:09.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c481ef430 con 0x7f5c4806a810 2023-12-08T20:55:09.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.302+0000 7f5c4fa53640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c481ef710 con 0x7f5c4815d870 2023-12-08T20:55:09.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.306+0000 7f5c4d7ef640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c4806a810 0x7f5c481e4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:09.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.306+0000 7f5c4dff0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4815d870 0x7f5c481e2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:09.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.306+0000 7f5c4dff0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4815d870 0x7f5c481e2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:43436/0 (socket says 172.21.15.53:43436) 2023-12-08T20:55:09.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.306+0000 7f5c4dff0640 1 -- 172.21.15.53:0/1254194025 learned_addr learned my addr 172.21.15.53:0/1254194025 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:09.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.310+0000 7f5c4d7ef640 1 -- 172.21.15.53:0/1254194025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4815d870 msgr2=0x7f5c481e2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:09.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.310+0000 7f5c4d7ef640 1 --2- 172.21.15.53:0/1254194025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4815d870 0x7f5c481e2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.310+0000 7f5c4d7ef640 1 -- 172.21.15.53:0/1254194025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c4806abf0 msgr2=0x7f5c481e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:09.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.310+0000 7f5c4d7ef640 1 --2- 172.21.15.53:0/1254194025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c4806abf0 0x7f5c481e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.310+0000 7f5c4d7ef640 1 -- 172.21.15.53:0/1254194025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c440094d0 con 0x7f5c4806a810 2023-12-08T20:55:09.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.314+0000 7f5c4d7ef640 1 --2- 172.21.15.53:0/1254194025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c4806a810 0x7f5c481e4380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c4806d2a0 tx=0x7f5c4401ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.326+0000 7f5c3dffb640 1 -- 172.21.15.53:0/1254194025 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440b9640 con 0x7f5c4806a810 2023-12-08T20:55:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.326+0000 7f5c3dffb640 1 -- 172.21.15.53:0/1254194025 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c440b97c0 con 0x7f5c4806a810 2023-12-08T20:55:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.326+0000 7f5c3dffb640 1 -- 172.21.15.53:0/1254194025 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440b9b70 con 0x7f5c4806a810 2023-12-08T20:55:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.326+0000 7f5c4fa53640 1 -- 172.21.15.53:0/1254194025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c481ef9f0 con 0x7f5c4806a810 2023-12-08T20:55:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.326+0000 7f5c4fa53640 1 -- 172.21.15.53:0/1254194025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c481effb0 con 0x7f5c4806a810 2023-12-08T20:55:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.326+0000 7f5c4fa53640 1 -- 172.21.15.53:0/1254194025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c480714e0 con 0x7f5c4806a810 2023-12-08T20:55:09.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.642+0000 7f5c3dffb640 1 -- 172.21.15.53:0/1254194025 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5c440b7070 con 0x7f5c4806a810 2023-12-08T20:55:09.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.642+0000 7f5c3dffb640 1 --2- 172.21.15.53:0/1254194025 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5c2c0664c0 0x7f5c2c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:09.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.646+0000 7f5c4cfee640 1 --2- 172.21.15.53:0/1254194025 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5c2c0664c0 0x7f5c2c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:09.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.646+0000 7f5c4cfee640 1 --2- 172.21.15.53:0/1254194025 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5c2c0664c0 0x7f5c2c068980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c481e3e70 tx=0x7f5c38006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:09.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.650+0000 7f5c3dffb640 1 -- 172.21.15.53:0/1254194025 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5c440a8950 con 0x7f5c4806a810 2023-12-08T20:55:09.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.674+0000 7f5c3dffb640 1 -- 172.21.15.53:0/1254194025 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c440ef9b0 con 0x7f5c4806a810 2023-12-08T20:55:09.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.850+0000 7f5c4fa53640 1 -- 172.21.15.53:0/1254194025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c480714e0 con 0x7f5c4806a810 2023-12-08T20:55:09.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.906+0000 7f5c3dffb640 1 -- 172.21.15.53:0/1254194025 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f5c440b5070 con 0x7f5c4806a810 2023-12-08T20:55:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:09.909 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:05.168215+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:55:09.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.910+0000 7f5c4fa53640 1 -- 172.21.15.53:0/1254194025 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5c2c0664c0 msgr2=0x7f5c2c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:09.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.910+0000 7f5c4fa53640 1 --2- 172.21.15.53:0/1254194025 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5c2c0664c0 0x7f5c2c068980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c481e3e70 tx=0x7f5c38006ca0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.910+0000 7f5c4fa53640 1 -- 172.21.15.53:0/1254194025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c4806a810 msgr2=0x7f5c481e4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:09.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.910+0000 7f5c4fa53640 1 --2- 172.21.15.53:0/1254194025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c4806a810 0x7f5c481e4380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c4806d2a0 tx=0x7f5c4401ba90 comp rx=0 tx=0).stop 2023-12-08T20:55:09.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.910+0000 7f5c4fa53640 1 -- 172.21.15.53:0/1254194025 shutdown_connections 2023-12-08T20:55:09.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.910+0000 7f5c4fa53640 1 --2- 172.21.15.53:0/1254194025 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5c2c0664c0 0x7f5c2c068980 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.910+0000 7f5c4fa53640 1 --2- 172.21.15.53:0/1254194025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4815d870 0x7f5c481e2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.910+0000 7f5c4fa53640 1 --2- 172.21.15.53:0/1254194025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c4806abf0 0x7f5c481e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.910+0000 7f5c4fa53640 1 --2- 172.21.15.53:0/1254194025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c4806a810 0x7f5c481e4380 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:09.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.910+0000 7f5c4fa53640 1 -- 172.21.15.53:0/1254194025 >> 172.21.15.53:0/1254194025 conn(0x7f5c480c8990 msgr2=0x7f5c480caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:09.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.910+0000 7f5c4fa53640 1 -- 172.21.15.53:0/1254194025 shutdown_connections 2023-12-08T20:55:09.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:09.910+0000 7f5c4fa53640 1 -- 172.21.15.53:0/1254194025 wait complete. 2023-12-08T20:55:10.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T20:54:56.254252+0000', 'modified': '2023-12-08T20:55:05.181353+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4258}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4258': {'gid': 4258, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.53:6835/3454931938', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 3454931938}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 3454931938}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-08T20:55:10.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T20:55:10.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-08T20:55:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.698+0000 7fbed53f7640 1 Processor -- start 2023-12-08T20:55:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.698+0000 7fbed53f7640 1 -- start start 2023-12-08T20:55:10.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.698+0000 7fbed53f7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbed006ed30 0x7fbed00c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.698+0000 7fbed53f7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbed0071140 0x7fbed0157290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.698+0000 7fbed53f7640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed0157e90 con 0x7fbed006f110 2023-12-08T20:55:10.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.698+0000 7fbed53f7640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed0158170 con 0x7fbed0071140 2023-12-08T20:55:10.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.698+0000 7fbed53f7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed015a920 con 0x7fbed006ed30 2023-12-08T20:55:10.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.702+0000 7fbecf7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbed0071140 0x7fbed0157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:10.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.702+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbed006ed30 0x7fbed00c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:10.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.702+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbed006ed30 0x7fbed00c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:43438/0 (socket says 172.21.15.53:43438) 2023-12-08T20:55:10.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.702+0000 7fbeceffd640 1 -- 172.21.15.53:0/2085501255 learned_addr learned my addr 172.21.15.53:0/2085501255 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.710+0000 7fbeceffd640 1 -- 172.21.15.53:0/2085501255 >> v2:172.21.15.146:3300/0 conn(0x7fbed0071140 msgr2=0x7fbed0157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.710+0000 7fbeceffd640 1 --2- 172.21.15.53:0/2085501255 >> v2:172.21.15.146:3300/0 conn(0x7fbed0071140 0x7fbed0157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.710+0000 7fbeceffd640 1 -- 172.21.15.53:0/2085501255 >> v1:172.21.15.146:6789/0 conn(0x7fbed006f110 legacy=0x7fbed006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.710+0000 7fbeceffd640 1 -- 172.21.15.53:0/2085501255 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed015ac00 con 0x7fbed006ed30 2023-12-08T20:55:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.722+0000 7fbeceffd640 1 --2- 172.21.15.53:0/2085501255 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbed006ed30 0x7fbed00c58f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009e50 tx=0x7fbec001f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bf93678bcea18bc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:10.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.834+0000 7fbecdffb640 1 -- 172.21.15.53:0/2085501255 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00af400 con 0x7fbed006ed30 2023-12-08T20:55:10.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.834+0000 7fbecdffb640 1 -- 172.21.15.53:0/2085501255 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec00ab050 con 0x7fbed006ed30 2023-12-08T20:55:10.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.834+0000 7fbecdffb640 1 -- 172.21.15.53:0/2085501255 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00af780 con 0x7fbed006ed30 2023-12-08T20:55:10.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.834+0000 7fbed53f7640 1 -- 172.21.15.53:0/2085501255 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbed006ed30 msgr2=0x7fbed00c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:10.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.834+0000 7fbed53f7640 1 --2- 172.21.15.53:0/2085501255 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbed006ed30 0x7fbed00c58f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009e50 tx=0x7fbec001f1c0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.834+0000 7fbed53f7640 1 -- 172.21.15.53:0/2085501255 shutdown_connections 2023-12-08T20:55:10.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.834+0000 7fbed53f7640 1 --2- 172.21.15.53:0/2085501255 >> v2:172.21.15.146:3300/0 conn(0x7fbed0071140 0x7fbed0157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.834+0000 7fbed53f7640 1 --2- 172.21.15.53:0/2085501255 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbed006ed30 0x7fbed00c58f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.834+0000 7fbed53f7640 1 -- 172.21.15.53:0/2085501255 >> 172.21.15.53:0/2085501255 conn(0x7fbed00caef0 msgr2=0x7fbed00cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:10.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.834+0000 7fbed53f7640 1 -- 172.21.15.53:0/2085501255 shutdown_connections 2023-12-08T20:55:10.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.834+0000 7fbed53f7640 1 -- 172.21.15.53:0/2085501255 wait complete. 2023-12-08T20:55:10.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.838+0000 7fbed53f7640 1 Processor -- start 2023-12-08T20:55:10.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.838+0000 7fbed53f7640 1 -- start start 2023-12-08T20:55:10.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.838+0000 7fbed53f7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbed006ed30 0x7fbed0151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.838+0000 7fbed53f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed006f110 0x7fbed006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.838+0000 7fbed53f7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbed0071140 0x7fbed01eef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.838+0000 7fbed53f7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0156f90 con 0x7fbed006f110 2023-12-08T20:55:10.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.838+0000 7fbed53f7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed01f31a0 con 0x7fbed006ed30 2023-12-08T20:55:10.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.838+0000 7fbed53f7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed00c4860 con 0x7fbed0071140 2023-12-08T20:55:10.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.842+0000 7fbece7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed006f110 0x7fbed006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:10.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.842+0000 7fbece7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed006f110 0x7fbed006d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42774/0 (socket says 172.21.15.53:42774) 2023-12-08T20:55:10.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.842+0000 7fbece7fc640 1 -- 172.21.15.53:0/978404687 learned_addr learned my addr 172.21.15.53:0/978404687 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:10.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.842+0000 7fbecf7fe640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbed0071140 0x7fbed01eef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:10.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.846+0000 7fbece7fc640 1 -- 172.21.15.53:0/978404687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbed0071140 msgr2=0x7fbed01eef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:10.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.846+0000 7fbece7fc640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbed0071140 0x7fbed01eef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.846+0000 7fbece7fc640 1 -- 172.21.15.53:0/978404687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbed006ed30 msgr2=0x7fbed0151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:10.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.846+0000 7fbece7fc640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbed006ed30 0x7fbed0151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.846+0000 7fbece7fc640 1 -- 172.21.15.53:0/978404687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec0009b30 con 0x7fbed006f110 2023-12-08T20:55:10.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.846+0000 7fbece7fc640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed006f110 0x7fbed006d7f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800c4b0 tx=0x7fbeb800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:10.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.854+0000 7fbec77fe640 1 -- 172.21.15.53:0/978404687 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8012830 con 0x7fbed006f110 2023-12-08T20:55:10.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.854+0000 7fbec77fe640 1 -- 172.21.15.53:0/978404687 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb80129b0 con 0x7fbed006f110 2023-12-08T20:55:10.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.854+0000 7fbec77fe640 1 -- 172.21.15.53:0/978404687 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8012d60 con 0x7fbed006f110 2023-12-08T20:55:10.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.854+0000 7fbed53f7640 1 -- 172.21.15.53:0/978404687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed00c3090 con 0x7fbed006f110 2023-12-08T20:55:10.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.854+0000 7fbed53f7640 1 -- 172.21.15.53:0/978404687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed00c4230 con 0x7fbed006f110 2023-12-08T20:55:10.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.858+0000 7fbed8527000 1 Processor -- start 2023-12-08T20:55:10.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.858+0000 7fbed8527000 1 -- start start 2023-12-08T20:55:10.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.858+0000 7fbed8527000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f88930 0x5641b1f88d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.858+0000 7fbed8527000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f8d9f0 0x5641b1f8ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.858+0000 7fbed8527000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 0x5641b1f8e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.858+0000 7fbed8527000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b1db7130 con 0x5641b1f8e310 2023-12-08T20:55:10.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.858+0000 7fbed8527000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b1da49a0 con 0x5641b1f88930 2023-12-08T20:55:10.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.858+0000 7fbed8527000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641b1da1ed0 con 0x5641b1f8d9f0 2023-12-08T20:55:10.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.858+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f88930 0x5641b1f88d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:10.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.862+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f88930 0x5641b1f88d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:52482/0 (socket says 172.21.15.53:52482) 2023-12-08T20:55:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.862+0000 7fbecf7fe640 1 -- 172.21.15.53:0/849339425 learned_addr learned my addr 172.21.15.53:0/849339425 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:10.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.862+0000 7fbeceffd640 1 --2- 172.21.15.53:0/849339425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f8d9f0 0x5641b1f8ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:10.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.866+0000 7fbecf7fe640 1 -- 172.21.15.53:0/849339425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f8d9f0 msgr2=0x5641b1f8ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:10.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.866+0000 7fbecf7fe640 1 --2- 172.21.15.53:0/849339425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f8d9f0 0x5641b1f8ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.866+0000 7fbecf7fe640 1 -- 172.21.15.53:0/849339425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 msgr2=0x5641b1f8e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:10.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.866+0000 7fbecf7fe640 1 --2- 172.21.15.53:0/849339425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 0x5641b1f8e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.866+0000 7fbecf7fe640 1 -- 172.21.15.53:0/849339425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641b1a95890 con 0x5641b1f88930 2023-12-08T20:55:10.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.870+0000 7fbecf7fe640 1 --2- 172.21.15.53:0/849339425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f88930 0x5641b1f88d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009b80 tx=0x7fbec8011690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5c38faa9d0e8e6b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:10.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.878+0000 7fbec77fe640 1 -- 172.21.15.53:0/978404687 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbeb801c460 con 0x7fbed006f110 2023-12-08T20:55:10.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.878+0000 7fbec77fe640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbeb40664c0 0x7fbeb4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.878+0000 7fbeceffd640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbeb40664c0 0x7fbeb4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:10.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.878+0000 7fbeceffd640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbeb40664c0 0x7fbeb4068980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbec00b1000 tx=0x7fbec0004ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.878+0000 7fbec77fe640 1 -- 172.21.15.53:0/978404687 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbeb8055560 con 0x7fbed006f110 2023-12-08T20:55:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbec4ff9640 1 -- 172.21.15.53:0/849339425 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8011ec0 con 0x5641b1f88930 2023-12-08T20:55:10.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbec4ff9640 1 -- 172.21.15.53:0/849339425 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec8009e80 con 0x5641b1f88930 2023-12-08T20:55:10.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbec4ff9640 1 -- 172.21.15.53:0/849339425 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8014640 con 0x5641b1f88930 2023-12-08T20:55:10.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 -- 172.21.15.53:0/849339425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f88930 msgr2=0x5641b1f88d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 --2- 172.21.15.53:0/849339425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f88930 0x5641b1f88d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009b80 tx=0x7fbec8011690 comp rx=0 tx=0).stop 2023-12-08T20:55:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 -- 172.21.15.53:0/849339425 shutdown_connections 2023-12-08T20:55:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 --2- 172.21.15.53:0/849339425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 0x5641b1f8e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 --2- 172.21.15.53:0/849339425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f8d9f0 0x5641b1f8ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 --2- 172.21.15.53:0/849339425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f88930 0x5641b1f88d10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 -- 172.21.15.53:0/849339425 >> 172.21.15.53:0/849339425 conn(0x5641b1f897a0 msgr2=0x5641b1f8bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 -- 172.21.15.53:0/849339425 shutdown_connections 2023-12-08T20:55:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 -- 172.21.15.53:0/849339425 wait complete. 2023-12-08T20:55:10.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 -- start start 2023-12-08T20:55:10.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 Processor -- start 2023-12-08T20:55:10.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f88930 0x5641b1f87d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f8d9f0 0x5641b1f88250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 0x5641b1f97990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b1d9d7c0 con 0x5641b1f8e310 2023-12-08T20:55:10.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b1d55bf0 con 0x5641b1f8d9f0 2023-12-08T20:55:10.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641b1d5ba90 con 0x5641b1f88930 2023-12-08T20:55:10.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbed8527000 10 client.0 _ll_register_callbacks cb 0x5641b1f383c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T20:55:10.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 0x5641b1f97990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:10.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 0x5641b1f97990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42782/0 (socket says 172.21.15.53:42782) 2023-12-08T20:55:10.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.882+0000 7fbecf7fe640 1 -- 172.21.15.53:0/647669799 learned_addr learned my addr 172.21.15.53:0/647669799 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:10.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.886+0000 7fbeceffd640 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f88930 0x5641b1f87d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:10.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.886+0000 7fbece7fc640 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f8d9f0 0x5641b1f88250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:10.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.886+0000 7fbecf7fe640 1 -- 172.21.15.53:0/647669799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f88930 msgr2=0x5641b1f87d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:10.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.886+0000 7fbecf7fe640 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f88930 0x5641b1f87d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.886+0000 7fbecf7fe640 1 -- 172.21.15.53:0/647669799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f8d9f0 msgr2=0x5641b1f88250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:10.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.886+0000 7fbecf7fe640 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f8d9f0 0x5641b1f88250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:10.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.886+0000 7fbecf7fe640 1 -- 172.21.15.53:0/647669799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec8009860 con 0x5641b1f8e310 2023-12-08T20:55:10.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.890+0000 7fbecf7fe640 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 0x5641b1f97990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbec8000c10 tx=0x7fbec8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65065c96f539b885 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:10.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.890+0000 7fbebdffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-12-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.894+0000 7fbebdffb640 1 -- 172.21.15.53:0/647669799 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8021050 con 0x5641b1f8e310 2023-12-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.894+0000 7fbebdffb640 1 -- 172.21.15.53:0/647669799 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbec80044f0 con 0x5641b1f8e310 2023-12-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.894+0000 7fbed8527000 1 -- 172.21.15.53:0/647669799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641b1d5f470 con 0x5641b1f8e310 2023-12-08T20:55:10.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.898+0000 7fbebdffb640 1 -- 172.21.15.53:0/647669799 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbec8003de0 con 0x5641b1f8e310 2023-12-08T20:55:10.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.898+0000 7fbed8527000 10 client.4305 fetch_fsmap learned FSMap version 7 2023-12-08T20:55:10.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.898+0000 7fbed8527000 1 -- 172.21.15.53:0/647669799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5641b1d5e190 con 0x5641b1f8e310 2023-12-08T20:55:10.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.902+0000 7fbebdffb640 1 -- 172.21.15.53:0/647669799 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641b1d5f470 con 0x5641b1f8e310 2023-12-08T20:55:10.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.902+0000 7fbebdffb640 1 -- 172.21.15.53:0/647669799 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fbec801b020 con 0x5641b1f8e310 2023-12-08T20:55:10.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.902+0000 7fbed8527000 10 client.4305 fetch_fsmap finished waiting for FSMap version 7 2023-12-08T20:55:10.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.902+0000 7fbed8527000 10 client.4305 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-08T20:55:10.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.902+0000 7fbed8527000 20 client.4305 populate_metadata read hostname 'smithi053' 2023-12-08T20:55:10.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.902+0000 7fbed8527000 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x5641b1f98640 0x5641b1f98a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:10.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.902+0000 7fbed8527000 4 client.4305 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T20:55:10.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.902+0000 7fbed8527000 1 -- 172.21.15.53:0/647669799 --> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641b1d62b50 con 0x5641b1f98640 2023-12-08T20:55:10.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:10.910+0000 7fbeceffd640 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x5641b1f98640 0x5641b1f98a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:11.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.002+0000 7fbeceffd640 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x5641b1f98640 0x5641b1f98a20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d8fe4accd9d530b server_cookie=f58cdcca0fb6fe66 in_seq=0 out_seq=0 2023-12-08T20:55:11.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.002+0000 7fbebdffb640 10 client.4305 ms_handle_connect on v2:172.21.15.53:6834/3454931938 2023-12-08T20:55:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbebdffb640 1 -- 172.21.15.53:0/647669799 <== mds.0 v2:172.21.15.53:6834/3454931938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5641b1d62b50 con 0x5641b1f98640 2023-12-08T20:55:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbebdffb640 10 client.4305 handle_command_reply: tid=0 2023-12-08T20:55:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbed8527000 1 client.4305 shutdown 2023-12-08T20:55:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbed8527000 1 -- 172.21.15.53:0/647669799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 msgr2=0x5641b1f97990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbed8527000 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 0x5641b1f97990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbec8000c10 tx=0x7fbec8004740 comp rx=0 tx=0).stop 2023-12-08T20:55:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbed8527000 1 -- 172.21.15.53:0/647669799 shutdown_connections 2023-12-08T20:55:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbed8527000 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x5641b1f98640 0x5641b1f98a20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbed8527000 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 0x5641b1f97990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbed8527000 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f8d9f0 0x5641b1f88250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbebdffb640 0 client.4305 ms_handle_reset on v2:172.21.15.53:6834/3454931938 2023-12-08T20:55:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbed8527000 1 --2- 172.21.15.53:0/647669799 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f88930 0x5641b1f87d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbed8527000 1 -- 172.21.15.53:0/647669799 >> 172.21.15.53:0/647669799 conn(0x5641b1f897a0 msgr2=0x5641b1f52ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbed8527000 1 -- 172.21.15.53:0/647669799 shutdown_connections 2023-12-08T20:55:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbed8527000 1 -- 172.21.15.53:0/647669799 wait complete. 2023-12-08T20:55:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.218+0000 7fbed8527000 20 client.4305 trim_cache size 0 max 16384 2023-12-08T20:55:11.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.270+0000 7fbed8527000 1 Processor -- start 2023-12-08T20:55:11.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.270+0000 7fbed8527000 1 -- start start 2023-12-08T20:55:11.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.270+0000 7fbed8527000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f88930 0x5641b1f8cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.270+0000 7fbed8527000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f8d9f0 0x5641b1f8d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.270+0000 7fbed8527000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 0x5641b1f98a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.274+0000 7fbed8527000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b1a56940 con 0x5641b1f8e310 2023-12-08T20:55:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.274+0000 7fbed8527000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b1d9c650 con 0x5641b1f88930 2023-12-08T20:55:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.274+0000 7fbed8527000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641b1e24fa0 con 0x5641b1f8d9f0 2023-12-08T20:55:11.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.274+0000 7fbece7fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f8d9f0 0x5641b1f8d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:11.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.274+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f88930 0x5641b1f8cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:11.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.274+0000 7fbece7fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f8d9f0 0x5641b1f8d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:59322/0 (socket says 172.21.15.53:59322) 2023-12-08T20:55:11.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.274+0000 7fbece7fc640 1 -- 172.21.15.53:0/749341903 learned_addr learned my addr 172.21.15.53:0/749341903 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:11.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.278+0000 7fbece7fc640 1 -- 172.21.15.53:0/749341903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f88930 msgr2=0x5641b1f8cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:11.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.278+0000 7fbece7fc640 1 --2- 172.21.15.53:0/749341903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f88930 0x5641b1f8cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.278+0000 7fbece7fc640 1 -- 172.21.15.53:0/749341903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 msgr2=0x5641b1f98a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:11.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.278+0000 7fbece7fc640 1 --2- 172.21.15.53:0/749341903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 0x5641b1f98a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.278+0000 7fbece7fc640 1 -- 172.21.15.53:0/749341903 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641b1d44490 con 0x5641b1f8d9f0 2023-12-08T20:55:11.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.286+0000 7fbece7fc640 1 --2- 172.21.15.53:0/749341903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f8d9f0 0x5641b1f8d0e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800c480 tx=0x7fbeb8014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d91650172b85d82 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:11.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.294+0000 7fbec57fa640 1 -- 172.21.15.53:0/749341903 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb805ccd0 con 0x5641b1f8d9f0 2023-12-08T20:55:11.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.294+0000 7fbec57fa640 1 -- 172.21.15.53:0/749341903 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb805ce30 con 0x5641b1f8d9f0 2023-12-08T20:55:11.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.294+0000 7fbec57fa640 1 -- 172.21.15.53:0/749341903 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb805cfa0 con 0x5641b1f8d9f0 2023-12-08T20:55:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.298+0000 7fbed8527000 1 -- 172.21.15.53:0/749341903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f8d9f0 msgr2=0x5641b1f8d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.298+0000 7fbed8527000 1 --2- 172.21.15.53:0/749341903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f8d9f0 0x5641b1f8d0e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800c480 tx=0x7fbeb8014040 comp rx=0 tx=0).stop 2023-12-08T20:55:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.298+0000 7fbed8527000 1 -- 172.21.15.53:0/749341903 shutdown_connections 2023-12-08T20:55:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.298+0000 7fbed8527000 1 --2- 172.21.15.53:0/749341903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8e310 0x5641b1f98a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.298+0000 7fbed8527000 1 --2- 172.21.15.53:0/749341903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f8d9f0 0x5641b1f8d0e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.298+0000 7fbed8527000 1 --2- 172.21.15.53:0/749341903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f88930 0x5641b1f8cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.298+0000 7fbed8527000 1 -- 172.21.15.53:0/749341903 >> 172.21.15.53:0/749341903 conn(0x5641b1f897a0 msgr2=0x5641b1f97640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.298+0000 7fbed8527000 1 -- 172.21.15.53:0/749341903 shutdown_connections 2023-12-08T20:55:11.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.298+0000 7fbed8527000 1 -- 172.21.15.53:0/749341903 wait complete. 2023-12-08T20:55:11.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.298+0000 7fbed8527000 1 -- start start 2023-12-08T20:55:11.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.298+0000 7fbed8527000 1 Processor -- start 2023-12-08T20:55:11.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.302+0000 7fbed8527000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f88930 0x5641b1fed220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.302+0000 7fbed8527000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8d9f0 0x5641b1fed760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.302+0000 7fbed8527000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f8e310 0x5641b1f4f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.302+0000 7fbed8527000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b1a961b0 con 0x5641b1f8d9f0 2023-12-08T20:55:11.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.302+0000 7fbed8527000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b1d9abc0 con 0x5641b1f8e310 2023-12-08T20:55:11.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.302+0000 7fbed8527000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641b1ddf140 con 0x5641b1f88930 2023-12-08T20:55:11.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.302+0000 7fbed8527000 10 client.0 _ll_register_callbacks cb 0x5641b1f18bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T20:55:11.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.302+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f88930 0x5641b1fed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:11.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.302+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f8e310 0x5641b1f4f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:11.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.302+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f88930 0x5641b1fed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:59324/0 (socket says 172.21.15.53:59324) 2023-12-08T20:55:11.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.302+0000 7fbeceffd640 1 -- 172.21.15.53:0/2636433791 learned_addr learned my addr 172.21.15.53:0/2636433791 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:11.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.310+0000 7fbeceffd640 1 -- 172.21.15.53:0/2636433791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f8e310 msgr2=0x5641b1f4f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:11.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.310+0000 7fbeceffd640 1 --2- 172.21.15.53:0/2636433791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f8e310 0x5641b1f4f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.310+0000 7fbeceffd640 1 -- 172.21.15.53:0/2636433791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8d9f0 msgr2=0x5641b1fed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:11.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.310+0000 7fbeceffd640 1 --2- 172.21.15.53:0/2636433791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8d9f0 0x5641b1fed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.310+0000 7fbeceffd640 1 -- 172.21.15.53:0/2636433791 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed00c4230 con 0x5641b1f88930 2023-12-08T20:55:11.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.318+0000 7fbeceffd640 1 --2- 172.21.15.53:0/2636433791 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f88930 0x5641b1fed220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009f40 tx=0x7fbec001da00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbc2092890c92cfd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:11.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.318+0000 7fbebdffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3301/0 2023-12-08T20:55:11.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.334+0000 7fbebdffb640 1 -- 172.21.15.53:0/2636433791 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00ce070 con 0x5641b1f88930 2023-12-08T20:55:11.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.334+0000 7fbebdffb640 1 -- 172.21.15.53:0/2636433791 <== mon.2 v2:172.21.15.146:3301/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbec00d3dd0 con 0x5641b1f88930 2023-12-08T20:55:11.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.334+0000 7fbed8527000 1 -- 172.21.15.53:0/2636433791 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641b1d9c110 con 0x5641b1f88930 2023-12-08T20:55:11.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.346+0000 7fbebdffb640 1 -- 172.21.15.53:0/2636433791 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbec00c95c0 con 0x5641b1f88930 2023-12-08T20:55:11.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.346+0000 7fbed8527000 10 client.4292 fetch_fsmap learned FSMap version 7 2023-12-08T20:55:11.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.346+0000 7fbed8527000 1 -- 172.21.15.53:0/2636433791 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5641b1a95cc0 con 0x5641b1f88930 2023-12-08T20:55:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.394+0000 7fbebdffb640 1 -- 172.21.15.53:0/2636433791 <== mon.2 v2:172.21.15.146:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641b1d9c110 con 0x5641b1f88930 2023-12-08T20:55:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.394+0000 7fbebdffb640 1 -- 172.21.15.53:0/2636433791 <== mon.2 v2:172.21.15.146:3301/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fbec00d9020 con 0x5641b1f88930 2023-12-08T20:55:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.394+0000 7fbed8527000 10 client.4292 fetch_fsmap finished waiting for FSMap version 7 2023-12-08T20:55:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.394+0000 7fbed8527000 10 client.4292 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-08T20:55:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.394+0000 7fbed8527000 20 client.4292 populate_metadata read hostname 'smithi053' 2023-12-08T20:55:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.394+0000 7fbed8527000 1 --2- 172.21.15.53:0/2636433791 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x5641b1ffa710 0x5641b1f4feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.394+0000 7fbed8527000 4 client.4292 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T20:55:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.394+0000 7fbed8527000 1 -- 172.21.15.53:0/2636433791 --> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5641b1dcb9a0 con 0x5641b1ffa710 2023-12-08T20:55:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.394+0000 7fbece7fc640 1 --2- 172.21.15.53:0/2636433791 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x5641b1ffa710 0x5641b1f4feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.398+0000 7fbebdffb640 10 client.4292 ms_handle_connect on v2:172.21.15.53:6834/3454931938 2023-12-08T20:55:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.398+0000 7fbece7fc640 1 --2- 172.21.15.53:0/2636433791 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x5641b1ffa710 0x5641b1f4feb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=288fe1bdda1be62e server_cookie=2aa11678c110d75b in_seq=0 out_seq=0 2023-12-08T20:55:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbebdffb640 1 -- 172.21.15.53:0/2636433791 <== mds.0 v2:172.21.15.53:6834/3454931938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5641b1dcb9a0 con 0x5641b1ffa710 2023-12-08T20:55:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbebdffb640 10 client.4292 handle_command_reply: tid=0 2023-12-08T20:55:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed8527000 1 client.4292 shutdown 2023-12-08T20:55:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed8527000 1 -- 172.21.15.53:0/2636433791 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f88930 msgr2=0x5641b1fed220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed8527000 1 --2- 172.21.15.53:0/2636433791 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f88930 0x5641b1fed220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009f40 tx=0x7fbec001da00 comp rx=0 tx=0).stop 2023-12-08T20:55:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed8527000 1 -- 172.21.15.53:0/2636433791 shutdown_connections 2023-12-08T20:55:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed8527000 1 --2- 172.21.15.53:0/2636433791 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x5641b1ffa710 0x5641b1f4feb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed8527000 1 --2- 172.21.15.53:0/2636433791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b1f8e310 0x5641b1f4f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed8527000 1 --2- 172.21.15.53:0/2636433791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641b1f8d9f0 0x5641b1fed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed8527000 1 --2- 172.21.15.53:0/2636433791 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5641b1f88930 0x5641b1fed220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbebdffb640 0 client.4292 ms_handle_reset on v2:172.21.15.53:6834/3454931938 2023-12-08T20:55:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed8527000 1 -- 172.21.15.53:0/2636433791 >> 172.21.15.53:0/2636433791 conn(0x5641b1f897a0 msgr2=0x5641b1f8cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed8527000 1 -- 172.21.15.53:0/2636433791 shutdown_connections 2023-12-08T20:55:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed8527000 1 -- 172.21.15.53:0/2636433791 wait complete. 2023-12-08T20:55:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed8527000 20 client.4292 trim_cache size 0 max 16384 2023-12-08T20:55:11.431 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-12-08T20:55:11.431 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "b118091f-f50b-41fe-890c-fae34a9e8e21", 2023-12-08T20:55:11.432 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-12-08T20:55:11.432 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4258, 2023-12-08T20:55:11.432 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-12-08T20:55:11.432 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-12-08T20:55:11.432 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-12-08T20:55:11.432 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 13.244340255999999, 2023-12-08T20:55:11.432 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 7, 2023-12-08T20:55:11.432 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 28, 2023-12-08T20:55:11.432 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 28, 2023-12-08T20:55:11.432 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 31.044846095 2023-12-08T20:55:11.432 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-12-08T20:55:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed53f7640 1 -- 172.21.15.53:0/978404687 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbeb40664c0 msgr2=0x7fbeb4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed53f7640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbeb40664c0 0x7fbeb4068980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbec00b1000 tx=0x7fbec0004ac0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed53f7640 1 -- 172.21.15.53:0/978404687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed006f110 msgr2=0x7fbed006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed53f7640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed006f110 0x7fbed006d7f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800c4b0 tx=0x7fbeb800c970 comp rx=0 tx=0).stop 2023-12-08T20:55:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed53f7640 1 -- 172.21.15.53:0/978404687 shutdown_connections 2023-12-08T20:55:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed53f7640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbeb40664c0 0x7fbeb4068980 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed53f7640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbed0071140 0x7fbed01eef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed53f7640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbed006f110 0x7fbed006d7f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed53f7640 1 --2- 172.21.15.53:0/978404687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbed006ed30 0x7fbed0151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed53f7640 1 -- 172.21.15.53:0/978404687 >> 172.21.15.53:0/978404687 conn(0x7fbed00caef0 msgr2=0x7fbed00715d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed53f7640 1 -- 172.21.15.53:0/978404687 shutdown_connections 2023-12-08T20:55:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.430+0000 7fbed53f7640 1 -- 172.21.15.53:0/978404687 wait complete. 2023-12-08T20:55:11.455 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T20:55:11.455 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-08T20:55:11.456 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T20:55:11.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.582+0000 7fe32f25c640 1 Processor -- start 2023-12-08T20:55:11.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.582+0000 7fe32f25c640 1 -- start start 2023-12-08T20:55:11.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.582+0000 7fe32f25c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3280ca2f0 0x7fe3280c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.582+0000 7fe32f25c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3280ceed0 0x7fe3280cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.582+0000 7fe32f25c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3280cb190 con 0x7fe328153910 2023-12-08T20:55:11.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.582+0000 7fe32f25c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3280ca120 con 0x7fe3280ca2f0 2023-12-08T20:55:11.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.582+0000 7fe32f25c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280cc2d0 con 0x7fe3280ceed0 2023-12-08T20:55:11.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.582+0000 7fe327fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3280ca2f0 0x7fe3280c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:11.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.582+0000 7fe32d7f9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3280ceed0 0x7fe3280cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:11.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.582+0000 7fe327fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3280ca2f0 0x7fe3280c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34728/0 (socket says 172.21.15.53:34728) 2023-12-08T20:55:11.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.582+0000 7fe327fff640 1 -- 172.21.15.53:0/1030989374 learned_addr learned my addr 172.21.15.53:0/1030989374 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:11.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.586+0000 7fe327fff640 1 -- 172.21.15.53:0/1030989374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3280ceed0 msgr2=0x7fe3280cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:11.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.586+0000 7fe327fff640 1 --2- 172.21.15.53:0/1030989374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3280ceed0 0x7fe3280cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.586+0000 7fe327fff640 1 -- 172.21.15.53:0/1030989374 >> v1:172.21.15.146:6789/0 conn(0x7fe328153910 legacy=0x7fe32815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:11.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.586+0000 7fe327fff640 1 -- 172.21.15.53:0/1030989374 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3280ca730 con 0x7fe3280ca2f0 2023-12-08T20:55:11.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.590+0000 7fe327fff640 1 --2- 172.21.15.53:0/1030989374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3280ca2f0 0x7fe3280c3e20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe314009870 tx=0x7fe31401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d00c29ca5d0b2ea server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:11.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe3277fe640 1 -- 172.21.15.53:0/1030989374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140a8a30 con 0x7fe3280ca2f0 2023-12-08T20:55:11.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe3277fe640 1 -- 172.21.15.53:0/1030989374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3140a8b90 con 0x7fe3280ca2f0 2023-12-08T20:55:11.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe3277fe640 1 -- 172.21.15.53:0/1030989374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140b0440 con 0x7fe3280ca2f0 2023-12-08T20:55:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 -- 172.21.15.53:0/1030989374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3280ca2f0 msgr2=0x7fe3280c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 --2- 172.21.15.53:0/1030989374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3280ca2f0 0x7fe3280c3e20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe314009870 tx=0x7fe31401ed30 comp rx=0 tx=0).stop 2023-12-08T20:55:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 -- 172.21.15.53:0/1030989374 shutdown_connections 2023-12-08T20:55:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 --2- 172.21.15.53:0/1030989374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3280ceed0 0x7fe3280cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 --2- 172.21.15.53:0/1030989374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3280ca2f0 0x7fe3280c3e20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 -- 172.21.15.53:0/1030989374 >> 172.21.15.53:0/1030989374 conn(0x7fe32808afc0 msgr2=0x7fe32808b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 -- 172.21.15.53:0/1030989374 shutdown_connections 2023-12-08T20:55:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 -- 172.21.15.53:0/1030989374 wait complete. 2023-12-08T20:55:11.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 Processor -- start 2023-12-08T20:55:11.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 -- start start 2023-12-08T20:55:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3280ca2f0 0x7fe3281f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3280ceed0 0x7fe3281f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe328153910 0x7fe3280b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3281f2850 con 0x7fe3280ca2f0 2023-12-08T20:55:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3281f2220 con 0x7fe3280ceed0 2023-12-08T20:55:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.598+0000 7fe32f25c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32815be70 con 0x7fe328153910 2023-12-08T20:55:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.602+0000 7fe32cff8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3280ca2f0 0x7fe3281f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.602+0000 7fe32cff8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3280ca2f0 0x7fe3281f0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34742/0 (socket says 172.21.15.53:34742) 2023-12-08T20:55:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.602+0000 7fe32cff8640 1 -- 172.21.15.53:0/3408687227 learned_addr learned my addr 172.21.15.53:0/3408687227 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.602+0000 7fe32d7f9640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe328153910 0x7fe3280b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.602+0000 7fe327fff640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3280ceed0 0x7fe3281f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:11.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.606+0000 7fe32cff8640 1 -- 172.21.15.53:0/3408687227 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe328153910 msgr2=0x7fe3280b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:11.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.606+0000 7fe32cff8640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe328153910 0x7fe3280b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.606+0000 7fe32cff8640 1 -- 172.21.15.53:0/3408687227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3280ceed0 msgr2=0x7fe3281f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:11.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.606+0000 7fe32cff8640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3280ceed0 0x7fe3281f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:11.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.606+0000 7fe32cff8640 1 -- 172.21.15.53:0/3408687227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3140094d0 con 0x7fe3280ca2f0 2023-12-08T20:55:11.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.610+0000 7fe32cff8640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3280ca2f0 0x7fe3281f0120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c500 tx=0x7fe31c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:11.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.614+0000 7fe3257fa640 1 -- 172.21.15.53:0/3408687227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c005220 con 0x7fe3280ca2f0 2023-12-08T20:55:11.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.614+0000 7fe3257fa640 1 -- 172.21.15.53:0/3408687227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c005380 con 0x7fe3280ca2f0 2023-12-08T20:55:11.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.614+0000 7fe3257fa640 1 -- 172.21.15.53:0/3408687227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c007270 con 0x7fe3280ca2f0 2023-12-08T20:55:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.614+0000 7fe32f25c640 1 -- 172.21.15.53:0/3408687227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32815c150 con 0x7fe3280ca2f0 2023-12-08T20:55:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.614+0000 7fe32f25c640 1 -- 172.21.15.53:0/3408687227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3281f24e0 con 0x7fe3280ca2f0 2023-12-08T20:55:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.614+0000 7fe32f25c640 1 -- 172.21.15.53:0/3408687227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3280b1db0 con 0x7fe3280ca2f0 2023-12-08T20:55:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.918+0000 7fe3257fa640 1 -- 172.21.15.53:0/3408687227 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe31c0073d0 con 0x7fe3280ca2f0 2023-12-08T20:55:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.922+0000 7fe3257fa640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe30c0664c0 0x7fe30c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.922+0000 7fe327fff640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe30c0664c0 0x7fe30c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:11.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.922+0000 7fe327fff640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe30c0664c0 0x7fe30c068980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3140b2000 tx=0x7fe314009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:11.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.962+0000 7fe3257fa640 1 -- 172.21.15.53:0/3408687227 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe31c007680 con 0x7fe3280ca2f0 2023-12-08T20:55:11.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:11.962+0000 7fe3257fa640 1 -- 172.21.15.53:0/3408687227 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe31c051960 con 0x7fe3280ca2f0 2023-12-08T20:55:12.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.170+0000 7fe32f25c640 1 -- 172.21.15.53:0/3408687227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe328072980 con 0x7fe3280ca2f0 2023-12-08T20:55:12.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.186+0000 7fe3257fa640 1 -- 172.21.15.53:0/3408687227 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe31c054f80 con 0x7fe3280ca2f0 2023-12-08T20:55:12.187 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-08T20:55:12.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.190+0000 7fe32f25c640 1 -- 172.21.15.53:0/3408687227 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe30c0664c0 msgr2=0x7fe30c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.190+0000 7fe32f25c640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe30c0664c0 0x7fe30c068980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3140b2000 tx=0x7fe314009040 comp rx=0 tx=0).stop 2023-12-08T20:55:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.190+0000 7fe32f25c640 1 -- 172.21.15.53:0/3408687227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3280ca2f0 msgr2=0x7fe3281f0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.190+0000 7fe32f25c640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3280ca2f0 0x7fe3281f0120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c500 tx=0x7fe31c00c9c0 comp rx=0 tx=0).stop 2023-12-08T20:55:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.190+0000 7fe32f25c640 1 -- 172.21.15.53:0/3408687227 shutdown_connections 2023-12-08T20:55:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.190+0000 7fe32f25c640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe30c0664c0 0x7fe30c068980 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.190+0000 7fe32f25c640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe328153910 0x7fe3280b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.190+0000 7fe32f25c640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3280ceed0 0x7fe3281f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.190+0000 7fe32f25c640 1 --2- 172.21.15.53:0/3408687227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3280ca2f0 0x7fe3281f0120 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.190+0000 7fe32f25c640 1 -- 172.21.15.53:0/3408687227 >> 172.21.15.53:0/3408687227 conn(0x7fe32808afc0 msgr2=0x7fe328151be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.190+0000 7fe32f25c640 1 -- 172.21.15.53:0/3408687227 shutdown_connections 2023-12-08T20:55:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:12.190+0000 7fe32f25c640 1 -- 172.21.15.53:0/3408687227 wait complete. 2023-12-08T20:55:12.207 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T20:55:12.208 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T20:55:12.208 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-12-08T20:55:12.208 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-08T20:55:12.208 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-08T20:55:12.208 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T20:55:12.208 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T20:55:12.208 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T20:55:12.208 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-08T20:55:12.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:12.208 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-12-08T20:55:12.214 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T20:55:12.214 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T20:55:12.214 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T20:55:12.214 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:55:12.214 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-12-08T20:55:12.214 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:55:12.214 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42076sec preferred_lft 42076sec 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-12-08T20:55:12.215 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-12-08T20:55:12.216 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T20:55:12.216 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:7e:62:58:1a brd ff:ff:ff:ff:ff:ff 2023-12-08T20:55:12.216 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T20:55:12.216 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:55:12.216 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-08T20:55:12.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:12.217 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-12-08T20:55:12.217 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-12-08T20:55:12.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add name ceph-brx type bridge 2023-12-08T20:55:12.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr flush dev ceph-brx 2023-12-08T20:55:12.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set ceph-brx up 2023-12-08T20:55:12.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-08T20:55:12.217 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-12-08T20:55:12.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:12.298 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T20:55:12.350 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-12-08T20:55:12.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:12.351 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-12-08T20:55:12.417 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-12-08T20:55:12.417 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T20:55:12.417 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-08T20:55:12.417 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T20:55:12.417 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-08T20:55:12.417 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T20:55:12.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:12.418 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-12-08T20:55:12.418 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-12-08T20:55:12.418 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T20:55:12.418 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T20:55:12.418 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T20:55:12.418 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-12-08T20:55:12.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:12.491 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-12-08T20:55:12.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:12.538 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2023-12-08T20:55:12.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:12.585 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-12-08T20:55:12.586 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-12-08T20:55:12.586 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T20:55:12.586 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-08T20:55:12.586 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-12-08T20:55:12.656 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-08T20:55:12.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:12.657 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-12-08T20:55:12.657 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-12-08T20:55:12.657 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-08T20:55:12.657 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-08T20:55:12.657 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-08T20:55:12.657 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-08T20:55:12.658 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-08T20:55:12.658 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-12-08T20:55:12.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:12.766 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-12-08T20:55:12.767 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-12-08T20:55:12.767 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-12-08T20:55:12.767 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.0 master ceph-brx 2023-12-08T20:55:12.767 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-12-08T20:55:12.786 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-08T20:55:12.786 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T20:55:12.786 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-08T20:55:12.834 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-08T20:55:12.835 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T20:55:12.835 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-08T20:55:12.880 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-12-08T20:55:12.938 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T20:55:12.988 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2023-12-08T20:55:12.988 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2023-12-08T20:55:12.988 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2023-12-08T20:55:12.988 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2023-12-08T20:55:12.988 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2023-12-08T20:55:12.988 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2023-12-08T20:55:12.988 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2023-12-08T20:55:12.988 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2023-12-08T20:55:12.988 INFO:teuthology.orchestra.run.smithi053.stdout:/run/lock 2023-12-08T20:55:12.988 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/fs/nfsd 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/run/rpc_pipefs 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2023-12-08T20:55:12.989 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2023-12-08T20:55:12.990 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T20:55:12.990 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T20:55:12.990 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T20:55:12.990 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T20:55:12.990 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2023-12-08T20:55:12.990 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T20:55:12.990 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T20:55:12.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:12.991 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-12-08T20:55:13.041 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-08T20:55:13.042 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-08T20:55:13.086 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-12-08T20:55:13.101 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T20:55:13.150 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2023-12-08T20:55:13.150 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2023-12-08T20:55:13.150 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2023-12-08T20:55:13.150 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2023-12-08T20:55:13.150 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/run/lock 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/fs/nfsd 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2023-12-08T20:55:13.151 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2023-12-08T20:55:13.152 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2023-12-08T20:55:13.152 INFO:teuthology.orchestra.run.smithi053.stdout:/run/rpc_pipefs 2023-12-08T20:55:13.152 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2023-12-08T20:55:13.152 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2023-12-08T20:55:13.152 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T20:55:13.152 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T20:55:13.152 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T20:55:13.152 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T20:55:13.152 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2023-12-08T20:55:13.152 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T20:55:13.152 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T20:55:13.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:13.153 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-12-08T20:55:13.184 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi053.stderr:2023-12-08T20:55:13.182+0000 7fb0e5ff3580 -1 init, newargv = 0x55fcab3bd460 newargc=15 2023-12-08T20:55:13.184 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi053.stderr:ceph-fuse[42964]: starting ceph client 2023-12-08T20:55:13.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi053.stderr:ceph-fuse[42964]: starting fuse 2023-12-08T20:55:14.289 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-12-08T20:55:14.307 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T20:55:14.354 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2023-12-08T20:55:14.354 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/run/lock 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2023-12-08T20:55:14.355 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/fs/nfsd 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/run/rpc_pipefs 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T20:55:14.356 INFO:teuthology.orchestra.run.smithi053.stdout:/home/ubuntu/cephtest/mnt.admin 2023-12-08T20:55:14.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:14.358 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-12-08T20:55:14.405 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-12-08T20:55:14.406 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-12-08T20:55:14.406 DEBUG:teuthology.orchestra.run.smithi053:> sudo stdin-killer -- python3 -c ' 2023-12-08T20:55:14.406 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-12-08T20:55:14.406 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-12-08T20:55:14.406 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-12-08T20:55:14.406 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-12-08T20:55:14.406 DEBUG:teuthology.orchestra.run.smithi053:> 2023-12-08T20:55:14.406 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-12-08T20:55:14.406 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-08T20:55:14.406 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-12-08T20:55:14.406 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-08T20:55:14.406 DEBUG:teuthology.orchestra.run.smithi053:> 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.admin")) 2023-12-08T20:55:14.407 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-12-08T20:55:14.534 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.admin.42964.asok 2023-12-08T20:55:14.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T20:55:14.547 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42964.asok 2023-12-08T20:55:14.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:14.547 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42964.asok status 2023-12-08T20:55:14.707 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-12-08T20:55:14.707 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "9dcc13bb80dcc1cdea72b04d80505b4649a2b882", 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)", 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "admin", 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "42964", 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4317, 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-12-08T20:55:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 4317 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1682839094 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1682839094 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-12-08T20:55:14.709 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.4317 192.168.0.1:0/1682839094", 2023-12-08T20:55:14.710 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/1682839094", 2023-12-08T20:55:14.710 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-12-08T20:55:14.710 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 7, 2023-12-08T20:55:14.710 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 28, 2023-12-08T20:55:14.710 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-12-08T20:55:14.710 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-12-08T20:55:14.710 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-12-08T20:55:14.710 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-12-08T20:55:14.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:14.721 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-12-08T20:55:14.721 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-08T20:55:14.757 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-12-08T20:55:14.757 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-08T20:55:14.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:14.757 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-08T20:55:14.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:14.923 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-08T20:55:15.274 INFO:teuthology.orchestra.run.smithi053.stdout:# file: . 2023-12-08T20:55:15.275 INFO:teuthology.orchestra.run.smithi053.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-08T20:55:15.275 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:15.276 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:55:15.276 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T20:55:15.284 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:55:15.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.462+0000 7f34eb73f640 1 Processor -- start 2023-12-08T20:55:15.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.462+0000 7f34eb73f640 1 -- start start 2023-12-08T20:55:15.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.462+0000 7f34eb73f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34e4151770 0x7f34e40ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:15.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.462+0000 7f34eb73f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e40c8e60 0x7f34e40b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:15.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.462+0000 7f34eb73f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e40c9fd0 con 0x7f34e415b400 2023-12-08T20:55:15.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.462+0000 7f34eb73f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e40b0920 con 0x7f34e4151770 2023-12-08T20:55:15.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.462+0000 7f34eb73f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40cd9b0 con 0x7f34e40c8e60 2023-12-08T20:55:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.566+0000 7f34e94db640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34e4151770 0x7f34e40ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.570+0000 7f34e94db640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34e4151770 0x7f34e40ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:41102/0 (socket says 172.21.15.53:41102) 2023-12-08T20:55:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.570+0000 7f34e94db640 1 -- 172.21.15.53:0/3913640177 learned_addr learned my addr 172.21.15.53:0/3913640177 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:15.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.578+0000 7f34e9cdc640 1 --2- 172.21.15.53:0/3913640177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e40c8e60 0x7f34e40b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:15.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.578+0000 7f34e94db640 1 -- 172.21.15.53:0/3913640177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e40c8e60 msgr2=0x7f34e40b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:15.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.578+0000 7f34e94db640 1 --2- 172.21.15.53:0/3913640177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e40c8e60 0x7f34e40b0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:15.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.578+0000 7f34e94db640 1 -- 172.21.15.53:0/3913640177 >> v1:172.21.15.146:6789/0 conn(0x7f34e415b400 legacy=0x7f34e40cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:15.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.578+0000 7f34e94db640 1 -- 172.21.15.53:0/3913640177 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e415b920 con 0x7f34e4151770 2023-12-08T20:55:15.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.594+0000 7f34e94db640 1 --2- 172.21.15.53:0/3913640177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4151770 0x7f34e40ca460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009870 tx=0x7f34d401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ad8775c67a93034 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.610+0000 7f34dbfff640 1 -- 172.21.15.53:0/3913640177 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d40aa670 con 0x7f34e4151770 2023-12-08T20:55:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.610+0000 7f34dbfff640 1 -- 172.21.15.53:0/3913640177 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d40aa7d0 con 0x7f34e4151770 2023-12-08T20:55:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.610+0000 7f34dbfff640 1 -- 172.21.15.53:0/3913640177 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d40aab60 con 0x7f34e4151770 2023-12-08T20:55:15.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.614+0000 7f34eb73f640 1 -- 172.21.15.53:0/3913640177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4151770 msgr2=0x7f34e40ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:15.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.614+0000 7f34eb73f640 1 --2- 172.21.15.53:0/3913640177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4151770 0x7f34e40ca460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009870 tx=0x7f34d401c510 comp rx=0 tx=0).stop 2023-12-08T20:55:15.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.614+0000 7f34eb73f640 1 -- 172.21.15.53:0/3913640177 shutdown_connections 2023-12-08T20:55:15.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.614+0000 7f34eb73f640 1 --2- 172.21.15.53:0/3913640177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e40c8e60 0x7f34e40b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:15.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.614+0000 7f34eb73f640 1 --2- 172.21.15.53:0/3913640177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4151770 0x7f34e40ca460 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:15.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.614+0000 7f34eb73f640 1 -- 172.21.15.53:0/3913640177 >> 172.21.15.53:0/3913640177 conn(0x7f34e4070c20 msgr2=0x7f34e4071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:15.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.614+0000 7f34eb73f640 1 -- 172.21.15.53:0/3913640177 shutdown_connections 2023-12-08T20:55:15.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.614+0000 7f34eb73f640 1 -- 172.21.15.53:0/3913640177 wait complete. 2023-12-08T20:55:15.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.614+0000 7f34eb73f640 1 Processor -- start 2023-12-08T20:55:15.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.614+0000 7f34eb73f640 1 -- start start 2023-12-08T20:55:15.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.618+0000 7f34eb73f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e40c8e60 0x7f34e4160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:15.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.618+0000 7f34eb73f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4151770 0x7f34e41f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:15.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.618+0000 7f34eb73f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34e415b400 0x7f34e414bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:15.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.618+0000 7f34eb73f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e414cc80 con 0x7f34e415b400 2023-12-08T20:55:15.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.618+0000 7f34eb73f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41520c0 con 0x7f34e4151770 2023-12-08T20:55:15.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.618+0000 7f34eb73f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41f2d10 con 0x7f34e40c8e60 2023-12-08T20:55:15.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.618+0000 7f34e94db640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e40c8e60 0x7f34e4160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:15.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.622+0000 7f34e94db640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e40c8e60 0x7f34e4160f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:59360/0 (socket says 172.21.15.53:59360) 2023-12-08T20:55:15.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.622+0000 7f34e94db640 1 -- 172.21.15.53:0/3882278318 learned_addr learned my addr 172.21.15.53:0/3882278318 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:15.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.622+0000 7f34e8cda640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4151770 0x7f34e41f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:15.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.634+0000 7f34e94db640 1 -- 172.21.15.53:0/3882278318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4151770 msgr2=0x7f34e41f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:15.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.634+0000 7f34e94db640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4151770 0x7f34e41f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:15.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.634+0000 7f34e94db640 1 -- 172.21.15.53:0/3882278318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34e415b400 msgr2=0x7f34e414bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:15.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.634+0000 7f34e94db640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34e415b400 0x7f34e414bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:15.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.634+0000 7f34e94db640 1 -- 172.21.15.53:0/3882278318 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d40094d0 con 0x7f34e40c8e60 2023-12-08T20:55:15.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.642+0000 7f34e94db640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e40c8e60 0x7f34e4160f70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f34d401a140 tx=0x7f34d401ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:15.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.650+0000 7f34d9ffb640 1 -- 172.21.15.53:0/3882278318 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d40b3800 con 0x7f34e40c8e60 2023-12-08T20:55:15.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.650+0000 7f34d9ffb640 1 -- 172.21.15.53:0/3882278318 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d40b3960 con 0x7f34e40c8e60 2023-12-08T20:55:15.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.650+0000 7f34eb73f640 1 -- 172.21.15.53:0/3882278318 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e4161be0 con 0x7f34e40c8e60 2023-12-08T20:55:15.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.650+0000 7f34d9ffb640 1 -- 172.21.15.53:0/3882278318 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d40b3d10 con 0x7f34e40c8e60 2023-12-08T20:55:15.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.650+0000 7f34eb73f640 1 -- 172.21.15.53:0/3882278318 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e4161900 con 0x7f34e40c8e60 2023-12-08T20:55:15.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:15.654+0000 7f34eb73f640 1 -- 172.21.15.53:0/3882278318 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e414cdc0 con 0x7f34e40c8e60 2023-12-08T20:55:16.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.058+0000 7f34d9ffb640 1 -- 172.21.15.53:0/3882278318 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f34d40c6390 con 0x7f34e40c8e60 2023-12-08T20:55:16.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.058+0000 7f34d9ffb640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f34c80664c0 0x7f34c8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:16.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.058+0000 7f34e8cda640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f34c80664c0 0x7f34c8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:16.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.062+0000 7f34e8cda640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f34c80664c0 0x7f34c8068980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f34e40c39d0 tx=0x7f34e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:16.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.066+0000 7f34d9ffb640 1 -- 172.21.15.53:0/3882278318 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f34d40efda0 con 0x7f34e40c8e60 2023-12-08T20:55:16.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.098+0000 7f34d9ffb640 1 -- 172.21.15.53:0/3882278318 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34d40ec0e0 con 0x7f34e40c8e60 2023-12-08T20:55:16.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.278+0000 7f34eb73f640 1 -- 172.21.15.53:0/3882278318 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34e414cdc0 con 0x7f34e40c8e60 2023-12-08T20:55:16.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34d9ffb640 1 -- 172.21.15.53:0/3882278318 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f34e414cdc0 con 0x7f34e40c8e60 2023-12-08T20:55:16.465 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:16.466 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:05.168215+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:55:16.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34eb73f640 1 -- 172.21.15.53:0/3882278318 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f34c80664c0 msgr2=0x7f34c8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:16.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34eb73f640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f34c80664c0 0x7f34c8068980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f34e40c39d0 tx=0x7f34e0009040 comp rx=0 tx=0).stop 2023-12-08T20:55:16.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34eb73f640 1 -- 172.21.15.53:0/3882278318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e40c8e60 msgr2=0x7f34e4160f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:16.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34eb73f640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e40c8e60 0x7f34e4160f70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f34d401a140 tx=0x7f34d401ad50 comp rx=0 tx=0).stop 2023-12-08T20:55:16.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34eb73f640 1 -- 172.21.15.53:0/3882278318 shutdown_connections 2023-12-08T20:55:16.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34eb73f640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f34c80664c0 0x7f34c8068980 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:16.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34eb73f640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34e415b400 0x7f34e414bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:16.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34eb73f640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4151770 0x7f34e41f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:16.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34eb73f640 1 --2- 172.21.15.53:0/3882278318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e40c8e60 0x7f34e4160f70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:16.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34eb73f640 1 -- 172.21.15.53:0/3882278318 >> 172.21.15.53:0/3882278318 conn(0x7f34e4070c20 msgr2=0x7f34e40cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:16.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34eb73f640 1 -- 172.21.15.53:0/3882278318 shutdown_connections 2023-12-08T20:55:16.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.466+0000 7f34eb73f640 1 -- 172.21.15.53:0/3882278318 wait complete. 2023-12-08T20:55:16.492 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T20:54:13.707275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T20:54:52.929484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T20:54:54.529440+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T20:55:01.908380+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T20:55:16.493 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T20:55:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.630+0000 7fa5fd614640 1 Processor -- start 2023-12-08T20:55:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.630+0000 7fa5fd614640 1 -- start start 2023-12-08T20:55:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.630+0000 7fa5fd614640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5f81518f0 0x7fa5f806a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.630+0000 7fa5fd614640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa5f80c77a0 0x7fa5f806aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.630+0000 7fa5fd614640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f80c6c00 con 0x7fa5f80c94b0 2023-12-08T20:55:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.630+0000 7fa5fd614640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f80c3920 con 0x7fa5f80c77a0 2023-12-08T20:55:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.630+0000 7fa5fd614640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f80c41b0 con 0x7fa5f81518f0 2023-12-08T20:55:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.630+0000 7fa5f77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa5f80c77a0 0x7fa5f806aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.630+0000 7fa5f77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa5f80c77a0 0x7fa5f806aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34762/0 (socket says 172.21.15.53:34762) 2023-12-08T20:55:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.630+0000 7fa5f77fe640 1 -- 172.21.15.53:0/2278082534 learned_addr learned my addr 172.21.15.53:0/2278082534 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.630+0000 7fa5f6ffd640 1 --2- 172.21.15.53:0/2278082534 >> v2:172.21.15.146:3300/0 conn(0x7fa5f81518f0 0x7fa5f806a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.634+0000 7fa5f77fe640 1 -- 172.21.15.53:0/2278082534 >> v2:172.21.15.146:3300/0 conn(0x7fa5f81518f0 msgr2=0x7fa5f806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.634+0000 7fa5f77fe640 1 --2- 172.21.15.53:0/2278082534 >> v2:172.21.15.146:3300/0 conn(0x7fa5f81518f0 0x7fa5f806a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.634+0000 7fa5f77fe640 1 -- 172.21.15.53:0/2278082534 >> v1:172.21.15.53:6789/0 conn(0x7fa5f80c94b0 legacy=0x7fa5f80c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.634+0000 7fa5f77fe640 1 -- 172.21.15.53:0/2278082534 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8151cd0 con 0x7fa5f80c77a0 2023-12-08T20:55:16.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.638+0000 7fa5f77fe640 1 --2- 172.21.15.53:0/2278082534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5f80c77a0 0x7fa5f806aaf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa5f806f440 tx=0x7fa5e001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1678bb68483ec8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:16.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5f5ffb640 1 -- 172.21.15.53:0/2278082534 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00ad680 con 0x7fa5f80c77a0 2023-12-08T20:55:16.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5f5ffb640 1 -- 172.21.15.53:0/2278082534 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e00ad7e0 con 0x7fa5f80c77a0 2023-12-08T20:55:16.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5f5ffb640 1 -- 172.21.15.53:0/2278082534 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00adb70 con 0x7fa5f80c77a0 2023-12-08T20:55:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 -- 172.21.15.53:0/2278082534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5f80c77a0 msgr2=0x7fa5f806aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 --2- 172.21.15.53:0/2278082534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5f80c77a0 0x7fa5f806aaf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa5f806f440 tx=0x7fa5e001c470 comp rx=0 tx=0).stop 2023-12-08T20:55:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 -- 172.21.15.53:0/2278082534 shutdown_connections 2023-12-08T20:55:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 --2- 172.21.15.53:0/2278082534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5f80c77a0 0x7fa5f806aaf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 --2- 172.21.15.53:0/2278082534 >> v2:172.21.15.146:3300/0 conn(0x7fa5f81518f0 0x7fa5f806a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 -- 172.21.15.53:0/2278082534 >> 172.21.15.53:0/2278082534 conn(0x7fa5f80c8990 msgr2=0x7fa5f80c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 -- 172.21.15.53:0/2278082534 shutdown_connections 2023-12-08T20:55:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 -- 172.21.15.53:0/2278082534 wait complete. 2023-12-08T20:55:16.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 Processor -- start 2023-12-08T20:55:16.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 -- start start 2023-12-08T20:55:16.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5f80c77a0 0x7fa5f814c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:16.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5f80c94b0 0x7fa5f813e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:16.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5f81518f0 0x7fa5f81444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:16.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f813da60 con 0x7fa5f80c94b0 2023-12-08T20:55:16.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81440b0 con 0x7fa5f81518f0 2023-12-08T20:55:16.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.646+0000 7fa5fd614640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8138600 con 0x7fa5f80c77a0 2023-12-08T20:55:16.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.650+0000 7fa5f67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5f80c94b0 0x7fa5f813e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:16.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.650+0000 7fa5f67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5f80c94b0 0x7fa5f813e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34766/0 (socket says 172.21.15.53:34766) 2023-12-08T20:55:16.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.650+0000 7fa5f67fc640 1 -- 172.21.15.53:0/1146529744 learned_addr learned my addr 172.21.15.53:0/1146529744 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:16.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.650+0000 7fa5f6ffd640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5f80c77a0 0x7fa5f814c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:16.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.650+0000 7fa5f77fe640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5f81518f0 0x7fa5f81444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:16.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.654+0000 7fa5f67fc640 1 -- 172.21.15.53:0/1146529744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5f80c77a0 msgr2=0x7fa5f814c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:16.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.654+0000 7fa5f67fc640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5f80c77a0 0x7fa5f814c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:16.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.654+0000 7fa5f67fc640 1 -- 172.21.15.53:0/1146529744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5f81518f0 msgr2=0x7fa5f81444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:16.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.654+0000 7fa5f67fc640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5f81518f0 0x7fa5f81444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:16.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.654+0000 7fa5f67fc640 1 -- 172.21.15.53:0/1146529744 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e00094d0 con 0x7fa5f80c94b0 2023-12-08T20:55:16.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.654+0000 7fa5f67fc640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5f80c94b0 0x7fa5f813e3d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c500 tx=0x7fa5e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.662+0000 7fa5ef7fe640 1 -- 172.21.15.53:0/1146529744 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8005220 con 0x7fa5f80c94b0 2023-12-08T20:55:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.662+0000 7fa5ef7fe640 1 -- 172.21.15.53:0/1146529744 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8005380 con 0x7fa5f80c94b0 2023-12-08T20:55:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.662+0000 7fa5ef7fe640 1 -- 172.21.15.53:0/1146529744 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8007270 con 0x7fa5f80c94b0 2023-12-08T20:55:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.662+0000 7fa5fd614640 1 -- 172.21.15.53:0/1146529744 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f813d780 con 0x7fa5f80c94b0 2023-12-08T20:55:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.662+0000 7fa5fd614640 1 -- 172.21.15.53:0/1146529744 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f81439f0 con 0x7fa5f80c94b0 2023-12-08T20:55:16.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.662+0000 7fa5fd614640 1 -- 172.21.15.53:0/1146529744 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f8074190 con 0x7fa5f80c94b0 2023-12-08T20:55:16.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.982+0000 7fa5ef7fe640 1 -- 172.21.15.53:0/1146529744 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5e80073d0 con 0x7fa5f80c94b0 2023-12-08T20:55:16.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.986+0000 7fa5ef7fe640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa5d80664c0 0x7fa5d8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:16.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.986+0000 7fa5f6ffd640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa5d80664c0 0x7fa5d8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:16.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:16.986+0000 7fa5f6ffd640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa5d80664c0 0x7fa5d8068980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0011340 tx=0x7fa5f000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:17.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.022+0000 7fa5ef7fe640 1 -- 172.21.15.53:0/1146529744 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa5e8007680 con 0x7fa5f80c94b0 2023-12-08T20:55:17.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.022+0000 7fa5ef7fe640 1 -- 172.21.15.53:0/1146529744 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5e80519c0 con 0x7fa5f80c94b0 2023-12-08T20:55:17.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.202+0000 7fa5fd614640 1 -- 172.21.15.53:0/1146529744 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5f80b1970 con 0x7fa5f80c94b0 2023-12-08T20:55:17.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.330+0000 7fa5ef7fe640 1 -- 172.21.15.53:0/1146529744 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5e8054fe0 con 0x7fa5f80c94b0 2023-12-08T20:55:17.331 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-12-08T20:55:17.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.334+0000 7fa5fd614640 1 -- 172.21.15.53:0/1146529744 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa5d80664c0 msgr2=0x7fa5d8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:17.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.334+0000 7fa5fd614640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa5d80664c0 0x7fa5d8068980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0011340 tx=0x7fa5f000b040 comp rx=0 tx=0).stop 2023-12-08T20:55:17.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.334+0000 7fa5fd614640 1 -- 172.21.15.53:0/1146529744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5f80c94b0 msgr2=0x7fa5f813e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:17.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.334+0000 7fa5fd614640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5f80c94b0 0x7fa5f813e3d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c500 tx=0x7fa5e800c9c0 comp rx=0 tx=0).stop 2023-12-08T20:55:17.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.334+0000 7fa5fd614640 1 -- 172.21.15.53:0/1146529744 shutdown_connections 2023-12-08T20:55:17.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.334+0000 7fa5fd614640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa5d80664c0 0x7fa5d8068980 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:17.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.334+0000 7fa5fd614640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5f81518f0 0x7fa5f81444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:17.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.334+0000 7fa5fd614640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5f80c94b0 0x7fa5f813e3d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:17.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.334+0000 7fa5fd614640 1 --2- 172.21.15.53:0/1146529744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5f80c77a0 0x7fa5f814c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:17.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.334+0000 7fa5fd614640 1 -- 172.21.15.53:0/1146529744 >> 172.21.15.53:0/1146529744 conn(0x7fa5f80c8990 msgr2=0x7fa5f806d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:17.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.334+0000 7fa5fd614640 1 -- 172.21.15.53:0/1146529744 shutdown_connections 2023-12-08T20:55:17.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.334+0000 7fa5fd614640 1 -- 172.21.15.53:0/1146529744 wait complete. 2023-12-08T20:55:17.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T20:55:17.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.486+0000 7f20fd2a7640 1 Processor -- start 2023-12-08T20:55:17.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.486+0000 7f20fd2a7640 1 -- start start 2023-12-08T20:55:17.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.486+0000 7f20fd2a7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f20f8159c20 0x7f20f815a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:17.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.486+0000 7f20fd2a7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f80c98a0 con 0x7f20f81539d0 2023-12-08T20:55:17.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.486+0000 7f20fd2a7640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f8159790 con 0x7f20f80c9160 2023-12-08T20:55:17.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.486+0000 7f20fd2a7640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f806bdd0 con 0x7f20f8159c20 2023-12-08T20:55:17.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.486+0000 7f20f6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f20f81539d0 0x7f20f806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44234/0 (socket says 172.21.15.53:44234) 2023-12-08T20:55:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.486+0000 7f20f6ffd640 1 -- 172.21.15.53:0/4162930004 learned_addr learned my addr 172.21.15.53:0/4162930004 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.486+0000 7f20f77fe640 1 --2- 172.21.15.53:0/4162930004 >> v2:172.21.15.146:3300/0 conn(0x7f20f8159c20 0x7f20f815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:17.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.490+0000 7f20f67fc640 1 -- 172.21.15.53:0/4162930004 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118704427 0 0) 0x7f20f80c98a0 con 0x7f20f81539d0 2023-12-08T20:55:17.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.490+0000 7f20f67fc640 1 -- 172.21.15.53:0/4162930004 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20e4003530 con 0x7f20f81539d0 2023-12-08T20:55:17.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.494+0000 7f20f77fe640 1 -- 172.21.15.53:0/4162930004 >> v1:172.21.15.146:6789/0 conn(0x7f20f80c9160 legacy=0x7f20f80c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:17.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.494+0000 7f20f77fe640 1 -- 172.21.15.53:0/4162930004 >> v1:172.21.15.53:6789/0 conn(0x7f20f81539d0 legacy=0x7f20f806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:17.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.494+0000 7f20f77fe640 1 -- 172.21.15.53:0/4162930004 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f815a5b0 con 0x7f20f8159c20 2023-12-08T20:55:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.502+0000 7f20f77fe640 1 --2- 172.21.15.53:0/4162930004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f8159c20 0x7f20f815a070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009d90 tx=0x7f20f001f100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5355708bcf4b888c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:17.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.510+0000 7f20f67fc640 1 -- 172.21.15.53:0/4162930004 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f00af600 con 0x7f20f8159c20 2023-12-08T20:55:17.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.510+0000 7f20f67fc640 1 -- 172.21.15.53:0/4162930004 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f00ab050 con 0x7f20f8159c20 2023-12-08T20:55:17.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.510+0000 7f20f67fc640 1 -- 172.21.15.53:0/4162930004 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f00af980 con 0x7f20f8159c20 2023-12-08T20:55:17.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 -- 172.21.15.53:0/4162930004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f8159c20 msgr2=0x7f20f815a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:17.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 --2- 172.21.15.53:0/4162930004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f8159c20 0x7f20f815a070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009d90 tx=0x7f20f001f100 comp rx=0 tx=0).stop 2023-12-08T20:55:17.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 -- 172.21.15.53:0/4162930004 shutdown_connections 2023-12-08T20:55:17.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 --2- 172.21.15.53:0/4162930004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f8159c20 0x7f20f815a070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:17.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 -- 172.21.15.53:0/4162930004 >> 172.21.15.53:0/4162930004 conn(0x7f20f8070b20 msgr2=0x7f20f8070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:17.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 -- 172.21.15.53:0/4162930004 shutdown_connections 2023-12-08T20:55:17.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 -- 172.21.15.53:0/4162930004 wait complete. 2023-12-08T20:55:17.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 Processor -- start 2023-12-08T20:55:17.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 -- start start 2023-12-08T20:55:17.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f80c9160 0x7f20f8155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:17.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f81539d0 0x7f20f80cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:17.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f8159c20 0x7f20f8154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:17.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80cd830 con 0x7f20f81539d0 2023-12-08T20:55:17.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80ad350 con 0x7f20f8159c20 2023-12-08T20:55:17.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20fd2a7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80cc3f0 con 0x7f20f80c9160 2023-12-08T20:55:17.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f81539d0 0x7f20f80cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:17.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f81539d0 0x7f20f80cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34772/0 (socket says 172.21.15.53:34772) 2023-12-08T20:55:17.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20effff640 1 -- 172.21.15.53:0/3464396502 learned_addr learned my addr 172.21.15.53:0/3464396502 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:17.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.514+0000 7f20f6ffd640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f80c9160 0x7f20f8155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:17.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.518+0000 7f20f77fe640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f8159c20 0x7f20f8154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:17.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.518+0000 7f20effff640 1 -- 172.21.15.53:0/3464396502 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f80c9160 msgr2=0x7f20f8155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:17.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.518+0000 7f20effff640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f80c9160 0x7f20f8155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:17.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.518+0000 7f20effff640 1 -- 172.21.15.53:0/3464396502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f8159c20 msgr2=0x7f20f8154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:17.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.518+0000 7f20effff640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f8159c20 0x7f20f8154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:17.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.518+0000 7f20effff640 1 -- 172.21.15.53:0/3464396502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0009a70 con 0x7f20f81539d0 2023-12-08T20:55:17.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.522+0000 7f20effff640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f81539d0 0x7f20f80cb1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20e000c4c0 tx=0x7f20e0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:17.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.526+0000 7f20ef7fe640 1 -- 172.21.15.53:0/3464396502 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0003600 con 0x7f20f81539d0 2023-12-08T20:55:17.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.526+0000 7f20ef7fe640 1 -- 172.21.15.53:0/3464396502 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e0003780 con 0x7f20f81539d0 2023-12-08T20:55:17.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.526+0000 7f20ef7fe640 1 -- 172.21.15.53:0/3464396502 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0003b30 con 0x7f20f81539d0 2023-12-08T20:55:17.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.526+0000 7f20fd2a7640 1 -- 172.21.15.53:0/3464396502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f80cc6d0 con 0x7f20f81539d0 2023-12-08T20:55:17.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.530+0000 7f20fd2a7640 1 -- 172.21.15.53:0/3464396502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f80ccc90 con 0x7f20f81539d0 2023-12-08T20:55:17.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.530+0000 7f20fd2a7640 1 -- 172.21.15.53:0/3464396502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f8074190 con 0x7f20f81539d0 2023-12-08T20:55:17.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.550+0000 7f20ef7fe640 1 -- 172.21.15.53:0/3464396502 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20e0003c90 con 0x7f20f81539d0 2023-12-08T20:55:17.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.554+0000 7f20ef7fe640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f20d80664c0 0x7f20d8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:17.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.554+0000 7f20f6ffd640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f20d80664c0 0x7f20d8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:17.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.554+0000 7f20f6ffd640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f20d80664c0 0x7f20d8068980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f20e80011f0 tx=0x7f20e8007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:17.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.554+0000 7f20ef7fe640 1 -- 172.21.15.53:0/3464396502 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f20e0054b60 con 0x7f20f81539d0 2023-12-08T20:55:17.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:17.858+0000 7f20ef7fe640 1 -- 172.21.15.53:0/3464396502 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20e0050ea0 con 0x7f20f81539d0 2023-12-08T20:55:18.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.030+0000 7f20fd2a7640 1 -- 172.21.15.53:0/3464396502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20f814da60 con 0x7f20f81539d0 2023-12-08T20:55:18.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.050+0000 7f20ef7fe640 1 -- 172.21.15.53:0/3464396502 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20e0017070 con 0x7f20f81539d0 2023-12-08T20:55:18.049 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-12-08T20:55:18.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.050+0000 7f20fd2a7640 1 -- 172.21.15.53:0/3464396502 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f20d80664c0 msgr2=0x7f20d8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:18.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.050+0000 7f20fd2a7640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f20d80664c0 0x7f20d8068980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f20e80011f0 tx=0x7f20e8007d40 comp rx=0 tx=0).stop 2023-12-08T20:55:18.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.050+0000 7f20fd2a7640 1 -- 172.21.15.53:0/3464396502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f81539d0 msgr2=0x7f20f80cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:18.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.050+0000 7f20fd2a7640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f81539d0 0x7f20f80cb1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20e000c4c0 tx=0x7f20e0001e80 comp rx=0 tx=0).stop 2023-12-08T20:55:18.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.054+0000 7f20fd2a7640 1 -- 172.21.15.53:0/3464396502 shutdown_connections 2023-12-08T20:55:18.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.054+0000 7f20fd2a7640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f20d80664c0 0x7f20d8068980 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:18.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.054+0000 7f20fd2a7640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f8159c20 0x7f20f8154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:18.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.054+0000 7f20fd2a7640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f81539d0 0x7f20f80cb1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:18.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.054+0000 7f20fd2a7640 1 --2- 172.21.15.53:0/3464396502 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f80c9160 0x7f20f8155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:18.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.054+0000 7f20fd2a7640 1 -- 172.21.15.53:0/3464396502 >> 172.21.15.53:0/3464396502 conn(0x7f20f8070b20 msgr2=0x7f20f8149890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:18.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.054+0000 7f20fd2a7640 1 -- 172.21.15.53:0/3464396502 shutdown_connections 2023-12-08T20:55:18.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.054+0000 7f20fd2a7640 1 -- 172.21.15.53:0/3464396502 wait complete. 2023-12-08T20:55:18.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T20:55:18.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.194+0000 7faec26a5640 1 Processor -- start 2023-12-08T20:55:18.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.194+0000 7faec26a5640 1 -- start start 2023-12-08T20:55:18.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.198+0000 7faec26a5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faebc0c6410 0x7faebc15a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:18.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.198+0000 7faec26a5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faebc0c01a0 con 0x7faebc0c1910 2023-12-08T20:55:18.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.198+0000 7faec26a5640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faebc06f3a0 con 0x7faebc0c1cf0 2023-12-08T20:55:18.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.198+0000 7faec26a5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc06ede0 con 0x7faebc0c6410 2023-12-08T20:55:18.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.198+0000 7faebbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7faebc0c1910 0x7faebc14cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44238/0 (socket says 172.21.15.53:44238) 2023-12-08T20:55:18.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.198+0000 7faebbfff640 1 -- 172.21.15.53:0/2719098907 learned_addr learned my addr 172.21.15.53:0/2719098907 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:18.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.202+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835669157 0 0) 0x7faebc0c01a0 con 0x7faebc0c1910 2023-12-08T20:55:18.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.202+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faea8003530 con 0x7faebc0c1910 2023-12-08T20:55:18.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2487147042 0 0) 0x7faea8003530 con 0x7faebc0c1910 2023-12-08T20:55:18.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faebc0c6410 msgr2=0x7faebc15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:18.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 --2- 172.21.15.53:0/2719098907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faebc0c6410 0x7faebc15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:18.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 >> v1:172.21.15.146:6789/0 conn(0x7faebc0c1cf0 legacy=0x7faebc15ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:18.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc06f0c0 con 0x7faebc0c1910 2023-12-08T20:55:18.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 149952835 0 0) 0x7faeac001680 con 0x7faebc0c1910 2023-12-08T20:55:18.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 >> v1:172.21.15.53:6789/0 conn(0x7faebc0c1910 legacy=0x7faebc14cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:18.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 --2- 172.21.15.53:0/2719098907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80039b0 0x7faea8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:18.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 --2- 172.21.15.53:0/2719098907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faebc0c6410 0x7faea80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:18.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 --2- 172.21.15.53:0/2719098907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faea8004de0 0x7faea8005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:18.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc06ede0 con 0x7faea8004de0 2023-12-08T20:55:18.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea800bbf0 con 0x7faea80039b0 2023-12-08T20:55:18.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea800bdb0 con 0x7faebc0c6410 2023-12-08T20:55:18.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.206+0000 7faec0c42640 1 --2- 172.21.15.53:0/2719098907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faea8004de0 0x7faea8005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:18.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.210+0000 7faebbfff640 1 --2- 172.21.15.53:0/2719098907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80039b0 0x7faea8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:18.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.214+0000 7faeb3fff640 1 --2- 172.21.15.53:0/2719098907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faebc0c6410 0x7faea80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:18.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.218+0000 7faec0c42640 1 -- 172.21.15.53:0/2719098907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faebc0c6410 msgr2=0x7faea80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:18.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.218+0000 7faec0c42640 1 --2- 172.21.15.53:0/2719098907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faebc0c6410 0x7faea80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:18.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.218+0000 7faec0c42640 1 -- 172.21.15.53:0/2719098907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80039b0 msgr2=0x7faea8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:18.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.218+0000 7faec0c42640 1 --2- 172.21.15.53:0/2719098907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80039b0 0x7faea8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:18.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.218+0000 7faec0c42640 1 -- 172.21.15.53:0/2719098907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8003530 con 0x7faea8004de0 2023-12-08T20:55:18.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.234+0000 7faec0c42640 1 --2- 172.21.15.53:0/2719098907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faea8004de0 0x7faea8005260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009ca0 tx=0x7faeb401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f27737c31b8608 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:18.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.342+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40a5c20 con 0x7faea8004de0 2023-12-08T20:55:18.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.342+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb40a5da0 con 0x7faea8004de0 2023-12-08T20:55:18.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.342+0000 7faebb7fe640 1 -- 172.21.15.53:0/2719098907 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40ad680 con 0x7faea8004de0 2023-12-08T20:55:18.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.342+0000 7faec26a5640 1 -- 172.21.15.53:0/2719098907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faea8004de0 msgr2=0x7faea8005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:18.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.342+0000 7faec26a5640 1 --2- 172.21.15.53:0/2719098907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faea8004de0 0x7faea8005260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009ca0 tx=0x7faeb401cc10 comp rx=0 tx=0).stop 2023-12-08T20:55:18.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.342+0000 7faec0c42640 1 -- 172.21.15.53:0/2719098907 reap_dead start 2023-12-08T20:55:18.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.342+0000 7faec26a5640 1 -- 172.21.15.53:0/2719098907 shutdown_connections 2023-12-08T20:55:18.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.342+0000 7faec26a5640 1 -- 172.21.15.53:0/2719098907 >> 172.21.15.53:0/2719098907 conn(0x7faebc0caef0 msgr2=0x7faebc0cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:18.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.342+0000 7faec26a5640 1 -- 172.21.15.53:0/2719098907 shutdown_connections 2023-12-08T20:55:18.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.342+0000 7faec26a5640 1 -- 172.21.15.53:0/2719098907 wait complete. 2023-12-08T20:55:18.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.346+0000 7faec26a5640 1 Processor -- start 2023-12-08T20:55:18.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.346+0000 7faec26a5640 1 -- start start 2023-12-08T20:55:18.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.346+0000 7faec26a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faebc154f80 0x7faebc1490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:18.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.346+0000 7faec26a5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faebc155360 0x7faebc140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:18.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.346+0000 7faec26a5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faebc1e2300 0x7faebc140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:18.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.346+0000 7faec26a5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc149610 con 0x7faebc154f80 2023-12-08T20:55:18.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.346+0000 7faec26a5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc157550 con 0x7faebc155360 2023-12-08T20:55:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.346+0000 7faec26a5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc148b50 con 0x7faebc1e2300 2023-12-08T20:55:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.350+0000 7faebbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faebc154f80 0x7faebc1490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.350+0000 7faebbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faebc154f80 0x7faebc1490d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34804/0 (socket says 172.21.15.53:34804) 2023-12-08T20:55:18.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.350+0000 7faebbfff640 1 -- 172.21.15.53:0/2941661460 learned_addr learned my addr 172.21.15.53:0/2941661460 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:18.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.354+0000 7faebbfff640 1 -- 172.21.15.53:0/2941661460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faebc1e2300 msgr2=0x7faebc140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:18.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.354+0000 7faebbfff640 1 --2- 172.21.15.53:0/2941661460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faebc1e2300 0x7faebc140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:18.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.354+0000 7faebbfff640 1 -- 172.21.15.53:0/2941661460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faebc155360 msgr2=0x7faebc140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:18.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.354+0000 7faebbfff640 1 --2- 172.21.15.53:0/2941661460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faebc155360 0x7faebc140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:18.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.354+0000 7faebbfff640 1 -- 172.21.15.53:0/2941661460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc148df0 con 0x7faebc154f80 2023-12-08T20:55:18.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.354+0000 7faebbfff640 1 --2- 172.21.15.53:0/2941661460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faebc154f80 0x7faebc1490d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faeac007290 tx=0x7faeac004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:18.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.362+0000 7faeb97fa640 1 -- 172.21.15.53:0/2941661460 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac00f940 con 0x7faebc154f80 2023-12-08T20:55:18.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.362+0000 7faeb97fa640 1 -- 172.21.15.53:0/2941661460 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac00fac0 con 0x7faebc154f80 2023-12-08T20:55:18.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.362+0000 7faeb97fa640 1 -- 172.21.15.53:0/2941661460 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac00fe70 con 0x7faebc154f80 2023-12-08T20:55:18.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.362+0000 7faec26a5640 1 -- 172.21.15.53:0/2941661460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc158cd0 con 0x7faebc154f80 2023-12-08T20:55:18.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.362+0000 7faec26a5640 1 -- 172.21.15.53:0/2941661460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc159290 con 0x7faebc154f80 2023-12-08T20:55:18.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.366+0000 7faec26a5640 1 -- 172.21.15.53:0/2941661460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faebc1f2420 con 0x7faebc154f80 2023-12-08T20:55:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.386+0000 7faeb97fa640 1 -- 172.21.15.53:0/2941661460 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faeac01d460 con 0x7faebc154f80 2023-12-08T20:55:18.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.386+0000 7faeb97fa640 1 --2- 172.21.15.53:0/2941661460 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fae9c0664f0 0x7fae9c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:18.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.386+0000 7faeb3fff640 1 --2- 172.21.15.53:0/2941661460 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fae9c0664f0 0x7fae9c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:18.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.390+0000 7faeb3fff640 1 --2- 172.21.15.53:0/2941661460 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fae9c0664f0 0x7fae9c0689b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faebc1587c0 tx=0x7faea4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:18.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.390+0000 7faeb97fa640 1 -- 172.21.15.53:0/2941661460 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faeac056130 con 0x7faebc154f80 2023-12-08T20:55:18.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:18.830+0000 7faeb97fa640 1 -- 172.21.15.53:0/2941661460 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faeac051d70 con 0x7faebc154f80 2023-12-08T20:55:19.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.010+0000 7faec26a5640 1 -- 172.21.15.53:0/2941661460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faebc1f2420 con 0x7faebc154f80 2023-12-08T20:55:19.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.022+0000 7faeb97fa640 1 -- 172.21.15.53:0/2941661460 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7faebc1f2420 con 0x7faebc154f80 2023-12-08T20:55:19.025 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-12-08T20:55:19.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.026+0000 7faec26a5640 1 -- 172.21.15.53:0/2941661460 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fae9c0664f0 msgr2=0x7fae9c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:19.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.026+0000 7faec26a5640 1 --2- 172.21.15.53:0/2941661460 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fae9c0664f0 0x7fae9c0689b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faebc1587c0 tx=0x7faea4009040 comp rx=0 tx=0).stop 2023-12-08T20:55:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.026+0000 7faec26a5640 1 -- 172.21.15.53:0/2941661460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faebc154f80 msgr2=0x7faebc1490d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.026+0000 7faec26a5640 1 --2- 172.21.15.53:0/2941661460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faebc154f80 0x7faebc1490d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faeac007290 tx=0x7faeac004f90 comp rx=0 tx=0).stop 2023-12-08T20:55:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.026+0000 7faec26a5640 1 -- 172.21.15.53:0/2941661460 shutdown_connections 2023-12-08T20:55:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.026+0000 7faec26a5640 1 --2- 172.21.15.53:0/2941661460 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fae9c0664f0 0x7fae9c0689b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.026+0000 7faec26a5640 1 --2- 172.21.15.53:0/2941661460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faebc1e2300 0x7faebc140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.026+0000 7faec26a5640 1 --2- 172.21.15.53:0/2941661460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faebc155360 0x7faebc140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.026+0000 7faec26a5640 1 --2- 172.21.15.53:0/2941661460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faebc154f80 0x7faebc1490d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.026+0000 7faec26a5640 1 -- 172.21.15.53:0/2941661460 >> 172.21.15.53:0/2941661460 conn(0x7faebc0caef0 msgr2=0x7faebc0ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.026+0000 7faec26a5640 1 -- 172.21.15.53:0/2941661460 shutdown_connections 2023-12-08T20:55:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.026+0000 7faec26a5640 1 -- 172.21.15.53:0/2941661460 wait complete. 2023-12-08T20:55:19.045 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T20:55:19.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.178+0000 7f346049a640 1 Processor -- start 2023-12-08T20:55:19.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.178+0000 7f346049a640 1 -- start start 2023-12-08T20:55:19.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.182+0000 7f346049a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f345806b1d0 0x7f34580c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:19.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.182+0000 7f346049a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f345806ec90 0x7f345806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:19.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.182+0000 7f346049a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345815a620 con 0x7f3458153a80 2023-12-08T20:55:19.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.182+0000 7f346049a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3458159730 con 0x7f345806b1d0 2023-12-08T20:55:19.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.182+0000 7f346049a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3458159a10 con 0x7f345806ec90 2023-12-08T20:55:19.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.182+0000 7f345ea37640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f345806ec90 0x7f345806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:19.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.182+0000 7f345da35640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f345806b1d0 0x7f34580c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:19.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.182+0000 7f345ea37640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f345806ec90 0x7f345806f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:59418/0 (socket says 172.21.15.53:59418) 2023-12-08T20:55:19.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.182+0000 7f345ea37640 1 -- 172.21.15.53:0/2436666960 learned_addr learned my addr 172.21.15.53:0/2436666960 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:19.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.190+0000 7f345ea37640 1 -- 172.21.15.53:0/2436666960 >> v2:172.21.15.146:3300/0 conn(0x7f345806b1d0 msgr2=0x7f34580c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:19.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.190+0000 7f345ea37640 1 --2- 172.21.15.53:0/2436666960 >> v2:172.21.15.146:3300/0 conn(0x7f345806b1d0 0x7f34580c2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.190+0000 7f345ea37640 1 -- 172.21.15.53:0/2436666960 >> v1:172.21.15.146:6789/0 conn(0x7f3458153a80 legacy=0x7f345806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:19.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.190+0000 7f345ea37640 1 -- 172.21.15.53:0/2436666960 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3458159cf0 con 0x7f345806ec90 2023-12-08T20:55:19.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.194+0000 7f345ea37640 1 --2- 172.21.15.53:0/2436666960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f345806ec90 0x7f345806f9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3450009e50 tx=0x7f345001c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abdc6124f36cc12c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:19.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f345d234640 1 -- 172.21.15.53:0/2436666960 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500a5820 con 0x7f345806ec90 2023-12-08T20:55:19.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f345d234640 1 -- 172.21.15.53:0/2436666960 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34500a5980 con 0x7f345806ec90 2023-12-08T20:55:19.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f345d234640 1 -- 172.21.15.53:0/2436666960 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500a5d10 con 0x7f345806ec90 2023-12-08T20:55:19.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 -- 172.21.15.53:0/2436666960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f345806ec90 msgr2=0x7f345806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:19.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 --2- 172.21.15.53:0/2436666960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f345806ec90 0x7f345806f9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3450009e50 tx=0x7f345001c9a0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 -- 172.21.15.53:0/2436666960 shutdown_connections 2023-12-08T20:55:19.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 --2- 172.21.15.53:0/2436666960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f345806ec90 0x7f345806f9d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 --2- 172.21.15.53:0/2436666960 >> v2:172.21.15.146:3300/0 conn(0x7f345806b1d0 0x7f34580c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 -- 172.21.15.53:0/2436666960 >> 172.21.15.53:0/2436666960 conn(0x7f345806b6c0 msgr2=0x7f345806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:19.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 -- 172.21.15.53:0/2436666960 shutdown_connections 2023-12-08T20:55:19.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 -- 172.21.15.53:0/2436666960 wait complete. 2023-12-08T20:55:19.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 Processor -- start 2023-12-08T20:55:19.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 -- start start 2023-12-08T20:55:19.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345806b1d0 0x7f34581430a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:19.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f345806ec90 0x7f34580cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:19.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3458153a80 0x7f34580cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:19.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3458154140 con 0x7f345806b1d0 2023-12-08T20:55:19.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345815d650 con 0x7f3458153a80 2023-12-08T20:55:19.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.206+0000 7f346049a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3458154560 con 0x7f345806ec90 2023-12-08T20:55:19.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.210+0000 7f345e236640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345806b1d0 0x7f34581430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:19.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.210+0000 7f345ea37640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3458153a80 0x7f34580cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:19.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.210+0000 7f345e236640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345806b1d0 0x7f34581430a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34812/0 (socket says 172.21.15.53:34812) 2023-12-08T20:55:19.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.210+0000 7f345e236640 1 -- 172.21.15.53:0/3992516159 learned_addr learned my addr 172.21.15.53:0/3992516159 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:19.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.210+0000 7f345da35640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f345806ec90 0x7f34580cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:19.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.214+0000 7f345e236640 1 -- 172.21.15.53:0/3992516159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f345806ec90 msgr2=0x7f34580cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:19.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.214+0000 7f345e236640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f345806ec90 0x7f34580cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.214+0000 7f345e236640 1 -- 172.21.15.53:0/3992516159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3458153a80 msgr2=0x7f34580cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:19.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.214+0000 7f345e236640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3458153a80 0x7f34580cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.214+0000 7f345e236640 1 -- 172.21.15.53:0/3992516159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3450009b30 con 0x7f345806b1d0 2023-12-08T20:55:19.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.218+0000 7f345e236640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345806b1d0 0x7f34581430a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f345400b3e0 tx=0x7f345400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:19.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.222+0000 7f344effd640 1 -- 172.21.15.53:0/3992516159 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454011830 con 0x7f345806b1d0 2023-12-08T20:55:19.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.222+0000 7f344effd640 1 -- 172.21.15.53:0/3992516159 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34540119b0 con 0x7f345806b1d0 2023-12-08T20:55:19.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.222+0000 7f346049a640 1 -- 172.21.15.53:0/3992516159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345815ac70 con 0x7f345806b1d0 2023-12-08T20:55:19.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.222+0000 7f344effd640 1 -- 172.21.15.53:0/3992516159 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454011d60 con 0x7f345806b1d0 2023-12-08T20:55:19.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.222+0000 7f346049a640 1 -- 172.21.15.53:0/3992516159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345814f650 con 0x7f345806b1d0 2023-12-08T20:55:19.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.222+0000 7f346049a640 1 -- 172.21.15.53:0/3992516159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3458074190 con 0x7f345806b1d0 2023-12-08T20:55:19.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.546+0000 7f344effd640 1 -- 172.21.15.53:0/3992516159 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f345401a400 con 0x7f345806b1d0 2023-12-08T20:55:19.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.546+0000 7f344effd640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f343c0664c0 0x7f343c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:19.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.546+0000 7f345da35640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f343c0664c0 0x7f343c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:19.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.550+0000 7f345da35640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f343c0664c0 0x7f343c068980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3458154960 tx=0x7f3448009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:19.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.586+0000 7f344effd640 1 -- 172.21.15.53:0/3992516159 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f34540556b0 con 0x7f345806b1d0 2023-12-08T20:55:19.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.586+0000 7f344effd640 1 -- 172.21.15.53:0/3992516159 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34540519f0 con 0x7f345806b1d0 2023-12-08T20:55:19.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.782+0000 7f346049a640 1 -- 172.21.15.53:0/3992516159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3458156f40 con 0x7f345806b1d0 2023-12-08T20:55:19.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.890+0000 7f344effd640 1 -- 172.21.15.53:0/3992516159 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3454015020 con 0x7f345806b1d0 2023-12-08T20:55:19.890 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-12-08T20:55:19.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.894+0000 7f346049a640 1 -- 172.21.15.53:0/3992516159 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f343c0664c0 msgr2=0x7f343c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:19.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.894+0000 7f346049a640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f343c0664c0 0x7f343c068980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3458154960 tx=0x7f3448009190 comp rx=0 tx=0).stop 2023-12-08T20:55:19.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.894+0000 7f346049a640 1 -- 172.21.15.53:0/3992516159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345806b1d0 msgr2=0x7f34581430a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:19.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.894+0000 7f346049a640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345806b1d0 0x7f34581430a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f345400b3e0 tx=0x7f345400b8a0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.894+0000 7f346049a640 1 -- 172.21.15.53:0/3992516159 shutdown_connections 2023-12-08T20:55:19.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.894+0000 7f346049a640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f343c0664c0 0x7f343c068980 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.894+0000 7f346049a640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3458153a80 0x7f34580cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.894+0000 7f346049a640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f345806ec90 0x7f34580cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.894+0000 7f346049a640 1 --2- 172.21.15.53:0/3992516159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345806b1d0 0x7f34581430a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:19.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.894+0000 7f346049a640 1 -- 172.21.15.53:0/3992516159 >> 172.21.15.53:0/3992516159 conn(0x7f345806b6c0 msgr2=0x7f34580c2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.894+0000 7f346049a640 1 -- 172.21.15.53:0/3992516159 shutdown_connections 2023-12-08T20:55:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:19.894+0000 7f346049a640 1 -- 172.21.15.53:0/3992516159 wait complete. 2023-12-08T20:55:19.917 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T20:55:20.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.050+0000 7f71702eb640 1 Processor -- start 2023-12-08T20:55:20.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.050+0000 7f71702eb640 1 -- start start 2023-12-08T20:55:20.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.054+0000 7f71702eb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71680c1110 0x7f71680c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:20.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.054+0000 7f71702eb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716815a350 con 0x7f7168150840 2023-12-08T20:55:20.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.054+0000 7f71702eb640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71680c2330 con 0x7f71680b1c80 2023-12-08T20:55:20.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.054+0000 7f71702eb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716815a860 con 0x7f71680c1110 2023-12-08T20:55:20.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.126+0000 7f716d886640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f71680b1c80 0x7f7168150130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.53:53142/0 (socket says 172.21.15.53:53142) 2023-12-08T20:55:20.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.126+0000 7f716d886640 1 -- 172.21.15.53:0/4207409477 learned_addr learned my addr 172.21.15.53:0/4207409477 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:20.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.138+0000 7f716e087640 1 --2- 172.21.15.53:0/4207409477 >> v2:172.21.15.53:3300/0 conn(0x7f71680c1110 0x7f71680c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:20.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.138+0000 7f716d085640 1 -- 172.21.15.53:0/4207409477 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782937649 0 0) 0x7f715c001120 con 0x7f71680b1c80 2023-12-08T20:55:20.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.138+0000 7f716d085640 1 -- 172.21.15.53:0/4207409477 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7150003530 con 0x7f71680b1c80 2023-12-08T20:55:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.146+0000 7f716e087640 1 -- 172.21.15.53:0/4207409477 >> v1:172.21.15.146:6789/0 conn(0x7f71680b1c80 legacy=0x7f7168150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.146+0000 7f716e087640 1 -- 172.21.15.53:0/4207409477 >> v1:172.21.15.53:6789/0 conn(0x7f7168150840 legacy=0x7f716806e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.146+0000 7f716e087640 1 -- 172.21.15.53:0/4207409477 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716815a580 con 0x7f71680c1110 2023-12-08T20:55:20.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.170+0000 7f716e087640 1 --2- 172.21.15.53:0/4207409477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71680c1110 0x7f71680c14f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71600097c0 tx=0x7f716001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa42aff757553fe1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:20.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.182+0000 7f716d085640 1 -- 172.21.15.53:0/4207409477 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71600ab650 con 0x7f71680c1110 2023-12-08T20:55:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.182+0000 7f716d085640 1 -- 172.21.15.53:0/4207409477 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71600ab7b0 con 0x7f71680c1110 2023-12-08T20:55:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.182+0000 7f716d085640 1 -- 172.21.15.53:0/4207409477 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71600abb40 con 0x7f71680c1110 2023-12-08T20:55:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.182+0000 7f71702eb640 1 -- 172.21.15.53:0/4207409477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71680c1110 msgr2=0x7f71680c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.182+0000 7f71702eb640 1 --2- 172.21.15.53:0/4207409477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71680c1110 0x7f71680c14f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71600097c0 tx=0x7f716001c450 comp rx=0 tx=0).stop 2023-12-08T20:55:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.182+0000 7f71702eb640 1 -- 172.21.15.53:0/4207409477 shutdown_connections 2023-12-08T20:55:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.182+0000 7f71702eb640 1 --2- 172.21.15.53:0/4207409477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71680c1110 0x7f71680c14f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.182+0000 7f71702eb640 1 -- 172.21.15.53:0/4207409477 >> 172.21.15.53:0/4207409477 conn(0x7f71680c8990 msgr2=0x7f71680c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.182+0000 7f71702eb640 1 -- 172.21.15.53:0/4207409477 shutdown_connections 2023-12-08T20:55:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.182+0000 7f71702eb640 1 -- 172.21.15.53:0/4207409477 wait complete. 2023-12-08T20:55:20.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f71702eb640 1 Processor -- start 2023-12-08T20:55:20.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f71702eb640 1 -- start start 2023-12-08T20:55:20.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f71702eb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71680b1c80 0x7f71681425a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:20.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f71702eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71680c1110 0x7f7168142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:20.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f71702eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7168150840 0x7f7168144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:20.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f71702eb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7168143b40 con 0x7f71680c1110 2023-12-08T20:55:20.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f71702eb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71681f3130 con 0x7f7168150840 2023-12-08T20:55:20.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f71702eb640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7168160cc0 con 0x7f71680b1c80 2023-12-08T20:55:20.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f716d886640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71680c1110 0x7f7168142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f716d886640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71680c1110 0x7f7168142ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34824/0 (socket says 172.21.15.53:34824) 2023-12-08T20:55:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f716d886640 1 -- 172.21.15.53:0/447117431 learned_addr learned my addr 172.21.15.53:0/447117431 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f716e087640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71680b1c80 0x7f71681425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.186+0000 7f716e888640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7168150840 0x7f7168144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:20.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.194+0000 7f716d886640 1 -- 172.21.15.53:0/447117431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71680b1c80 msgr2=0x7f71681425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:20.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.194+0000 7f716d886640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71680b1c80 0x7f71681425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:20.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.194+0000 7f716d886640 1 -- 172.21.15.53:0/447117431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7168150840 msgr2=0x7f7168144c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:20.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.194+0000 7f716d886640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7168150840 0x7f7168144c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:20.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.194+0000 7f716d886640 1 -- 172.21.15.53:0/447117431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160009420 con 0x7f71680c1110 2023-12-08T20:55:20.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.198+0000 7f716d886640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71680c1110 0x7f7168142ae0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f715c00c760 tx=0x7f715c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:20.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.206+0000 7f7166ffd640 1 -- 172.21.15.53:0/447117431 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c005ac0 con 0x7f71680c1110 2023-12-08T20:55:20.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.206+0000 7f7166ffd640 1 -- 172.21.15.53:0/447117431 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c005c20 con 0x7f71680c1110 2023-12-08T20:55:20.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.206+0000 7f7166ffd640 1 -- 172.21.15.53:0/447117431 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c007070 con 0x7f71680c1110 2023-12-08T20:55:20.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.206+0000 7f71702eb640 1 -- 172.21.15.53:0/447117431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71681f3600 con 0x7f71680c1110 2023-12-08T20:55:20.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.206+0000 7f71702eb640 1 -- 172.21.15.53:0/447117431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716815f580 con 0x7f71680c1110 2023-12-08T20:55:20.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.206+0000 7f71702eb640 1 -- 172.21.15.53:0/447117431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71680677c0 con 0x7f71680c1110 2023-12-08T20:55:20.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.242+0000 7f7166ffd640 1 -- 172.21.15.53:0/447117431 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f715c0071d0 con 0x7f71680c1110 2023-12-08T20:55:20.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.246+0000 7f7166ffd640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71540664c0 0x7f7154068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:20.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.246+0000 7f716e087640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71540664c0 0x7f7154068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:20.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.246+0000 7f716e087640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71540664c0 0x7f7154068980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f71600af000 tx=0x7f71600a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:20.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.570+0000 7f7166ffd640 1 -- 172.21.15.53:0/447117431 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f715c054850 con 0x7f71680c1110 2023-12-08T20:55:20.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.570+0000 7f7166ffd640 1 -- 172.21.15.53:0/447117431 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f715c050b90 con 0x7f71680c1110 2023-12-08T20:55:20.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.798+0000 7f71702eb640 1 -- 172.21.15.53:0/447117431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f71680c2330 con 0x7f71680c1110 2023-12-08T20:55:20.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.802+0000 7f7166ffd640 1 -- 172.21.15.53:0/447117431 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f71680c2330 con 0x7f71680c1110 2023-12-08T20:55:20.803 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-12-08T20:55:20.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.806+0000 7f71702eb640 1 -- 172.21.15.53:0/447117431 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71540664c0 msgr2=0x7f7154068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.806+0000 7f71702eb640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71540664c0 0x7f7154068980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f71600af000 tx=0x7f71600a7000 comp rx=0 tx=0).stop 2023-12-08T20:55:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.806+0000 7f71702eb640 1 -- 172.21.15.53:0/447117431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71680c1110 msgr2=0x7f7168142ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.806+0000 7f71702eb640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71680c1110 0x7f7168142ae0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f715c00c760 tx=0x7f715c00cc20 comp rx=0 tx=0).stop 2023-12-08T20:55:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.806+0000 7f71702eb640 1 -- 172.21.15.53:0/447117431 shutdown_connections 2023-12-08T20:55:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.806+0000 7f71702eb640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71540664c0 0x7f7154068980 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.806+0000 7f71702eb640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7168150840 0x7f7168144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.806+0000 7f71702eb640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71680c1110 0x7f7168142ae0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.806+0000 7f71702eb640 1 --2- 172.21.15.53:0/447117431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71680b1c80 0x7f71681425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.806+0000 7f71702eb640 1 -- 172.21.15.53:0/447117431 >> 172.21.15.53:0/447117431 conn(0x7f71680c8990 msgr2=0x7f71680c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.806+0000 7f71702eb640 1 -- 172.21.15.53:0/447117431 shutdown_connections 2023-12-08T20:55:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:20.806+0000 7f71702eb640 1 -- 172.21.15.53:0/447117431 wait complete. 2023-12-08T20:55:20.823 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:55:20.823 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T20:55:20.829 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:55:21.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.002+0000 7fbd969bd640 1 Processor -- start 2023-12-08T20:55:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.002+0000 7fbd969bd640 1 -- start start 2023-12-08T20:55:21.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.002+0000 7fbd969bd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd900cae10 0x7fbd9006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.002+0000 7fbd969bd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbd9006c330 0x7fbd90153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.002+0000 7fbd969bd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9015a3b0 con 0x7fbd900cb5c0 2023-12-08T20:55:21.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.002+0000 7fbd969bd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd900c9db0 con 0x7fbd9006c330 2023-12-08T20:55:21.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.002+0000 7fbd969bd640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd9015a650 con 0x7fbd900cae10 2023-12-08T20:55:21.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.002+0000 7fbd94f5a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbd9006c330 0x7fbd90153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:21.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.002+0000 7fbd8f7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd900cae10 0x7fbd9006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:21.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.002+0000 7fbd94f5a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbd9006c330 0x7fbd90153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34826/0 (socket says 172.21.15.53:34826) 2023-12-08T20:55:21.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.002+0000 7fbd94f5a640 1 -- 172.21.15.53:0/475958319 learned_addr learned my addr 172.21.15.53:0/475958319 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:21.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.010+0000 7fbd94f5a640 1 -- 172.21.15.53:0/475958319 >> v2:172.21.15.146:3300/0 conn(0x7fbd900cae10 msgr2=0x7fbd9006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:21.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.010+0000 7fbd94f5a640 1 --2- 172.21.15.53:0/475958319 >> v2:172.21.15.146:3300/0 conn(0x7fbd900cae10 0x7fbd9006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.010+0000 7fbd94f5a640 1 -- 172.21.15.53:0/475958319 >> v1:172.21.15.53:6789/0 conn(0x7fbd900cb5c0 legacy=0x7fbd900cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:21.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.010+0000 7fbd94f5a640 1 -- 172.21.15.53:0/475958319 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd900ca820 con 0x7fbd9006c330 2023-12-08T20:55:21.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.022+0000 7fbd94f5a640 1 --2- 172.21.15.53:0/475958319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd9006c330 0x7fbd90153380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd900c9470 tx=0x7fbd8801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d169d05fb11390 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:21.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.026+0000 7fbd8effd640 1 -- 172.21.15.53:0/475958319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880af400 con 0x7fbd9006c330 2023-12-08T20:55:21.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.026+0000 7fbd8effd640 1 -- 172.21.15.53:0/475958319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd880ab050 con 0x7fbd9006c330 2023-12-08T20:55:21.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.026+0000 7fbd8effd640 1 -- 172.21.15.53:0/475958319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880af780 con 0x7fbd9006c330 2023-12-08T20:55:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.026+0000 7fbd969bd640 1 -- 172.21.15.53:0/475958319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd9006c330 msgr2=0x7fbd90153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.026+0000 7fbd969bd640 1 --2- 172.21.15.53:0/475958319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd9006c330 0x7fbd90153380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd900c9470 tx=0x7fbd8801f1c0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.026+0000 7fbd969bd640 1 -- 172.21.15.53:0/475958319 shutdown_connections 2023-12-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.026+0000 7fbd969bd640 1 --2- 172.21.15.53:0/475958319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd9006c330 0x7fbd90153380 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.026+0000 7fbd969bd640 1 --2- 172.21.15.53:0/475958319 >> v2:172.21.15.146:3300/0 conn(0x7fbd900cae10 0x7fbd9006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.026+0000 7fbd969bd640 1 -- 172.21.15.53:0/475958319 >> 172.21.15.53:0/475958319 conn(0x7fbd9008b5c0 msgr2=0x7fbd90060fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.026+0000 7fbd969bd640 1 -- 172.21.15.53:0/475958319 shutdown_connections 2023-12-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.026+0000 7fbd969bd640 1 -- 172.21.15.53:0/475958319 wait complete. 2023-12-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.030+0000 7fbd969bd640 1 Processor -- start 2023-12-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.030+0000 7fbd969bd640 1 -- start start 2023-12-08T20:55:21.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.030+0000 7fbd969bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd9006c330 0x7fbd901f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.030+0000 7fbd969bd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd900cae10 0x7fbd90158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.030+0000 7fbd969bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd900cb5c0 0x7fbd90158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.030+0000 7fbd969bd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd900b2de0 con 0x7fbd9006c330 2023-12-08T20:55:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.030+0000 7fbd969bd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd901f1030 con 0x7fbd900cb5c0 2023-12-08T20:55:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.030+0000 7fbd969bd640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd900b3030 con 0x7fbd900cae10 2023-12-08T20:55:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.030+0000 7fbd8ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd9006c330 0x7fbd901f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.030+0000 7fbd8ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd9006c330 0x7fbd901f14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34842/0 (socket says 172.21.15.53:34842) 2023-12-08T20:55:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.030+0000 7fbd8ffff640 1 -- 172.21.15.53:0/157053615 learned_addr learned my addr 172.21.15.53:0/157053615 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.034+0000 7fbd8f7fe640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd900cae10 0x7fbd90158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.034+0000 7fbd8ffff640 1 -- 172.21.15.53:0/157053615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd900cae10 msgr2=0x7fbd90158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.034+0000 7fbd8ffff640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd900cae10 0x7fbd90158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.034+0000 7fbd8ffff640 1 -- 172.21.15.53:0/157053615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd900cb5c0 msgr2=0x7fbd90158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.034+0000 7fbd8ffff640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd900cb5c0 0x7fbd90158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.034+0000 7fbd8ffff640 1 -- 172.21.15.53:0/157053615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd88009b30 con 0x7fbd9006c330 2023-12-08T20:55:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.042+0000 7fbd8ffff640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd9006c330 0x7fbd901f14c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c530 tx=0x7fbd8000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.126+0000 7fbd8cff9640 1 -- 172.21.15.53:0/157053615 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80005220 con 0x7fbd9006c330 2023-12-08T20:55:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.126+0000 7fbd8cff9640 1 -- 172.21.15.53:0/157053615 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd80005380 con 0x7fbd9006c330 2023-12-08T20:55:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.126+0000 7fbd8cff9640 1 -- 172.21.15.53:0/157053615 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80007270 con 0x7fbd9006c330 2023-12-08T20:55:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.126+0000 7fbd969bd640 1 -- 172.21.15.53:0/157053615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd900b3310 con 0x7fbd9006c330 2023-12-08T20:55:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.126+0000 7fbd969bd640 1 -- 172.21.15.53:0/157053615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd901f09e0 con 0x7fbd9006c330 2023-12-08T20:55:21.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.126+0000 7fbd969bd640 1 -- 172.21.15.53:0/157053615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd90074190 con 0x7fbd9006c330 2023-12-08T20:55:21.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.150+0000 7fbd8cff9640 1 -- 172.21.15.53:0/157053615 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd800073d0 con 0x7fbd9006c330 2023-12-08T20:55:21.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.150+0000 7fbd8cff9640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbd700664f0 0x7fbd700689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.150+0000 7fbd8f7fe640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbd700664f0 0x7fbd700689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:21.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.150+0000 7fbd8f7fe640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbd700664f0 0x7fbd700689b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd9006c150 tx=0x7fbd78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:21.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.154+0000 7fbd8cff9640 1 -- 172.21.15.53:0/157053615 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd80007680 con 0x7fbd9006c330 2023-12-08T20:55:21.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.514+0000 7fbd8cff9640 1 -- 172.21.15.53:0/157053615 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbd800519f0 con 0x7fbd9006c330 2023-12-08T20:55:21.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.694+0000 7fbd969bd640 1 -- 172.21.15.53:0/157053615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd90061070 con 0x7fbd9006c330 2023-12-08T20:55:21.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.790+0000 7fbd8cff9640 1 -- 172.21.15.53:0/157053615 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fbd80055010 con 0x7fbd9006c330 2023-12-08T20:55:21.793 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:21.793 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:05.168215+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:55:21.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.794+0000 7fbd969bd640 1 -- 172.21.15.53:0/157053615 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbd700664f0 msgr2=0x7fbd700689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:21.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.794+0000 7fbd969bd640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbd700664f0 0x7fbd700689b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd9006c150 tx=0x7fbd78008040 comp rx=0 tx=0).stop 2023-12-08T20:55:21.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.794+0000 7fbd969bd640 1 -- 172.21.15.53:0/157053615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd9006c330 msgr2=0x7fbd901f14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:21.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.794+0000 7fbd969bd640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd9006c330 0x7fbd901f14c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c530 tx=0x7fbd8000c9f0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.794+0000 7fbd969bd640 1 -- 172.21.15.53:0/157053615 shutdown_connections 2023-12-08T20:55:21.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.794+0000 7fbd969bd640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbd700664f0 0x7fbd700689b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.794+0000 7fbd969bd640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd900cb5c0 0x7fbd90158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.794+0000 7fbd969bd640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd900cae10 0x7fbd90158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.794+0000 7fbd969bd640 1 --2- 172.21.15.53:0/157053615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd9006c330 0x7fbd901f14c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.794+0000 7fbd969bd640 1 -- 172.21.15.53:0/157053615 >> 172.21.15.53:0/157053615 conn(0x7fbd9008b5c0 msgr2=0x7fbd9006c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:21.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.794+0000 7fbd969bd640 1 -- 172.21.15.53:0/157053615 shutdown_connections 2023-12-08T20:55:21.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.794+0000 7fbd969bd640 1 -- 172.21.15.53:0/157053615 wait complete. 2023-12-08T20:55:21.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T20:54:13.707275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T20:54:52.929484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T20:54:54.529440+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T20:55:01.908380+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T20:55:21.816 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T20:55:21.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.946+0000 7f70c0bee640 1 Processor -- start 2023-12-08T20:55:21.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.950+0000 7f70c0bee640 1 -- start start 2023-12-08T20:55:21.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.950+0000 7f70c0bee640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70bc070cc0 0x7f70bc0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.950+0000 7f70c0bee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70bc0c9230 0x7f70bc157460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.950+0000 7f70c0bee640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f70bc0710a0 0x7f70bc1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.950+0000 7f70c0bee640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70bc0c37d0 con 0x7f70bc0c9230 2023-12-08T20:55:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.950+0000 7f70c0bee640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70bc0c87e0 con 0x7f70bc0710a0 2023-12-08T20:55:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.950+0000 7f70c0bee640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc0c7150 con 0x7f70bc070cc0 2023-12-08T20:55:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.950+0000 7f70ba59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70bc0c9230 0x7f70bc157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.950+0000 7f70ba59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70bc0c9230 0x7f70bc157460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36452/0 (socket says 172.21.15.53:36452) 2023-12-08T20:55:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.950+0000 7f70ba59c640 1 -- 172.21.15.53:0/1259095210 learned_addr learned my addr 172.21.15.53:0/1259095210 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.950+0000 7f70b259c640 1 --2- 172.21.15.53:0/1259095210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70bc070cc0 0x7f70bc0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.950+0000 7f70bad9d640 1 --2- 172.21.15.53:0/1259095210 >> v2:172.21.15.146:3300/0 conn(0x7f70bc0710a0 0x7f70bc1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.954+0000 7f70ba59c640 1 -- 172.21.15.53:0/1259095210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70bc070cc0 msgr2=0x7f70bc0c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.954+0000 7f70ba59c640 1 --2- 172.21.15.53:0/1259095210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70bc070cc0 0x7f70bc0c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.954+0000 7f70ba59c640 1 -- 172.21.15.53:0/1259095210 >> v2:172.21.15.146:3300/0 conn(0x7f70bc0710a0 msgr2=0x7f70bc1512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.954+0000 7f70ba59c640 1 --2- 172.21.15.53:0/1259095210 >> v2:172.21.15.146:3300/0 conn(0x7f70bc0710a0 0x7f70bc1512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.954+0000 7f70ba59c640 1 -- 172.21.15.53:0/1259095210 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc15b340 con 0x7f70bc0c9230 2023-12-08T20:55:21.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.958+0000 7f70ba59c640 1 --2- 172.21.15.53:0/1259095210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc0c9230 0x7f70bc157460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70bc06faa0 tx=0x7f70ac01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fb8abde6b6950 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:21.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.962+0000 7f70b9d9b640 1 -- 172.21.15.53:0/1259095210 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac0a89b0 con 0x7f70bc0c9230 2023-12-08T20:55:21.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.962+0000 7f70b9d9b640 1 -- 172.21.15.53:0/1259095210 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac0a8b10 con 0x7f70bc0c9230 2023-12-08T20:55:21.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.962+0000 7f70b9d9b640 1 -- 172.21.15.53:0/1259095210 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac0a8ea0 con 0x7f70bc0c9230 2023-12-08T20:55:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.962+0000 7f70c0bee640 1 -- 172.21.15.53:0/1259095210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc0c9230 msgr2=0x7f70bc157460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.962+0000 7f70c0bee640 1 --2- 172.21.15.53:0/1259095210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc0c9230 0x7f70bc157460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70bc06faa0 tx=0x7f70ac01ecf0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.962+0000 7f70c0bee640 1 -- 172.21.15.53:0/1259095210 shutdown_connections 2023-12-08T20:55:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.962+0000 7f70c0bee640 1 --2- 172.21.15.53:0/1259095210 >> v2:172.21.15.146:3300/0 conn(0x7f70bc0710a0 0x7f70bc1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.962+0000 7f70c0bee640 1 --2- 172.21.15.53:0/1259095210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc0c9230 0x7f70bc157460 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.962+0000 7f70c0bee640 1 --2- 172.21.15.53:0/1259095210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70bc070cc0 0x7f70bc0c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.962+0000 7f70c0bee640 1 -- 172.21.15.53:0/1259095210 >> 172.21.15.53:0/1259095210 conn(0x7f70bc06abe0 msgr2=0x7f70bc06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.962+0000 7f70c0bee640 1 -- 172.21.15.53:0/1259095210 shutdown_connections 2023-12-08T20:55:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.962+0000 7f70c0bee640 1 -- 172.21.15.53:0/1259095210 wait complete. 2023-12-08T20:55:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70c0bee640 1 Processor -- start 2023-12-08T20:55:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70c0bee640 1 -- start start 2023-12-08T20:55:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70c0bee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc070cc0 0x7f70bc159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70c0bee640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70bc0710a0 0x7f70bc157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70c0bee640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70bc0c9230 0x7f70bc1ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70c0bee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc14d980 con 0x7f70bc070cc0 2023-12-08T20:55:21.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70c0bee640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc1ec920 con 0x7f70bc0c9230 2023-12-08T20:55:21.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70c0bee640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc14e3e0 con 0x7f70bc0710a0 2023-12-08T20:55:21.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70b259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc070cc0 0x7f70bc159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:21.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70b259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc070cc0 0x7f70bc159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36462/0 (socket says 172.21.15.53:36462) 2023-12-08T20:55:21.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70b259c640 1 -- 172.21.15.53:0/2775925608 learned_addr learned my addr 172.21.15.53:0/2775925608 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:21.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70ba59c640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70bc0710a0 0x7f70bc157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:21.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.966+0000 7f70bad9d640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70bc0c9230 0x7f70bc1ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.970+0000 7f70b259c640 1 -- 172.21.15.53:0/2775925608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70bc0710a0 msgr2=0x7f70bc157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.970+0000 7f70b259c640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70bc0710a0 0x7f70bc157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.970+0000 7f70b259c640 1 -- 172.21.15.53:0/2775925608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70bc0c9230 msgr2=0x7f70bc1ecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.970+0000 7f70b259c640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70bc0c9230 0x7f70bc1ecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.970+0000 7f70b259c640 1 -- 172.21.15.53:0/2775925608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac0094d0 con 0x7f70bc070cc0 2023-12-08T20:55:21.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.974+0000 7f70b259c640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc070cc0 0x7f70bc159330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70a400e8b0 tx=0x7f70a400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:21.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.978+0000 7f70b37fe640 1 -- 172.21.15.53:0/2775925608 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a400c940 con 0x7f70bc070cc0 2023-12-08T20:55:21.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.978+0000 7f70b37fe640 1 -- 172.21.15.53:0/2775925608 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a400caa0 con 0x7f70bc070cc0 2023-12-08T20:55:21.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.978+0000 7f70b37fe640 1 -- 172.21.15.53:0/2775925608 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a400ce30 con 0x7f70bc070cc0 2023-12-08T20:55:21.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.978+0000 7f70c0bee640 1 -- 172.21.15.53:0/2775925608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70bc1f0010 con 0x7f70bc070cc0 2023-12-08T20:55:21.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.978+0000 7f70c0bee640 1 -- 172.21.15.53:0/2775925608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70bc1f05d0 con 0x7f70bc070cc0 2023-12-08T20:55:21.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.978+0000 7f70c0bee640 1 -- 172.21.15.53:0/2775925608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70bc0675b0 con 0x7f70bc070cc0 2023-12-08T20:55:21.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.998+0000 7f70b37fe640 1 -- 172.21.15.53:0/2775925608 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70a4013470 con 0x7f70bc070cc0 2023-12-08T20:55:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.998+0000 7f70b37fe640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f709c0664f0 0x7f709c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.998+0000 7f70ba59c640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f709c0664f0 0x7f709c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:22.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:21.998+0000 7f70ba59c640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f709c0664f0 0x7f709c0689b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0b2000 tx=0x7f70ac0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:22.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.278+0000 7f70b37fe640 1 -- 172.21.15.53:0/2775925608 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f70a4055970 con 0x7f70bc070cc0 2023-12-08T20:55:22.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.278+0000 7f70b37fe640 1 -- 172.21.15.53:0/2775925608 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f70a4051cb0 con 0x7f70bc070cc0 2023-12-08T20:55:22.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.458+0000 7f70c0bee640 1 -- 172.21.15.53:0/2775925608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70bc0ccdb0 con 0x7f70bc070cc0 2023-12-08T20:55:22.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.482+0000 7f70b37fe640 1 -- 172.21.15.53:0/2775925608 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70a4021020 con 0x7f70bc070cc0 2023-12-08T20:55:22.482 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-12-08T20:55:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.486+0000 7f70c0bee640 1 -- 172.21.15.53:0/2775925608 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f709c0664f0 msgr2=0x7f709c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.486+0000 7f70c0bee640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f709c0664f0 0x7f709c0689b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0b2000 tx=0x7f70ac0aa070 comp rx=0 tx=0).stop 2023-12-08T20:55:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.486+0000 7f70c0bee640 1 -- 172.21.15.53:0/2775925608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc070cc0 msgr2=0x7f70bc159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.486+0000 7f70c0bee640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc070cc0 0x7f70bc159330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70a400e8b0 tx=0x7f70a400ed70 comp rx=0 tx=0).stop 2023-12-08T20:55:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.486+0000 7f70c0bee640 1 -- 172.21.15.53:0/2775925608 shutdown_connections 2023-12-08T20:55:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.486+0000 7f70c0bee640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f709c0664f0 0x7f709c0689b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.486+0000 7f70c0bee640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70bc0c9230 0x7f70bc1ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.486+0000 7f70c0bee640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70bc0710a0 0x7f70bc157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.486+0000 7f70c0bee640 1 --2- 172.21.15.53:0/2775925608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc070cc0 0x7f70bc159330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.486+0000 7f70c0bee640 1 -- 172.21.15.53:0/2775925608 >> 172.21.15.53:0/2775925608 conn(0x7f70bc06abe0 msgr2=0x7f70bc0c1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.486+0000 7f70c0bee640 1 -- 172.21.15.53:0/2775925608 shutdown_connections 2023-12-08T20:55:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.486+0000 7f70c0bee640 1 -- 172.21.15.53:0/2775925608 wait complete. 2023-12-08T20:55:22.505 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T20:55:22.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.634+0000 7f8d004ee640 1 Processor -- start 2023-12-08T20:55:22.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.634+0000 7f8d004ee640 1 -- start start 2023-12-08T20:55:22.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.634+0000 7f8d004ee640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8cf8153910 0x7f8cf80ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:22.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.634+0000 7f8d004ee640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf815a180 0x7f8cf80c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:22.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.634+0000 7f8d004ee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8cf80ceed0 0x7f8cf80cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.634+0000 7f8d004ee640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf80ca120 con 0x7f8cf80ceed0 2023-12-08T20:55:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.634+0000 7f8d004ee640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf80cb190 con 0x7f8cf8153910 2023-12-08T20:55:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.634+0000 7f8d004ee640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf80cc2d0 con 0x7f8cf815a180 2023-12-08T20:55:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.634+0000 7f8cfea8b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8cf80ceed0 0x7f8cf80cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.634+0000 7f8cfea8b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8cf80ceed0 0x7f8cf80cf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36470/0 (socket says 172.21.15.53:36470) 2023-12-08T20:55:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.634+0000 7f8cfea8b640 1 -- 172.21.15.53:0/2073811781 learned_addr learned my addr 172.21.15.53:0/2073811781 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:22.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.638+0000 7f8cfea8b640 1 -- 172.21.15.53:0/2073811781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf815a180 msgr2=0x7f8cf80c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:22.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.638+0000 7f8cfea8b640 1 --2- 172.21.15.53:0/2073811781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf815a180 0x7f8cf80c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:22.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.638+0000 7f8cfea8b640 1 -- 172.21.15.53:0/2073811781 >> v2:172.21.15.146:3300/0 conn(0x7f8cf8153910 msgr2=0x7f8cf80ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:22.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.638+0000 7f8cfea8b640 1 --2- 172.21.15.53:0/2073811781 >> v2:172.21.15.146:3300/0 conn(0x7f8cf8153910 0x7f8cf80ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:22.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.638+0000 7f8cfea8b640 1 -- 172.21.15.53:0/2073811781 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf80cb3e0 con 0x7f8cf80ceed0 2023-12-08T20:55:22.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.642+0000 7f8cfea8b640 1 --2- 172.21.15.53:0/2073811781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cf80ceed0 0x7f8cf80cf360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8cf808c470 tx=0x7f8cf001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1580f8d6369e0937 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8cfd288640 1 -- 172.21.15.53:0/2073811781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf00af400 con 0x7f8cf80ceed0 2023-12-08T20:55:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8cfd288640 1 -- 172.21.15.53:0/2073811781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf00ab050 con 0x7f8cf80ceed0 2023-12-08T20:55:22.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8cfd288640 1 -- 172.21.15.53:0/2073811781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf00af780 con 0x7f8cf80ceed0 2023-12-08T20:55:22.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 -- 172.21.15.53:0/2073811781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cf80ceed0 msgr2=0x7f8cf80cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:22.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 --2- 172.21.15.53:0/2073811781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cf80ceed0 0x7f8cf80cf360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8cf808c470 tx=0x7f8cf001f1c0 comp rx=0 tx=0).stop 2023-12-08T20:55:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 -- 172.21.15.53:0/2073811781 shutdown_connections 2023-12-08T20:55:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 --2- 172.21.15.53:0/2073811781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cf80ceed0 0x7f8cf80cf360 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 --2- 172.21.15.53:0/2073811781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf815a180 0x7f8cf80c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 --2- 172.21.15.53:0/2073811781 >> v2:172.21.15.146:3300/0 conn(0x7f8cf8153910 0x7f8cf80ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 -- 172.21.15.53:0/2073811781 >> 172.21.15.53:0/2073811781 conn(0x7f8cf808afc0 msgr2=0x7f8cf808b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 -- 172.21.15.53:0/2073811781 shutdown_connections 2023-12-08T20:55:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 -- 172.21.15.53:0/2073811781 wait complete. 2023-12-08T20:55:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 Processor -- start 2023-12-08T20:55:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 -- start start 2023-12-08T20:55:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf80ceed0 0x7f8cf815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cf8153910 0x7f8cf80c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf815a180 0x7f8cf8147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf814d2d0 con 0x7f8cf8153910 2023-12-08T20:55:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf80c77c0 con 0x7f8cf815a180 2023-12-08T20:55:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.646+0000 7f8d004ee640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf814d800 con 0x7f8cf80ceed0 2023-12-08T20:55:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.650+0000 7f8cfda89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cf8153910 0x7f8cf80c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.650+0000 7f8cfda89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cf8153910 0x7f8cf80c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36476/0 (socket says 172.21.15.53:36476) 2023-12-08T20:55:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.650+0000 7f8cfda89640 1 -- 172.21.15.53:0/1476491051 learned_addr learned my addr 172.21.15.53:0/1476491051 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.654+0000 7f8cfda89640 1 -- 172.21.15.53:0/1476491051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf80ceed0 msgr2=0x7f8cf815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.654+0000 7f8cfda89640 1 --2- 172.21.15.53:0/1476491051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf80ceed0 0x7f8cf815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.654+0000 7f8cfda89640 1 -- 172.21.15.53:0/1476491051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf815a180 msgr2=0x7f8cf8147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.654+0000 7f8cfda89640 1 --2- 172.21.15.53:0/1476491051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf815a180 0x7f8cf8147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.654+0000 7f8cfda89640 1 -- 172.21.15.53:0/1476491051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf0009b30 con 0x7f8cf8153910 2023-12-08T20:55:22.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.654+0000 7f8cfda89640 1 --2- 172.21.15.53:0/1476491051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cf8153910 0x7f8cf80c8af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800b410 tx=0x7f8ce800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.658+0000 7f8ceeffd640 1 -- 172.21.15.53:0/1476491051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8011830 con 0x7f8cf8153910 2023-12-08T20:55:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.658+0000 7f8ceeffd640 1 -- 172.21.15.53:0/1476491051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce8011990 con 0x7f8cf8153910 2023-12-08T20:55:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.658+0000 7f8ceeffd640 1 -- 172.21.15.53:0/1476491051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8011d40 con 0x7f8cf8153910 2023-12-08T20:55:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.658+0000 7f8d004ee640 1 -- 172.21.15.53:0/1476491051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf814d520 con 0x7f8cf8153910 2023-12-08T20:55:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.658+0000 7f8d004ee640 1 -- 172.21.15.53:0/1476491051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf80c8010 con 0x7f8cf8153910 2023-12-08T20:55:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.658+0000 7f8d004ee640 1 -- 172.21.15.53:0/1476491051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf80675b0 con 0x7f8cf8153910 2023-12-08T20:55:22.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.678+0000 7f8ceeffd640 1 -- 172.21.15.53:0/1476491051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ce801a400 con 0x7f8cf8153910 2023-12-08T20:55:22.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.678+0000 7f8ceeffd640 1 --2- 172.21.15.53:0/1476491051 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8cdc0664c0 0x7f8cdc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:22.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.678+0000 7f8cfe28a640 1 --2- 172.21.15.53:0/1476491051 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8cdc0664c0 0x7f8cdc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:22.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.682+0000 7f8cfe28a640 1 --2- 172.21.15.53:0/1476491051 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8cdc0664c0 0x7f8cdc068980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009730 tx=0x7f8cf4006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:22.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.682+0000 7f8ceeffd640 1 -- 172.21.15.53:0/1476491051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ce8055e00 con 0x7f8cf8153910 2023-12-08T20:55:22.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:22.998+0000 7f8ceeffd640 1 -- 172.21.15.53:0/1476491051 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ce8051a40 con 0x7f8cf8153910 2023-12-08T20:55:23.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.166+0000 7f8d004ee640 1 -- 172.21.15.53:0/1476491051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8cf8157170 con 0x7f8cf8153910 2023-12-08T20:55:23.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8ceeffd640 1 -- 172.21.15.53:0/1476491051 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ce8015020 con 0x7f8cf8153910 2023-12-08T20:55:23.198 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-12-08T20:55:23.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8d004ee640 1 -- 172.21.15.53:0/1476491051 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8cdc0664c0 msgr2=0x7f8cdc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:23.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8d004ee640 1 --2- 172.21.15.53:0/1476491051 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8cdc0664c0 0x7f8cdc068980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009730 tx=0x7f8cf4006ca0 comp rx=0 tx=0).stop 2023-12-08T20:55:23.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8d004ee640 1 -- 172.21.15.53:0/1476491051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cf8153910 msgr2=0x7f8cf80c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:23.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8d004ee640 1 --2- 172.21.15.53:0/1476491051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cf8153910 0x7f8cf80c8af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800b410 tx=0x7f8ce800b8d0 comp rx=0 tx=0).stop 2023-12-08T20:55:23.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8d004ee640 1 -- 172.21.15.53:0/1476491051 shutdown_connections 2023-12-08T20:55:23.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8d004ee640 1 --2- 172.21.15.53:0/1476491051 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8cdc0664c0 0x7f8cdc068980 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:23.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8d004ee640 1 --2- 172.21.15.53:0/1476491051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf815a180 0x7f8cf8147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:23.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8d004ee640 1 --2- 172.21.15.53:0/1476491051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cf8153910 0x7f8cf80c8af0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:23.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8d004ee640 1 --2- 172.21.15.53:0/1476491051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf80ceed0 0x7f8cf815a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:23.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8d004ee640 1 -- 172.21.15.53:0/1476491051 >> 172.21.15.53:0/1476491051 conn(0x7f8cf808afc0 msgr2=0x7f8cf80cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:23.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8d004ee640 1 -- 172.21.15.53:0/1476491051 shutdown_connections 2023-12-08T20:55:23.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.198+0000 7f8d004ee640 1 -- 172.21.15.53:0/1476491051 wait complete. 2023-12-08T20:55:23.220 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T20:55:23.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.346+0000 7fb0948e9640 1 Processor -- start 2023-12-08T20:55:23.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.346+0000 7fb0948e9640 1 -- start start 2023-12-08T20:55:23.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.346+0000 7fb0948e9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0900c2030 0x7fb0900c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:23.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.346+0000 7fb0948e9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0900c2f70 con 0x7fb0901516b0 2023-12-08T20:55:23.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.346+0000 7fb0948e9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09015b6a0 con 0x7fb0900c81c0 2023-12-08T20:55:23.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.346+0000 7fb0948e9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09015b980 con 0x7fb0900c2030 2023-12-08T20:55:23.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.350+0000 7fb08e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb0901516b0 0x7fb0900c3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50666/0 (socket says 172.21.15.53:50666) 2023-12-08T20:55:23.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.350+0000 7fb08e59c640 1 -- 172.21.15.53:0/3632730538 learned_addr learned my addr 172.21.15.53:0/3632730538 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:23.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.354+0000 7fb08dd9b640 1 --2- 172.21.15.53:0/3632730538 >> v2:172.21.15.146:3300/0 conn(0x7fb0900c2030 0x7fb0900c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:23.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.354+0000 7fb08d59a640 1 -- 172.21.15.53:0/3632730538 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075086596 0 0) 0x7fb0900c2f70 con 0x7fb0901516b0 2023-12-08T20:55:23.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.354+0000 7fb08d59a640 1 -- 172.21.15.53:0/3632730538 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07c003530 con 0x7fb0901516b0 2023-12-08T20:55:23.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.362+0000 7fb08dd9b640 1 -- 172.21.15.53:0/3632730538 >> v1:172.21.15.146:6789/0 conn(0x7fb0900c81c0 legacy=0x7fb09015a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:23.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.362+0000 7fb08dd9b640 1 -- 172.21.15.53:0/3632730538 >> v1:172.21.15.53:6789/0 conn(0x7fb0901516b0 legacy=0x7fb0900c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:23.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.362+0000 7fb08dd9b640 1 -- 172.21.15.53:0/3632730538 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0900c2640 con 0x7fb0900c2030 2023-12-08T20:55:23.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.374+0000 7fb08dd9b640 1 --2- 172.21.15.53:0/3632730538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0900c2030 0x7fb0900c7c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb0780097c0 tx=0x7fb07801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deed0ec4bf18891a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:23.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.390+0000 7fb08d59a640 1 -- 172.21.15.53:0/3632730538 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0780a8970 con 0x7fb0900c2030 2023-12-08T20:55:23.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.510+0000 7fb08d59a640 1 -- 172.21.15.53:0/3632730538 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0780a8ad0 con 0x7fb0900c2030 2023-12-08T20:55:23.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.510+0000 7fb08d59a640 1 -- 172.21.15.53:0/3632730538 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0780a8e40 con 0x7fb0900c2030 2023-12-08T20:55:23.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.510+0000 7fb0948e9640 1 -- 172.21.15.53:0/3632730538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0900c2030 msgr2=0x7fb0900c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:23.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.510+0000 7fb0948e9640 1 --2- 172.21.15.53:0/3632730538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0900c2030 0x7fb0900c7c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb0780097c0 tx=0x7fb07801ec70 comp rx=0 tx=0).stop 2023-12-08T20:55:23.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.510+0000 7fb0948e9640 1 -- 172.21.15.53:0/3632730538 shutdown_connections 2023-12-08T20:55:23.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.510+0000 7fb0948e9640 1 --2- 172.21.15.53:0/3632730538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0900c2030 0x7fb0900c7c80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:23.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.510+0000 7fb0948e9640 1 -- 172.21.15.53:0/3632730538 >> 172.21.15.53:0/3632730538 conn(0x7fb090070b20 msgr2=0x7fb090070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:23.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.510+0000 7fb0948e9640 1 -- 172.21.15.53:0/3632730538 shutdown_connections 2023-12-08T20:55:23.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.510+0000 7fb0948e9640 1 -- 172.21.15.53:0/3632730538 wait complete. 2023-12-08T20:55:23.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.514+0000 7fb0948e9640 1 Processor -- start 2023-12-08T20:55:23.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.514+0000 7fb0948e9640 1 -- start start 2023-12-08T20:55:23.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.514+0000 7fb0948e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0900c2030 0x7fb0901f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:23.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.514+0000 7fb0948e9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0900c81c0 0x7fb0901547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:23.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.514+0000 7fb0948e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0901516b0 0x7fb0900b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:23.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.514+0000 7fb0948e9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0901f1430 con 0x7fb0900c2030 2023-12-08T20:55:23.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.514+0000 7fb0948e9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0900b2de0 con 0x7fb0901516b0 2023-12-08T20:55:23.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.514+0000 7fb0948e9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0901edd20 con 0x7fb0900c81c0 2023-12-08T20:55:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.518+0000 7fb08ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0901516b0 0x7fb0900b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.518+0000 7fb08dd9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0900c81c0 0x7fb0901547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.518+0000 7fb08ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0901516b0 0x7fb0900b2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:56732/0 (socket says 172.21.15.53:56732) 2023-12-08T20:55:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.518+0000 7fb08ed9d640 1 -- 172.21.15.53:0/2891394391 learned_addr learned my addr 172.21.15.53:0/2891394391 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:23.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.518+0000 7fb08e59c640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0900c2030 0x7fb0901f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:23.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.526+0000 7fb08ed9d640 1 -- 172.21.15.53:0/2891394391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0900c81c0 msgr2=0x7fb0901547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:23.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.526+0000 7fb08ed9d640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0900c81c0 0x7fb0901547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:23.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.526+0000 7fb08ed9d640 1 -- 172.21.15.53:0/2891394391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0900c2030 msgr2=0x7fb0901f0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:23.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.526+0000 7fb08ed9d640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0900c2030 0x7fb0901f0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:23.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.526+0000 7fb08ed9d640 1 -- 172.21.15.53:0/2891394391 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb078009420 con 0x7fb0901516b0 2023-12-08T20:55:23.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.534+0000 7fb08ed9d640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0901516b0 0x7fb0900b2410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb08000c460 tx=0x7fb08000c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:23.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.538+0000 7fb086ffd640 1 -- 172.21.15.53:0/2891394391 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080005220 con 0x7fb0901516b0 2023-12-08T20:55:23.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.538+0000 7fb0948e9640 1 -- 172.21.15.53:0/2891394391 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0901ed110 con 0x7fb0901516b0 2023-12-08T20:55:23.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.538+0000 7fb0948e9640 1 -- 172.21.15.53:0/2891394391 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0901ed6d0 con 0x7fb0901516b0 2023-12-08T20:55:23.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.542+0000 7fb0948e9640 1 -- 172.21.15.53:0/2891394391 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0901edeb0 con 0x7fb0901516b0 2023-12-08T20:55:23.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.838+0000 7fb086ffd640 1 -- 172.21.15.53:0/2891394391 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb080005380 con 0x7fb0901516b0 2023-12-08T20:55:23.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.838+0000 7fb086ffd640 1 -- 172.21.15.53:0/2891394391 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080007270 con 0x7fb0901516b0 2023-12-08T20:55:23.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.842+0000 7fb086ffd640 1 -- 172.21.15.53:0/2891394391 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb080007490 con 0x7fb0901516b0 2023-12-08T20:55:23.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.842+0000 7fb086ffd640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb070066470 0x7fb070068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:23.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.842+0000 7fb08e59c640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb070066470 0x7fb070068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:23.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.842+0000 7fb08e59c640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb070066470 0x7fb070068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb088001570 tx=0x7fb088009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:23.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.842+0000 7fb086ffd640 1 -- 172.21.15.53:0/2891394391 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb080055c30 con 0x7fb0901516b0 2023-12-08T20:55:23.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:23.854+0000 7fb086ffd640 1 -- 172.21.15.53:0/2891394391 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb080051870 con 0x7fb0901516b0 2023-12-08T20:55:24.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.034+0000 7fb0948e9640 1 -- 172.21.15.53:0/2891394391 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb090074190 con 0x7fb0901516b0 2023-12-08T20:55:24.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.090+0000 7fb086ffd640 1 -- 172.21.15.53:0/2891394391 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb080054e90 con 0x7fb0901516b0 2023-12-08T20:55:24.092 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-12-08T20:55:24.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.094+0000 7fb0948e9640 1 -- 172.21.15.53:0/2891394391 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb070066470 msgr2=0x7fb070068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:24.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.094+0000 7fb0948e9640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb070066470 0x7fb070068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb088001570 tx=0x7fb088009040 comp rx=0 tx=0).stop 2023-12-08T20:55:24.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.094+0000 7fb0948e9640 1 -- 172.21.15.53:0/2891394391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0901516b0 msgr2=0x7fb0900b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:24.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.094+0000 7fb0948e9640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0901516b0 0x7fb0900b2410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb08000c460 tx=0x7fb08000c920 comp rx=0 tx=0).stop 2023-12-08T20:55:24.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.094+0000 7fb0948e9640 1 -- 172.21.15.53:0/2891394391 shutdown_connections 2023-12-08T20:55:24.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.094+0000 7fb0948e9640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb070066470 0x7fb070068930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.094+0000 7fb0948e9640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0901516b0 0x7fb0900b2410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.094+0000 7fb0948e9640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0900c81c0 0x7fb0901547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.094+0000 7fb0948e9640 1 --2- 172.21.15.53:0/2891394391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0900c2030 0x7fb0901f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.094+0000 7fb0948e9640 1 -- 172.21.15.53:0/2891394391 >> 172.21.15.53:0/2891394391 conn(0x7fb090070b20 msgr2=0x7fb0900c3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:24.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.094+0000 7fb0948e9640 1 -- 172.21.15.53:0/2891394391 shutdown_connections 2023-12-08T20:55:24.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.094+0000 7fb0948e9640 1 -- 172.21.15.53:0/2891394391 wait complete. 2023-12-08T20:55:24.117 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T20:55:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.250+0000 7efc98124640 1 Processor -- start 2023-12-08T20:55:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.250+0000 7efc98124640 1 -- start start 2023-12-08T20:55:24.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.250+0000 7efc98124640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc900c8820 0x7efc900c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:24.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.250+0000 7efc98124640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc900ccd30 0x7efc900cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:24.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.250+0000 7efc98124640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9015a5f0 con 0x7efc901537a0 2023-12-08T20:55:24.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.250+0000 7efc98124640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc900c80c0 con 0x7efc900c8820 2023-12-08T20:55:24.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.250+0000 7efc98124640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc90159620 con 0x7efc900ccd30 2023-12-08T20:55:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.250+0000 7efc966c1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc900ccd30 0x7efc900cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:24.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.254+0000 7efc966c1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc900ccd30 0x7efc900cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:56736/0 (socket says 172.21.15.53:56736) 2023-12-08T20:55:24.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.254+0000 7efc966c1640 1 -- 172.21.15.53:0/1723391732 learned_addr learned my addr 172.21.15.53:0/1723391732 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:24.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.254+0000 7efc956bf640 1 --2- 172.21.15.53:0/1723391732 >> v2:172.21.15.53:3300/0 conn(0x7efc900c8820 0x7efc900c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:24.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.258+0000 7efc956bf640 1 -- 172.21.15.53:0/1723391732 >> v2:172.21.15.146:3300/0 conn(0x7efc900ccd30 msgr2=0x7efc900cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:24.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.258+0000 7efc956bf640 1 --2- 172.21.15.53:0/1723391732 >> v2:172.21.15.146:3300/0 conn(0x7efc900ccd30 0x7efc900cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.258+0000 7efc956bf640 1 -- 172.21.15.53:0/1723391732 >> v1:172.21.15.146:6789/0 conn(0x7efc901537a0 legacy=0x7efc900c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:24.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.258+0000 7efc956bf640 1 -- 172.21.15.53:0/1723391732 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc900c7de0 con 0x7efc900c8820 2023-12-08T20:55:24.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.262+0000 7efc956bf640 1 --2- 172.21.15.53:0/1723391732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc900c8820 0x7efc900c3770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efc900707e0 tx=0x7efc8401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71251e7b33557cdb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:24.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.266+0000 7efc94ebe640 1 -- 172.21.15.53:0/1723391732 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840ab600 con 0x7efc900c8820 2023-12-08T20:55:24.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.266+0000 7efc94ebe640 1 -- 172.21.15.53:0/1723391732 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc840a7050 con 0x7efc900c8820 2023-12-08T20:55:24.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.266+0000 7efc94ebe640 1 -- 172.21.15.53:0/1723391732 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840ab980 con 0x7efc900c8820 2023-12-08T20:55:24.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.266+0000 7efc98124640 1 -- 172.21.15.53:0/1723391732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc900c8820 msgr2=0x7efc900c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:24.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.266+0000 7efc98124640 1 --2- 172.21.15.53:0/1723391732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc900c8820 0x7efc900c3770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efc900707e0 tx=0x7efc8401c3d0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.266+0000 7efc98124640 1 -- 172.21.15.53:0/1723391732 shutdown_connections 2023-12-08T20:55:24.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.266+0000 7efc98124640 1 --2- 172.21.15.53:0/1723391732 >> v2:172.21.15.146:3300/0 conn(0x7efc900ccd30 0x7efc900cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.266+0000 7efc98124640 1 --2- 172.21.15.53:0/1723391732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc900c8820 0x7efc900c3770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.266+0000 7efc98124640 1 -- 172.21.15.53:0/1723391732 >> 172.21.15.53:0/1723391732 conn(0x7efc90060fd0 msgr2=0x7efc900613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:24.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.266+0000 7efc98124640 1 -- 172.21.15.53:0/1723391732 shutdown_connections 2023-12-08T20:55:24.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.266+0000 7efc98124640 1 -- 172.21.15.53:0/1723391732 wait complete. 2023-12-08T20:55:24.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.270+0000 7efc98124640 1 Processor -- start 2023-12-08T20:55:24.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.270+0000 7efc98124640 1 -- start start 2023-12-08T20:55:24.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.270+0000 7efc98124640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc900c8820 0x7efc901526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.270+0000 7efc98124640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc900ccd30 0x7efc90154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.270+0000 7efc98124640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901537a0 0x7efc9006c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.270+0000 7efc98124640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc90152cc0 con 0x7efc901537a0 2023-12-08T20:55:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.270+0000 7efc98124640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc90156290 con 0x7efc900ccd30 2023-12-08T20:55:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.270+0000 7efc98124640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc90155680 con 0x7efc900c8820 2023-12-08T20:55:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.270+0000 7efc966c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901537a0 0x7efc9006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.270+0000 7efc966c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901537a0 0x7efc9006c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36504/0 (socket says 172.21.15.53:36504) 2023-12-08T20:55:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.270+0000 7efc966c1640 1 -- 172.21.15.53:0/842853881 learned_addr learned my addr 172.21.15.53:0/842853881 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.270+0000 7efc95ec0640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc900c8820 0x7efc901526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:24.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.274+0000 7efc956bf640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc900ccd30 0x7efc90154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:24.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.274+0000 7efc966c1640 1 -- 172.21.15.53:0/842853881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc900c8820 msgr2=0x7efc901526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:24.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.274+0000 7efc966c1640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc900c8820 0x7efc901526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.274+0000 7efc966c1640 1 -- 172.21.15.53:0/842853881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc900ccd30 msgr2=0x7efc90154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:24.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.274+0000 7efc966c1640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc900ccd30 0x7efc90154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.274+0000 7efc966c1640 1 -- 172.21.15.53:0/842853881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc84009420 con 0x7efc901537a0 2023-12-08T20:55:24.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.278+0000 7efc966c1640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901537a0 0x7efc9006c300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc8800e880 tx=0x7efc8800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:24.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.282+0000 7efc8e7fc640 1 -- 172.21.15.53:0/842853881 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8800c940 con 0x7efc901537a0 2023-12-08T20:55:24.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.282+0000 7efc8e7fc640 1 -- 172.21.15.53:0/842853881 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8800caa0 con 0x7efc901537a0 2023-12-08T20:55:24.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.282+0000 7efc98124640 1 -- 172.21.15.53:0/842853881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc90155960 con 0x7efc901537a0 2023-12-08T20:55:24.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.282+0000 7efc8e7fc640 1 -- 172.21.15.53:0/842853881 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8800ce50 con 0x7efc901537a0 2023-12-08T20:55:24.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.282+0000 7efc98124640 1 -- 172.21.15.53:0/842853881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc90155f20 con 0x7efc901537a0 2023-12-08T20:55:24.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.282+0000 7efc98124640 1 -- 172.21.15.53:0/842853881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc900c92e0 con 0x7efc901537a0 2023-12-08T20:55:24.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.610+0000 7efc8e7fc640 1 -- 172.21.15.53:0/842853881 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc88013470 con 0x7efc901537a0 2023-12-08T20:55:24.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.614+0000 7efc8e7fc640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efc7c0664c0 0x7efc7c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:24.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.614+0000 7efc95ec0640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efc7c0664c0 0x7efc7c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:24.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.614+0000 7efc95ec0640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efc7c0664c0 0x7efc7c068980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efc80001e00 tx=0x7efc80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.650+0000 7efc8e7fc640 1 -- 172.21.15.53:0/842853881 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc88055a00 con 0x7efc901537a0 2023-12-08T20:55:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.650+0000 7efc8e7fc640 1 -- 172.21.15.53:0/842853881 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc88051d40 con 0x7efc901537a0 2023-12-08T20:55:24.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.826+0000 7efc98124640 1 -- 172.21.15.53:0/842853881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efc90074190 con 0x7efc901537a0 2023-12-08T20:55:24.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc8e7fc640 1 -- 172.21.15.53:0/842853881 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7efc880210a0 con 0x7efc901537a0 2023-12-08T20:55:24.834 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-12-08T20:55:24.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc98124640 1 -- 172.21.15.53:0/842853881 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efc7c0664c0 msgr2=0x7efc7c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:24.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc98124640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efc7c0664c0 0x7efc7c068980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efc80001e00 tx=0x7efc80009040 comp rx=0 tx=0).stop 2023-12-08T20:55:24.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc98124640 1 -- 172.21.15.53:0/842853881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901537a0 msgr2=0x7efc9006c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:24.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc98124640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901537a0 0x7efc9006c300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc8800e880 tx=0x7efc8800ed40 comp rx=0 tx=0).stop 2023-12-08T20:55:24.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc98124640 1 -- 172.21.15.53:0/842853881 shutdown_connections 2023-12-08T20:55:24.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc98124640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efc7c0664c0 0x7efc7c068980 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc98124640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901537a0 0x7efc9006c300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc98124640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc900ccd30 0x7efc90154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc98124640 1 --2- 172.21.15.53:0/842853881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc900c8820 0x7efc901526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc98124640 1 -- 172.21.15.53:0/842853881 >> 172.21.15.53:0/842853881 conn(0x7efc90060fd0 msgr2=0x7efc90157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:24.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc98124640 1 -- 172.21.15.53:0/842853881 shutdown_connections 2023-12-08T20:55:24.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.834+0000 7efc98124640 1 -- 172.21.15.53:0/842853881 wait complete. 2023-12-08T20:55:24.855 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T20:55:24.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.982+0000 7fc122475640 1 Processor -- start 2023-12-08T20:55:24.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.982+0000 7fc122475640 1 -- start start 2023-12-08T20:55:24.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.982+0000 7fc122475640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc11c1518f0 0x7fc11c06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:24.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.982+0000 7fc122475640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c0c6c00 con 0x7fc11c0c94b0 2023-12-08T20:55:24.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.982+0000 7fc122475640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c0c41b0 con 0x7fc11c0c77a0 2023-12-08T20:55:24.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.982+0000 7fc122475640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11c0c3920 con 0x7fc11c1518f0 2023-12-08T20:55:24.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.982+0000 7fc11bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc11c1518f0 0x7fc11c06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:24.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.986+0000 7fc11bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc11c1518f0 0x7fc11c06a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36510/0 (socket says 172.21.15.53:36510) 2023-12-08T20:55:24.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.986+0000 7fc11bfff640 1 -- 172.21.15.53:0/1001910819 learned_addr learned my addr 172.21.15.53:0/1001910819 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:24.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.986+0000 7fc11bfff640 1 -- 172.21.15.53:0/1001910819 >> v1:172.21.15.146:6789/0 conn(0x7fc11c0c77a0 legacy=0x7fc11c161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:24.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.986+0000 7fc11bfff640 1 -- 172.21.15.53:0/1001910819 >> v1:172.21.15.53:6789/0 conn(0x7fc11c0c94b0 legacy=0x7fc11c0c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:24.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.986+0000 7fc11bfff640 1 -- 172.21.15.53:0/1001910819 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c151cd0 con 0x7fc11c1518f0 2023-12-08T20:55:24.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.990+0000 7fc11bfff640 1 --2- 172.21.15.53:0/1001910819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc11c1518f0 0x7fc11c06a5b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009870 tx=0x7fc10c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55d231175e1d4f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:24.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.998+0000 7fc11affd640 1 -- 172.21.15.53:0/1001910819 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0ab600 con 0x7fc11c1518f0 2023-12-08T20:55:24.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.998+0000 7fc11affd640 1 -- 172.21.15.53:0/1001910819 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c0a7050 con 0x7fc11c1518f0 2023-12-08T20:55:24.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.998+0000 7fc11affd640 1 -- 172.21.15.53:0/1001910819 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0ab980 con 0x7fc11c1518f0 2023-12-08T20:55:24.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.998+0000 7fc122475640 1 -- 172.21.15.53:0/1001910819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc11c1518f0 msgr2=0x7fc11c06a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:24.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.998+0000 7fc122475640 1 --2- 172.21.15.53:0/1001910819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc11c1518f0 0x7fc11c06a5b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009870 tx=0x7fc10c01c430 comp rx=0 tx=0).stop 2023-12-08T20:55:24.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.998+0000 7fc122475640 1 -- 172.21.15.53:0/1001910819 shutdown_connections 2023-12-08T20:55:24.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.998+0000 7fc122475640 1 --2- 172.21.15.53:0/1001910819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc11c1518f0 0x7fc11c06a5b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:24.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.998+0000 7fc122475640 1 -- 172.21.15.53:0/1001910819 >> 172.21.15.53:0/1001910819 conn(0x7fc11c0c8990 msgr2=0x7fc11c0c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:24.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.998+0000 7fc122475640 1 -- 172.21.15.53:0/1001910819 shutdown_connections 2023-12-08T20:55:24.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.998+0000 7fc122475640 1 -- 172.21.15.53:0/1001910819 wait complete. 2023-12-08T20:55:25.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.998+0000 7fc122475640 1 Processor -- start 2023-12-08T20:55:25.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:24.998+0000 7fc122475640 1 -- start start 2023-12-08T20:55:25.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.002+0000 7fc122475640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc11c0c77a0 0x7fc11c13fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:25.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.002+0000 7fc122475640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0c94b0 0x7fc11c1586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:25.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.002+0000 7fc122475640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc11c1518f0 0x7fc11c0c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:25.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.002+0000 7fc122475640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c15a690 con 0x7fc11c0c77a0 2023-12-08T20:55:25.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.002+0000 7fc122475640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c15aa10 con 0x7fc11c1518f0 2023-12-08T20:55:25.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.002+0000 7fc122475640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c158fe0 con 0x7fc11c0c94b0 2023-12-08T20:55:25.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.002+0000 7fc11bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc11c0c77a0 0x7fc11c13fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:25.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.002+0000 7fc11bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc11c0c77a0 0x7fc11c13fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36518/0 (socket says 172.21.15.53:36518) 2023-12-08T20:55:25.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.002+0000 7fc11bfff640 1 -- 172.21.15.53:0/4154025058 learned_addr learned my addr 172.21.15.53:0/4154025058 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:25.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.006+0000 7fc11bfff640 1 -- 172.21.15.53:0/4154025058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0c94b0 msgr2=0x7fc11c1586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:25.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.006+0000 7fc11bfff640 1 --2- 172.21.15.53:0/4154025058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0c94b0 0x7fc11c1586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:25.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.006+0000 7fc11bfff640 1 -- 172.21.15.53:0/4154025058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc11c1518f0 msgr2=0x7fc11c0c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:25.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.006+0000 7fc11bfff640 1 --2- 172.21.15.53:0/4154025058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc11c1518f0 0x7fc11c0c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:25.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.006+0000 7fc11bfff640 1 -- 172.21.15.53:0/4154025058 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c0094d0 con 0x7fc11c0c77a0 2023-12-08T20:55:25.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.006+0000 7fc11bfff640 1 --2- 172.21.15.53:0/4154025058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc11c0c77a0 0x7fc11c13fb20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc10c019040 tx=0x7fc10c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:25.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.010+0000 7fc118ff9640 1 -- 172.21.15.53:0/4154025058 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0b6830 con 0x7fc11c0c77a0 2023-12-08T20:55:25.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.010+0000 7fc118ff9640 1 -- 172.21.15.53:0/4154025058 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c0b6990 con 0x7fc11c0c77a0 2023-12-08T20:55:25.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.010+0000 7fc118ff9640 1 -- 172.21.15.53:0/4154025058 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0b6d20 con 0x7fc11c0c77a0 2023-12-08T20:55:25.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.010+0000 7fc122475640 1 -- 172.21.15.53:0/4154025058 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c15ac80 con 0x7fc11c0c77a0 2023-12-08T20:55:25.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.010+0000 7fc122475640 1 -- 172.21.15.53:0/4154025058 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c15b240 con 0x7fc11c0c77a0 2023-12-08T20:55:25.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.010+0000 7fc122475640 1 -- 172.21.15.53:0/4154025058 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c06c650 con 0x7fc11c0c77a0 2023-12-08T20:55:25.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.030+0000 7fc118ff9640 1 -- 172.21.15.53:0/4154025058 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc10c0b2040 con 0x7fc11c0c77a0 2023-12-08T20:55:25.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.030+0000 7fc118ff9640 1 --2- 172.21.15.53:0/4154025058 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc1080664c0 0x7fc108068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:25.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.030+0000 7fc11b7fe640 1 --2- 172.21.15.53:0/4154025058 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc1080664c0 0x7fc108068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:25.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.034+0000 7fc11b7fe640 1 --2- 172.21.15.53:0/4154025058 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc1080664c0 0x7fc108068980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0b17c0 tx=0x7fc1100079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:25.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.042+0000 7fc118ff9640 1 -- 172.21.15.53:0/4154025058 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc10c0f02f0 con 0x7fc11c0c77a0 2023-12-08T20:55:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.366+0000 7fc118ff9640 1 -- 172.21.15.53:0/4154025058 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc10c0ebf30 con 0x7fc11c0c77a0 2023-12-08T20:55:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.566+0000 7fc122475640 1 -- 172.21.15.53:0/4154025058 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc11c15b430 con 0x7fc11c0c77a0 2023-12-08T20:55:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc118ff9640 1 -- 172.21.15.53:0/4154025058 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc10c0b0080 con 0x7fc11c0c77a0 2023-12-08T20:55:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-12-08T20:55:25.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc122475640 1 -- 172.21.15.53:0/4154025058 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc1080664c0 msgr2=0x7fc108068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc122475640 1 --2- 172.21.15.53:0/4154025058 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc1080664c0 0x7fc108068980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0b17c0 tx=0x7fc1100079c0 comp rx=0 tx=0).stop 2023-12-08T20:55:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc122475640 1 -- 172.21.15.53:0/4154025058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc11c0c77a0 msgr2=0x7fc11c13fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc122475640 1 --2- 172.21.15.53:0/4154025058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc11c0c77a0 0x7fc11c13fb20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc10c019040 tx=0x7fc10c01ac70 comp rx=0 tx=0).stop 2023-12-08T20:55:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc122475640 1 -- 172.21.15.53:0/4154025058 shutdown_connections 2023-12-08T20:55:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc122475640 1 --2- 172.21.15.53:0/4154025058 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc1080664c0 0x7fc108068980 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc122475640 1 --2- 172.21.15.53:0/4154025058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc11c1518f0 0x7fc11c0c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc122475640 1 --2- 172.21.15.53:0/4154025058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0c94b0 0x7fc11c1586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc122475640 1 --2- 172.21.15.53:0/4154025058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc11c0c77a0 0x7fc11c13fb20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc122475640 1 -- 172.21.15.53:0/4154025058 >> 172.21.15.53:0/4154025058 conn(0x7fc11c0c8990 msgr2=0x7fc11c0c7090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc122475640 1 -- 172.21.15.53:0/4154025058 shutdown_connections 2023-12-08T20:55:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:25.578+0000 7fc122475640 1 -- 172.21.15.53:0/4154025058 wait complete. 2023-12-08T20:55:25.597 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-12-08T20:55:25.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:25.597 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-08T20:55:25.616 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi053.stderr:ceph-fuse[42964]: fuse finished with error 0 and tester_r 0 2023-12-08T20:55:25.619 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T20:55:26.517 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:55:26.521 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:55:31.721 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T20:55:31.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:55:31.721 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-08T20:55:31.750 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:55:31.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.918+0000 7f1b6028a640 1 Processor -- start 2023-12-08T20:55:31.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.918+0000 7f1b6028a640 1 -- start start 2023-12-08T20:55:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.918+0000 7f1b6028a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b58153910 0x7f1b580ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.918+0000 7f1b6028a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b5815a180 0x7f1b580c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.918+0000 7f1b6028a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b580ceed0 0x7f1b580cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.918+0000 7f1b6028a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b580ca120 con 0x7f1b58153910 2023-12-08T20:55:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.918+0000 7f1b6028a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b580cb190 con 0x7f1b580ceed0 2023-12-08T20:55:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.918+0000 7f1b6028a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580cc2d0 con 0x7f1b5815a180 2023-12-08T20:55:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.918+0000 7f1b5e026640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b58153910 0x7f1b580ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:31.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.918+0000 7f1b5e026640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b58153910 0x7f1b580ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34978/0 (socket says 172.21.15.53:34978) 2023-12-08T20:55:31.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.918+0000 7f1b5e026640 1 -- 172.21.15.53:0/2905057364 learned_addr learned my addr 172.21.15.53:0/2905057364 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:31.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.922+0000 7f1b5e026640 1 -- 172.21.15.53:0/2905057364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b5815a180 msgr2=0x7f1b580c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:31.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.922+0000 7f1b5e026640 1 --2- 172.21.15.53:0/2905057364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b5815a180 0x7f1b580c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:31.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.922+0000 7f1b5e026640 1 -- 172.21.15.53:0/2905057364 >> v2:172.21.15.146:3300/0 conn(0x7f1b580ceed0 msgr2=0x7f1b580cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:31.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.922+0000 7f1b5e026640 1 --2- 172.21.15.53:0/2905057364 >> v2:172.21.15.146:3300/0 conn(0x7f1b580ceed0 0x7f1b580cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:31.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.922+0000 7f1b5e026640 1 -- 172.21.15.53:0/2905057364 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b580cb3e0 con 0x7f1b58153910 2023-12-08T20:55:31.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.926+0000 7f1b5e026640 1 --2- 172.21.15.53:0/2905057364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b58153910 0x7f1b580ca2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b580b1cd0 tx=0x7f1b5401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e91957275ce933 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:31.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.930+0000 7f1b5d024640 1 -- 172.21.15.53:0/2905057364 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b540a89b0 con 0x7f1b58153910 2023-12-08T20:55:31.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.930+0000 7f1b5d024640 1 -- 172.21.15.53:0/2905057364 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b540a8b10 con 0x7f1b58153910 2023-12-08T20:55:31.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.930+0000 7f1b5d024640 1 -- 172.21.15.53:0/2905057364 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b540a8ea0 con 0x7f1b58153910 2023-12-08T20:55:31.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.930+0000 7f1b6028a640 1 -- 172.21.15.53:0/2905057364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b58153910 msgr2=0x7f1b580ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:31.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.930+0000 7f1b6028a640 1 --2- 172.21.15.53:0/2905057364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b58153910 0x7f1b580ca2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b580b1cd0 tx=0x7f1b5401ecf0 comp rx=0 tx=0).stop 2023-12-08T20:55:31.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 -- 172.21.15.53:0/2905057364 shutdown_connections 2023-12-08T20:55:31.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 --2- 172.21.15.53:0/2905057364 >> v2:172.21.15.146:3300/0 conn(0x7f1b580ceed0 0x7f1b580cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:31.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 --2- 172.21.15.53:0/2905057364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b5815a180 0x7f1b580c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:31.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 --2- 172.21.15.53:0/2905057364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b58153910 0x7f1b580ca2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:31.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 -- 172.21.15.53:0/2905057364 >> 172.21.15.53:0/2905057364 conn(0x7f1b5808afc0 msgr2=0x7f1b5808b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:31.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 -- 172.21.15.53:0/2905057364 shutdown_connections 2023-12-08T20:55:31.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 -- 172.21.15.53:0/2905057364 wait complete. 2023-12-08T20:55:31.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 Processor -- start 2023-12-08T20:55:31.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 -- start start 2023-12-08T20:55:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b580ceed0 0x7f1b580c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815a180 0x7f1b58148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b581ef130 0x7f1b581ef5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58149280 con 0x7f1b5815a180 2023-12-08T20:55:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b581f26a0 con 0x7f1b580ceed0 2023-12-08T20:55:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.934+0000 7f1b6028a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b581f2980 con 0x7f1b581ef130 2023-12-08T20:55:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.942+0000 7f1b5d825640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815a180 0x7f1b58148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.942+0000 7f1b5d825640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815a180 0x7f1b58148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34982/0 (socket says 172.21.15.53:34982) 2023-12-08T20:55:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.942+0000 7f1b5d825640 1 -- 172.21.15.53:0/3181967092 learned_addr learned my addr 172.21.15.53:0/3181967092 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:31.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.946+0000 7f1b5d825640 1 -- 172.21.15.53:0/3181967092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b581ef130 msgr2=0x7f1b581ef5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:31.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.946+0000 7f1b5d825640 1 --2- 172.21.15.53:0/3181967092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b581ef130 0x7f1b581ef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:31.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.946+0000 7f1b5d825640 1 -- 172.21.15.53:0/3181967092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b580ceed0 msgr2=0x7f1b580c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:31.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.946+0000 7f1b5d825640 1 --2- 172.21.15.53:0/3181967092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b580ceed0 0x7f1b580c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:31.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.946+0000 7f1b5d825640 1 -- 172.21.15.53:0/3181967092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b540094d0 con 0x7f1b5815a180 2023-12-08T20:55:31.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.946+0000 7f1b5d825640 1 --2- 172.21.15.53:0/3181967092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815a180 0x7f1b58148960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800b410 tx=0x7f1b4800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:31.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.950+0000 7f1b4effd640 1 -- 172.21.15.53:0/3181967092 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48011830 con 0x7f1b5815a180 2023-12-08T20:55:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.950+0000 7f1b4effd640 1 -- 172.21.15.53:0/3181967092 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b48011990 con 0x7f1b5815a180 2023-12-08T20:55:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.950+0000 7f1b4effd640 1 -- 172.21.15.53:0/3181967092 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48011d40 con 0x7f1b5815a180 2023-12-08T20:55:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.950+0000 7f1b6028a640 1 -- 172.21.15.53:0/3181967092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b581f2c60 con 0x7f1b5815a180 2023-12-08T20:55:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.950+0000 7f1b6028a640 1 -- 172.21.15.53:0/3181967092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b580c9350 con 0x7f1b5815a180 2023-12-08T20:55:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.954+0000 7f1b6028a640 1 -- 172.21.15.53:0/3181967092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b580675b0 con 0x7f1b5815a180 2023-12-08T20:55:31.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.970+0000 7f1b4effd640 1 -- 172.21.15.53:0/3181967092 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b4801a400 con 0x7f1b5815a180 2023-12-08T20:55:31.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.974+0000 7f1b4effd640 1 --2- 172.21.15.53:0/3181967092 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f1b3c0664f0 0x7f1b3c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:31.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.974+0000 7f1b5e026640 1 --2- 172.21.15.53:0/3181967092 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f1b3c0664f0 0x7f1b3c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:31.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:31.974+0000 7f1b5e026640 1 --2- 172.21.15.53:0/3181967092 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f1b3c0664f0 0x7f1b3c0689b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1b540b2000 tx=0x7f1b54004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:32.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.258+0000 7f1b4effd640 1 -- 172.21.15.53:0/3181967092 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1b48055e40 con 0x7f1b5815a180 2023-12-08T20:55:32.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.262+0000 7f1b4effd640 1 -- 172.21.15.53:0/3181967092 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b48051a80 con 0x7f1b5815a180 2023-12-08T20:55:32.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.482+0000 7f1b6028a640 1 -- 172.21.15.53:0/3181967092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b581f3460 con 0x7f1b5815a180 2023-12-08T20:55:32.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.582+0000 7f1b4effd640 1 -- 172.21.15.53:0/3181967092 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f1b581f3460 con 0x7f1b5815a180 2023-12-08T20:55:32.581 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:32.582 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:05.168215+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:55:32.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.586+0000 7f1b6028a640 1 -- 172.21.15.53:0/3181967092 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f1b3c0664f0 msgr2=0x7f1b3c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:32.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.586+0000 7f1b6028a640 1 --2- 172.21.15.53:0/3181967092 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f1b3c0664f0 0x7f1b3c0689b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1b540b2000 tx=0x7f1b54004740 comp rx=0 tx=0).stop 2023-12-08T20:55:32.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.586+0000 7f1b6028a640 1 -- 172.21.15.53:0/3181967092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815a180 msgr2=0x7f1b58148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:32.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.586+0000 7f1b6028a640 1 --2- 172.21.15.53:0/3181967092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815a180 0x7f1b58148960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800b410 tx=0x7f1b4800b8d0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.586+0000 7f1b6028a640 1 -- 172.21.15.53:0/3181967092 shutdown_connections 2023-12-08T20:55:32.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.586+0000 7f1b6028a640 1 --2- 172.21.15.53:0/3181967092 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f1b3c0664f0 0x7f1b3c0689b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.586+0000 7f1b6028a640 1 --2- 172.21.15.53:0/3181967092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b581ef130 0x7f1b581ef5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.586+0000 7f1b6028a640 1 --2- 172.21.15.53:0/3181967092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815a180 0x7f1b58148960 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.586+0000 7f1b6028a640 1 --2- 172.21.15.53:0/3181967092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b580ceed0 0x7f1b580c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.586+0000 7f1b6028a640 1 -- 172.21.15.53:0/3181967092 >> 172.21.15.53:0/3181967092 conn(0x7f1b5808afc0 msgr2=0x7f1b580cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:32.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.586+0000 7f1b6028a640 1 -- 172.21.15.53:0/3181967092 shutdown_connections 2023-12-08T20:55:32.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.586+0000 7f1b6028a640 1 -- 172.21.15.53:0/3181967092 wait complete. 2023-12-08T20:55:32.609 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:55:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29ee9b9640 1 Processor -- start 2023-12-08T20:55:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29ee9b9640 1 -- start start 2023-12-08T20:55:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29ee9b9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e8150300 0x7f29e8156db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29ee9b9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f29e806e030 0x7f29e806e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29ee9b9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29e80c0eb0 0x7f29e80c1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29ee9b9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e806dc10 con 0x7f29e80c0eb0 2023-12-08T20:55:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29ee9b9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e80c2af0 con 0x7f29e806e030 2023-12-08T20:55:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29ee9b9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e81572f0 con 0x7f29e8150300 2023-12-08T20:55:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29ecf56640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29e80c0eb0 0x7f29e80c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:32.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29e7fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e8150300 0x7f29e8156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:32.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29e77fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f29e806e030 0x7f29e806e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:32.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29ecf56640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29e80c0eb0 0x7f29e80c1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34998/0 (socket says 172.21.15.53:34998) 2023-12-08T20:55:32.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.738+0000 7f29ecf56640 1 -- 172.21.15.53:0/3898314441 learned_addr learned my addr 172.21.15.53:0/3898314441 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:32.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.742+0000 7f29ecf56640 1 -- 172.21.15.53:0/3898314441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e8150300 msgr2=0x7f29e8156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:32.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.742+0000 7f29ecf56640 1 --2- 172.21.15.53:0/3898314441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e8150300 0x7f29e8156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.742+0000 7f29ecf56640 1 -- 172.21.15.53:0/3898314441 >> v2:172.21.15.146:3300/0 conn(0x7f29e806e030 msgr2=0x7f29e806e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:32.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.742+0000 7f29ecf56640 1 --2- 172.21.15.53:0/3898314441 >> v2:172.21.15.146:3300/0 conn(0x7f29e806e030 0x7f29e806e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.742+0000 7f29ecf56640 1 -- 172.21.15.53:0/3898314441 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e806e9b0 con 0x7f29e80c0eb0 2023-12-08T20:55:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.746+0000 7f29ecf56640 1 --2- 172.21.15.53:0/3898314441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80c0eb0 0x7f29e80c1300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29e80ccee0 tx=0x7f29e001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b9a350bc3e6efc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:32.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.750+0000 7f29e6ffd640 1 -- 172.21.15.53:0/3898314441 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e00ac600 con 0x7f29e80c0eb0 2023-12-08T20:55:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.750+0000 7f29e6ffd640 1 -- 172.21.15.53:0/3898314441 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e00a8050 con 0x7f29e80c0eb0 2023-12-08T20:55:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.750+0000 7f29e6ffd640 1 -- 172.21.15.53:0/3898314441 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e00ac980 con 0x7f29e80c0eb0 2023-12-08T20:55:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 -- 172.21.15.53:0/3898314441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80c0eb0 msgr2=0x7f29e80c1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 --2- 172.21.15.53:0/3898314441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80c0eb0 0x7f29e80c1300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29e80ccee0 tx=0x7f29e001c4d0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 -- 172.21.15.53:0/3898314441 shutdown_connections 2023-12-08T20:55:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 --2- 172.21.15.53:0/3898314441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80c0eb0 0x7f29e80c1300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 --2- 172.21.15.53:0/3898314441 >> v2:172.21.15.146:3300/0 conn(0x7f29e806e030 0x7f29e806e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 --2- 172.21.15.53:0/3898314441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e8150300 0x7f29e8156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 -- 172.21.15.53:0/3898314441 >> 172.21.15.53:0/3898314441 conn(0x7f29e806b6c0 msgr2=0x7f29e806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 -- 172.21.15.53:0/3898314441 shutdown_connections 2023-12-08T20:55:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 -- 172.21.15.53:0/3898314441 wait complete. 2023-12-08T20:55:32.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 Processor -- start 2023-12-08T20:55:32.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 -- start start 2023-12-08T20:55:32.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e806e030 0x7f29e8160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:32.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80c0eb0 0x7f29e813a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:32.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e8150300 0x7f29e8133960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:32.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e8160ad0 con 0x7f29e80c0eb0 2023-12-08T20:55:32.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e81f6110 con 0x7f29e806e030 2023-12-08T20:55:32.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29ee9b9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e81f5500 con 0x7f29e8150300 2023-12-08T20:55:32.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29e77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80c0eb0 0x7f29e813a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:32.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29e77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80c0eb0 0x7f29e813a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35004/0 (socket says 172.21.15.53:35004) 2023-12-08T20:55:32.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.754+0000 7f29e77fe640 1 -- 172.21.15.53:0/4123423286 learned_addr learned my addr 172.21.15.53:0/4123423286 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:32.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.758+0000 7f29ecf56640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e8150300 0x7f29e8133960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:32.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.758+0000 7f29e7fff640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e806e030 0x7f29e8160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:32.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.758+0000 7f29e77fe640 1 -- 172.21.15.53:0/4123423286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e8150300 msgr2=0x7f29e8133960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:32.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.758+0000 7f29e77fe640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e8150300 0x7f29e8133960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.758+0000 7f29e77fe640 1 -- 172.21.15.53:0/4123423286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e806e030 msgr2=0x7f29e8160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:32.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.758+0000 7f29e77fe640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e806e030 0x7f29e8160490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:32.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.758+0000 7f29e77fe640 1 -- 172.21.15.53:0/4123423286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00094d0 con 0x7f29e80c0eb0 2023-12-08T20:55:32.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.762+0000 7f29e77fe640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80c0eb0 0x7f29e813a090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29d000eed0 tx=0x7f29d000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.766+0000 7f29e4ff9640 1 -- 172.21.15.53:0/4123423286 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0010040 con 0x7f29e80c0eb0 2023-12-08T20:55:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.766+0000 7f29e4ff9640 1 -- 172.21.15.53:0/4123423286 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d000bd10 con 0x7f29e80c0eb0 2023-12-08T20:55:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.766+0000 7f29e4ff9640 1 -- 172.21.15.53:0/4123423286 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0014620 con 0x7f29e80c0eb0 2023-12-08T20:55:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.766+0000 7f29ee9b9640 1 -- 172.21.15.53:0/4123423286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e81f57e0 con 0x7f29e80c0eb0 2023-12-08T20:55:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.766+0000 7f29ee9b9640 1 -- 172.21.15.53:0/4123423286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e81f5da0 con 0x7f29e80c0eb0 2023-12-08T20:55:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:32.766+0000 7f29ee9b9640 1 -- 172.21.15.53:0/4123423286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e81f5f30 con 0x7f29e80c0eb0 2023-12-08T20:55:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.066+0000 7f29e4ff9640 1 -- 172.21.15.53:0/4123423286 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f29d0014990 con 0x7f29e80c0eb0 2023-12-08T20:55:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.066+0000 7f29e4ff9640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f29c8066470 0x7f29c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.066+0000 7f29e7fff640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f29c8066470 0x7f29c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.066+0000 7f29e7fff640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f29c8066470 0x7f29c8068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009b60 tx=0x7f29d8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:33.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.106+0000 7f29e4ff9640 1 -- 172.21.15.53:0/4123423286 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29d00560b0 con 0x7f29e80c0eb0 2023-12-08T20:55:33.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.122+0000 7f29e4ff9640 1 -- 172.21.15.53:0/4123423286 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29d00523f0 con 0x7f29e80c0eb0 2023-12-08T20:55:33.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.290+0000 7f29ee9b9640 1 -- 172.21.15.53:0/4123423286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29e81f6280 con 0x7f29e80c0eb0 2023-12-08T20:55:33.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.422+0000 7f29e4ff9640 1 -- 172.21.15.53:0/4123423286 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f29d0055a10 con 0x7f29e80c0eb0 2023-12-08T20:55:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:33.422 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:05.168215+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:55:33.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.426+0000 7f29ee9b9640 1 -- 172.21.15.53:0/4123423286 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f29c8066470 msgr2=0x7f29c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:33.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.426+0000 7f29ee9b9640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f29c8066470 0x7f29c8068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009b60 tx=0x7f29d8009190 comp rx=0 tx=0).stop 2023-12-08T20:55:33.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.426+0000 7f29ee9b9640 1 -- 172.21.15.53:0/4123423286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80c0eb0 msgr2=0x7f29e813a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:33.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.426+0000 7f29ee9b9640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80c0eb0 0x7f29e813a090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29d000eed0 tx=0x7f29d000b480 comp rx=0 tx=0).stop 2023-12-08T20:55:33.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.426+0000 7f29ee9b9640 1 -- 172.21.15.53:0/4123423286 shutdown_connections 2023-12-08T20:55:33.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.426+0000 7f29ee9b9640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f29c8066470 0x7f29c8068930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:33.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.426+0000 7f29ee9b9640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e8150300 0x7f29e8133960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:33.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.426+0000 7f29ee9b9640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80c0eb0 0x7f29e813a090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:33.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.426+0000 7f29ee9b9640 1 --2- 172.21.15.53:0/4123423286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e806e030 0x7f29e8160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:33.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.426+0000 7f29ee9b9640 1 -- 172.21.15.53:0/4123423286 >> 172.21.15.53:0/4123423286 conn(0x7f29e806b6c0 msgr2=0x7f29e8146290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:33.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.426+0000 7f29ee9b9640 1 -- 172.21.15.53:0/4123423286 shutdown_connections 2023-12-08T20:55:33.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.426+0000 7f29ee9b9640 1 -- 172.21.15.53:0/4123423286 wait complete. 2023-12-08T20:55:33.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-08T20:55:33.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.586+0000 7f28b7a4b640 1 Processor -- start 2023-12-08T20:55:33.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.586+0000 7f28b7a4b640 1 -- start start 2023-12-08T20:55:33.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.586+0000 7f28b7a4b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28b0153910 0x7f28b00ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:33.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.586+0000 7f28b7a4b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b00cb190 con 0x7f28b00ceed0 2023-12-08T20:55:33.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.586+0000 7f28b7a4b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b00cc2d0 con 0x7f28b015a180 2023-12-08T20:55:33.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.586+0000 7f28b7a4b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00ca120 con 0x7f28b0153910 2023-12-08T20:55:33.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.586+0000 7f28b5fe8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f28b00ceed0 0x7f28b0164080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58310/0 (socket says 172.21.15.53:58310) 2023-12-08T20:55:33.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.586+0000 7f28b5fe8640 1 -- 172.21.15.53:0/978194356 learned_addr learned my addr 172.21.15.53:0/978194356 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:33.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.590+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898620711 0 0) 0x7f28b00cb190 con 0x7f28b00ceed0 2023-12-08T20:55:33.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.590+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2898003530 con 0x7f28b00ceed0 2023-12-08T20:55:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1908600204 0 0) 0x7f2898003530 con 0x7f28b00ceed0 2023-12-08T20:55:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28b0153910 msgr2=0x7f28b00ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 --2- 172.21.15.53:0/978194356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28b0153910 0x7f28b00ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 >> v1:172.21.15.146:6789/0 conn(0x7f28b015a180 legacy=0x7f28b00c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b00c4530 con 0x7f28b00ceed0 2023-12-08T20:55:33.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 149952835 0 0) 0x7f28a8001a00 con 0x7f28b00ceed0 2023-12-08T20:55:33.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 >> v1:172.21.15.53:6789/0 conn(0x7f28b00ceed0 legacy=0x7f28b0164080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:33.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 --2- 172.21.15.53:0/978194356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28980039b0 0x7f2898003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:33.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 --2- 172.21.15.53:0/978194356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980047d0 0x7f2898004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:33.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 --2- 172.21.15.53:0/978194356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28b0153910 0x7f289800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:33.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00ca120 con 0x7f28980039b0 2023-12-08T20:55:33.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2898005580 con 0x7f28980047d0 2023-12-08T20:55:33.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.594+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289800bed0 con 0x7f28b0153910 2023-12-08T20:55:33.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.598+0000 7f28b57e7640 1 --2- 172.21.15.53:0/978194356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28980039b0 0x7f2898003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:33.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.602+0000 7f28b57e7640 1 -- 172.21.15.53:0/978194356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28b0153910 msgr2=0x7f289800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:33.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.602+0000 7f28b57e7640 1 --2- 172.21.15.53:0/978194356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28b0153910 0x7f289800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:33.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.602+0000 7f28b57e7640 1 -- 172.21.15.53:0/978194356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980047d0 msgr2=0x7f2898004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:33.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.602+0000 7f28b57e7640 1 --2- 172.21.15.53:0/978194356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980047d0 0x7f2898004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:33.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.602+0000 7f28b57e7640 1 -- 172.21.15.53:0/978194356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2898003530 con 0x7f28980039b0 2023-12-08T20:55:33.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.610+0000 7f28b57e7640 1 --2- 172.21.15.53:0/978194356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28980039b0 0x7f2898003db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009890 tx=0x7f28a001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b728403e8aa8fbd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:33.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.610+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00ab600 con 0x7f28980039b0 2023-12-08T20:55:33.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.610+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a00a7050 con 0x7f28980039b0 2023-12-08T20:55:33.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.610+0000 7f28affff640 1 -- 172.21.15.53:0/978194356 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00ab9c0 con 0x7f28980039b0 2023-12-08T20:55:33.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 -- 172.21.15.53:0/978194356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28980039b0 msgr2=0x7f2898003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:33.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 --2- 172.21.15.53:0/978194356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28980039b0 0x7f2898003db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009890 tx=0x7f28a001c3a0 comp rx=0 tx=0).stop 2023-12-08T20:55:33.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b5fe8640 1 -- 172.21.15.53:0/978194356 reap_dead start 2023-12-08T20:55:33.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 -- 172.21.15.53:0/978194356 shutdown_connections 2023-12-08T20:55:33.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 -- 172.21.15.53:0/978194356 >> 172.21.15.53:0/978194356 conn(0x7f28b008afc0 msgr2=0x7f28b008b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:33.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 -- 172.21.15.53:0/978194356 shutdown_connections 2023-12-08T20:55:33.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 -- 172.21.15.53:0/978194356 wait complete. 2023-12-08T20:55:33.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 Processor -- start 2023-12-08T20:55:33.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 -- start start 2023-12-08T20:55:33.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28b0158820 0x7f28b01ef610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:33.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28b015d3e0 0x7f28b01efb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:33.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b0158c00 0x7f28b0146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:33.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00c77e0 con 0x7f28b0158c00 2023-12-08T20:55:33.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00c7ac0 con 0x7f28b015d3e0 2023-12-08T20:55:33.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b7a4b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00c7da0 con 0x7f28b0158820 2023-12-08T20:55:33.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b5fe8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b0158c00 0x7f28b0146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:33.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b5fe8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b0158c00 0x7f28b0146800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35030/0 (socket says 172.21.15.53:35030) 2023-12-08T20:55:33.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.614+0000 7f28b5fe8640 1 -- 172.21.15.53:0/2198019075 learned_addr learned my addr 172.21.15.53:0/2198019075 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:33.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.618+0000 7f28b5fe8640 1 -- 172.21.15.53:0/2198019075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28b0158820 msgr2=0x7f28b01ef610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:33.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.618+0000 7f28b5fe8640 1 --2- 172.21.15.53:0/2198019075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28b0158820 0x7f28b01ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:33.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.618+0000 7f28b5fe8640 1 -- 172.21.15.53:0/2198019075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28b015d3e0 msgr2=0x7f28b01efb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:33.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.618+0000 7f28b5fe8640 1 --2- 172.21.15.53:0/2198019075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28b015d3e0 0x7f28b01efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:33.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.618+0000 7f28b5fe8640 1 -- 172.21.15.53:0/2198019075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b00c8080 con 0x7f28b0158c00 2023-12-08T20:55:33.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.622+0000 7f28b5fe8640 1 --2- 172.21.15.53:0/2198019075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b0158c00 0x7f28b0146800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f28b006b380 tx=0x7f28a800ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:33.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.626+0000 7f28adffb640 1 -- 172.21.15.53:0/2198019075 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800dba0 con 0x7f28b0158c00 2023-12-08T20:55:33.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.626+0000 7f28adffb640 1 -- 172.21.15.53:0/2198019075 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a800dd00 con 0x7f28b0158c00 2023-12-08T20:55:33.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.626+0000 7f28adffb640 1 -- 172.21.15.53:0/2198019075 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800a270 con 0x7f28b0158c00 2023-12-08T20:55:33.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.626+0000 7f28b7a4b640 1 -- 172.21.15.53:0/2198019075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b01ef0f0 con 0x7f28b0158c00 2023-12-08T20:55:33.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.626+0000 7f28b7a4b640 1 -- 172.21.15.53:0/2198019075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b00c82e0 con 0x7f28b0158c00 2023-12-08T20:55:33.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.626+0000 7f28b7a4b640 1 -- 172.21.15.53:0/2198019075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b01ef310 con 0x7f28b0158c00 2023-12-08T20:55:33.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.650+0000 7f28adffb640 1 -- 172.21.15.53:0/2198019075 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28a800a3d0 con 0x7f28b0158c00 2023-12-08T20:55:33.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.650+0000 7f28adffb640 1 --2- 172.21.15.53:0/2198019075 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f289c0664a0 0x7f289c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:33.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.650+0000 7f28b57e7640 1 --2- 172.21.15.53:0/2198019075 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f289c0664a0 0x7f289c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:33.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.650+0000 7f28b57e7640 1 --2- 172.21.15.53:0/2198019075 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f289c0664a0 0x7f289c068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f28a00ad000 tx=0x7f28a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:33.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.654+0000 7f28adffb640 1 -- 172.21.15.53:0/2198019075 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f28a800de70 con 0x7f28b0158c00 2023-12-08T20:55:33.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:33.938+0000 7f28adffb640 1 -- 172.21.15.53:0/2198019075 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f28a8053c80 con 0x7f28b0158c00 2023-12-08T20:55:34.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:34.210+0000 7f28b7a4b640 1 -- 172.21.15.53:0/2198019075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f28b00675b0 con 0x7f28b0158c00 2023-12-08T20:55:35.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.110+0000 7f28adffb640 1 -- 172.21.15.53:0/2198019075 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f28a801b070 con 0x7f28b0158c00 2023-12-08T20:55:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.114+0000 7f28b7a4b640 1 -- 172.21.15.53:0/2198019075 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f289c0664a0 msgr2=0x7f289c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.114+0000 7f28b7a4b640 1 --2- 172.21.15.53:0/2198019075 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f289c0664a0 0x7f289c068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f28a00ad000 tx=0x7f28a0008040 comp rx=0 tx=0).stop 2023-12-08T20:55:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.114+0000 7f28b7a4b640 1 -- 172.21.15.53:0/2198019075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b0158c00 msgr2=0x7f28b0146800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.114+0000 7f28b7a4b640 1 --2- 172.21.15.53:0/2198019075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b0158c00 0x7f28b0146800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f28b006b380 tx=0x7f28a800ff00 comp rx=0 tx=0).stop 2023-12-08T20:55:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.114+0000 7f28b7a4b640 1 -- 172.21.15.53:0/2198019075 shutdown_connections 2023-12-08T20:55:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.114+0000 7f28b7a4b640 1 --2- 172.21.15.53:0/2198019075 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f289c0664a0 0x7f289c068960 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.114+0000 7f28b7a4b640 1 --2- 172.21.15.53:0/2198019075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b0158c00 0x7f28b0146800 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.114+0000 7f28b7a4b640 1 --2- 172.21.15.53:0/2198019075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28b015d3e0 0x7f28b01efb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.114+0000 7f28b7a4b640 1 --2- 172.21.15.53:0/2198019075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28b0158820 0x7f28b01ef610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.114+0000 7f28b7a4b640 1 -- 172.21.15.53:0/2198019075 >> 172.21.15.53:0/2198019075 conn(0x7f28b008afc0 msgr2=0x7f28b00c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:35.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.114+0000 7f28b7a4b640 1 -- 172.21.15.53:0/2198019075 shutdown_connections 2023-12-08T20:55:35.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.114+0000 7f28b7a4b640 1 -- 172.21.15.53:0/2198019075 wait complete. 2023-12-08T20:55:35.134 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2023-12-08T20:55:35.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-08T20:55:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.266+0000 7f93f8b87640 1 Processor -- start 2023-12-08T20:55:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.266+0000 7f93f8b87640 1 -- start start 2023-12-08T20:55:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.270+0000 7f93f8b87640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93f4151730 0x7f93f40c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.270+0000 7f93f8b87640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f40b0c50 con 0x7f93f40c7d20 2023-12-08T20:55:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.270+0000 7f93f8b87640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f40ca830 con 0x7f93f4151350 2023-12-08T20:55:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.270+0000 7f93f8b87640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f40b0380 con 0x7f93f4151730 2023-12-08T20:55:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.270+0000 7f93f2d9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93f4151730 0x7f93f40c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:35.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.270+0000 7f93f259c640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f93f4151350 0x7f93f40c97e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.53:51800/0 (socket says 172.21.15.53:51800) 2023-12-08T20:55:35.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.270+0000 7f93f259c640 1 -- 172.21.15.53:0/3640781739 learned_addr learned my addr 172.21.15.53:0/3640781739 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.278+0000 7f93f2d9d640 1 -- 172.21.15.53:0/3640781739 >> v1:172.21.15.146:6789/0 conn(0x7f93f4151350 legacy=0x7f93f40c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.278+0000 7f93f2d9d640 1 -- 172.21.15.53:0/3640781739 >> v1:172.21.15.53:6789/0 conn(0x7f93f40c7d20 legacy=0x7f93f40cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.278+0000 7f93f2d9d640 1 -- 172.21.15.53:0/3640781739 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f40c26c0 con 0x7f93f4151730 2023-12-08T20:55:35.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.282+0000 7f93f2d9d640 1 --2- 172.21.15.53:0/3640781739 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93f4151730 0x7f93f40c2b50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f93e40097f0 tx=0x7f93e401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a1dd5e25113176a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:35.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.290+0000 7f93f159a640 1 -- 172.21.15.53:0/3640781739 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e40ab600 con 0x7f93f4151730 2023-12-08T20:55:35.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.290+0000 7f93f159a640 1 -- 172.21.15.53:0/3640781739 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e40a7050 con 0x7f93f4151730 2023-12-08T20:55:35.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.290+0000 7f93f159a640 1 -- 172.21.15.53:0/3640781739 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e40ab980 con 0x7f93f4151730 2023-12-08T20:55:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.290+0000 7f93f8b87640 1 -- 172.21.15.53:0/3640781739 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93f4151730 msgr2=0x7f93f40c2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.290+0000 7f93f8b87640 1 --2- 172.21.15.53:0/3640781739 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93f4151730 0x7f93f40c2b50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f93e40097f0 tx=0x7f93e401c3f0 comp rx=0 tx=0).stop 2023-12-08T20:55:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.290+0000 7f93f8b87640 1 -- 172.21.15.53:0/3640781739 shutdown_connections 2023-12-08T20:55:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.290+0000 7f93f8b87640 1 --2- 172.21.15.53:0/3640781739 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93f4151730 0x7f93f40c2b50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.290+0000 7f93f8b87640 1 -- 172.21.15.53:0/3640781739 >> 172.21.15.53:0/3640781739 conn(0x7f93f4060fd0 msgr2=0x7f93f40613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.290+0000 7f93f8b87640 1 -- 172.21.15.53:0/3640781739 shutdown_connections 2023-12-08T20:55:35.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.290+0000 7f93f8b87640 1 -- 172.21.15.53:0/3640781739 wait complete. 2023-12-08T20:55:35.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.294+0000 7f93f8b87640 1 Processor -- start 2023-12-08T20:55:35.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.294+0000 7f93f8b87640 1 -- start start 2023-12-08T20:55:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.294+0000 7f93f8b87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f40c7d20 0x7f93f40c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.294+0000 7f93f8b87640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93f4151350 0x7f93f41f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.294+0000 7f93f8b87640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93f4151730 0x7f93f41484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.294+0000 7f93f8b87640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f40afce0 con 0x7f93f40c7d20 2023-12-08T20:55:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.294+0000 7f93f8b87640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f40c46d0 con 0x7f93f4151730 2023-12-08T20:55:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.294+0000 7f93f8b87640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f41f4150 con 0x7f93f4151350 2023-12-08T20:55:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.294+0000 7f93f2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93f4151730 0x7f93f41484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.294+0000 7f93f2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93f4151730 0x7f93f41484e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:47100/0 (socket says 172.21.15.53:47100) 2023-12-08T20:55:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.294+0000 7f93f2d9d640 1 -- 172.21.15.53:0/1395115151 learned_addr learned my addr 172.21.15.53:0/1395115151 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.298+0000 7f93f1d9b640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93f4151350 0x7f93f41f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:35.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.306+0000 7f93f1d9b640 1 -- 172.21.15.53:0/1395115151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93f4151730 msgr2=0x7f93f41484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:35.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.306+0000 7f93f1d9b640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93f4151730 0x7f93f41484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:35.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.306+0000 7f93f1d9b640 1 -- 172.21.15.53:0/1395115151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f40c7d20 msgr2=0x7f93f40c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:35.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.306+0000 7f93f1d9b640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f40c7d20 0x7f93f40c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:35.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.306+0000 7f93f1d9b640 1 -- 172.21.15.53:0/1395115151 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4009420 con 0x7f93f4151350 2023-12-08T20:55:35.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.310+0000 7f93f1d9b640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93f4151350 0x7f93f41f3780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f93e800b410 tx=0x7f93e800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:35.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.322+0000 7f93e2ffd640 1 -- 172.21.15.53:0/1395115151 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8011830 con 0x7f93f4151350 2023-12-08T20:55:35.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.322+0000 7f93e2ffd640 1 -- 172.21.15.53:0/1395115151 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e80119d0 con 0x7f93f4151350 2023-12-08T20:55:35.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.322+0000 7f93e2ffd640 1 -- 172.21.15.53:0/1395115151 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8011d80 con 0x7f93f4151350 2023-12-08T20:55:35.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.322+0000 7f93f8b87640 1 -- 172.21.15.53:0/1395115151 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f41f43f0 con 0x7f93f4151350 2023-12-08T20:55:35.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.322+0000 7f93f8b87640 1 -- 172.21.15.53:0/1395115151 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f414cdf0 con 0x7f93f4151350 2023-12-08T20:55:35.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.322+0000 7f93f8b87640 1 -- 172.21.15.53:0/1395115151 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f4074190 con 0x7f93f4151350 2023-12-08T20:55:35.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.654+0000 7f93e2ffd640 1 -- 172.21.15.53:0/1395115151 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f93e8023430 con 0x7f93f4151350 2023-12-08T20:55:35.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.654+0000 7f93e2ffd640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f93d40664c0 0x7f93d4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:35.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.654+0000 7f93f259c640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f93d40664c0 0x7f93d4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:35.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.654+0000 7f93f259c640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f93d40664c0 0x7f93d4068980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f93ec001fe0 tx=0x7f93ec0015d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.662+0000 7f93e2ffd640 1 -- 172.21.15.53:0/1395115151 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f93e8055820 con 0x7f93f4151350 2023-12-08T20:55:35.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.690+0000 7f93e2ffd640 1 -- 172.21.15.53:0/1395115151 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f93e8051460 con 0x7f93f4151350 2023-12-08T20:55:35.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:35.930+0000 7f93f8b87640 1 -- 172.21.15.53:0/1395115151 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f93f40c40d0 con 0x7f93f4151350 2023-12-08T20:55:37.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.134+0000 7f93e2ffd640 1 -- 172.21.15.53:0/1395115151 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f93e8054a80 con 0x7f93f4151350 2023-12-08T20:55:37.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.134+0000 7f93f8b87640 1 -- 172.21.15.53:0/1395115151 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f93d40664c0 msgr2=0x7f93d4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:37.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.134+0000 7f93f8b87640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f93d40664c0 0x7f93d4068980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f93ec001fe0 tx=0x7f93ec0015d0 comp rx=0 tx=0).stop 2023-12-08T20:55:37.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.134+0000 7f93f8b87640 1 -- 172.21.15.53:0/1395115151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93f4151350 msgr2=0x7f93f41f3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:37.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.134+0000 7f93f8b87640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93f4151350 0x7f93f41f3780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f93e800b410 tx=0x7f93e800b8d0 comp rx=0 tx=0).stop 2023-12-08T20:55:37.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.134+0000 7f93f8b87640 1 -- 172.21.15.53:0/1395115151 shutdown_connections 2023-12-08T20:55:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.134+0000 7f93f8b87640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f93d40664c0 0x7f93d4068980 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.134+0000 7f93f8b87640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93f4151730 0x7f93f41484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.134+0000 7f93f8b87640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93f4151350 0x7f93f41f3780 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.134+0000 7f93f8b87640 1 --2- 172.21.15.53:0/1395115151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f40c7d20 0x7f93f40c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.138+0000 7f93f8b87640 1 -- 172.21.15.53:0/1395115151 >> 172.21.15.53:0/1395115151 conn(0x7f93f4060fd0 msgr2=0x7f93f40613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.138+0000 7f93f8b87640 1 -- 172.21.15.53:0/1395115151 shutdown_connections 2023-12-08T20:55:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.138+0000 7f93f8b87640 1 -- 172.21.15.53:0/1395115151 wait complete. 2023-12-08T20:55:37.162 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-12-08T20:55:37.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.310+0000 7f6f810b2640 1 Processor -- start 2023-12-08T20:55:37.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.310+0000 7f6f810b2640 1 -- start start 2023-12-08T20:55:37.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.310+0000 7f6f810b2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f7c0c4ec0 0x7f6f7c06b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:37.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.310+0000 7f6f810b2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6f7c157ef0 0x7f6f7c1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:37.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.310+0000 7f6f810b2640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7c15b510 con 0x7f6f7c0c52a0 2023-12-08T20:55:37.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.310+0000 7f6f810b2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7c0c77c0 con 0x7f6f7c157ef0 2023-12-08T20:55:37.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.310+0000 7f6f810b2640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c157390 con 0x7f6f7c0c4ec0 2023-12-08T20:55:37.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.310+0000 7f6f7ad9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f7c0c4ec0 0x7f6f7c06b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:37.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.314+0000 7f6f7a59c640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6f7c0c52a0 0x7f6f7c1577e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.53:51804/0 (socket says 172.21.15.53:51804) 2023-12-08T20:55:37.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.314+0000 7f6f7a59c640 1 -- 172.21.15.53:0/2376432039 learned_addr learned my addr 172.21.15.53:0/2376432039 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:37.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.318+0000 7f6f7ad9d640 1 -- 172.21.15.53:0/2376432039 >> v2:172.21.15.53:3300/0 conn(0x7f6f7c157ef0 msgr2=0x7f6f7c1510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:37.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.318+0000 7f6f7ad9d640 1 --2- 172.21.15.53:0/2376432039 >> v2:172.21.15.53:3300/0 conn(0x7f6f7c157ef0 0x7f6f7c1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:37.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.318+0000 7f6f7ad9d640 1 -- 172.21.15.53:0/2376432039 >> v1:172.21.15.146:6789/0 conn(0x7f6f7c0c52a0 legacy=0x7f6f7c1577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:37.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.318+0000 7f6f7ad9d640 1 -- 172.21.15.53:0/2376432039 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c15b7f0 con 0x7f6f7c0c4ec0 2023-12-08T20:55:37.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.326+0000 7f6f7ad9d640 1 --2- 172.21.15.53:0/2376432039 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f7c0c4ec0 0x7f6f7c06b6b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f700097c0 tx=0x7f6f7001ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d17b5b05ad3f8774 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:37.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.334+0000 7f6f79d9b640 1 -- 172.21.15.53:0/2376432039 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700a8970 con 0x7f6f7c0c4ec0 2023-12-08T20:55:37.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.334+0000 7f6f79d9b640 1 -- 172.21.15.53:0/2376432039 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f700a8ad0 con 0x7f6f7c0c4ec0 2023-12-08T20:55:37.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.334+0000 7f6f79d9b640 1 -- 172.21.15.53:0/2376432039 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700a8e60 con 0x7f6f7c0c4ec0 2023-12-08T20:55:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 -- 172.21.15.53:0/2376432039 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f7c0c4ec0 msgr2=0x7f6f7c06b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 --2- 172.21.15.53:0/2376432039 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f7c0c4ec0 0x7f6f7c06b6b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f700097c0 tx=0x7f6f7001ec70 comp rx=0 tx=0).stop 2023-12-08T20:55:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 -- 172.21.15.53:0/2376432039 shutdown_connections 2023-12-08T20:55:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 --2- 172.21.15.53:0/2376432039 >> v2:172.21.15.53:3300/0 conn(0x7f6f7c157ef0 0x7f6f7c1510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 --2- 172.21.15.53:0/2376432039 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f7c0c4ec0 0x7f6f7c06b6b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 -- 172.21.15.53:0/2376432039 >> 172.21.15.53:0/2376432039 conn(0x7f6f7c0cbb50 msgr2=0x7f6f7c06f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 -- 172.21.15.53:0/2376432039 shutdown_connections 2023-12-08T20:55:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 -- 172.21.15.53:0/2376432039 wait complete. 2023-12-08T20:55:37.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 Processor -- start 2023-12-08T20:55:37.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 -- start start 2023-12-08T20:55:37.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f7c0c4ec0 0x7f6f7c1489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:37.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f7c0c52a0 0x7f6f7c0c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:37.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f7c157ef0 0x7f6f7c149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:37.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c1efcf0 con 0x7f6f7c157ef0 2023-12-08T20:55:37.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c1f33c0 con 0x7f6f7c0c4ec0 2023-12-08T20:55:37.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f810b2640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c1ef3c0 con 0x7f6f7c0c52a0 2023-12-08T20:55:37.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.338+0000 7f6f7b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f7c157ef0 0x7f6f7c149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:37.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.342+0000 7f6f7b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f7c157ef0 0x7f6f7c149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35056/0 (socket says 172.21.15.53:35056) 2023-12-08T20:55:37.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.342+0000 7f6f7b59e640 1 -- 172.21.15.53:0/2655103263 learned_addr learned my addr 172.21.15.53:0/2655103263 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:37.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.342+0000 7f6f7ad9d640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f7c0c4ec0 0x7f6f7c1489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:37.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.342+0000 7f6f7a59c640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f7c0c52a0 0x7f6f7c0c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:37.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.346+0000 7f6f7b59e640 1 -- 172.21.15.53:0/2655103263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f7c0c52a0 msgr2=0x7f6f7c0c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:37.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.346+0000 7f6f7b59e640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f7c0c52a0 0x7f6f7c0c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:37.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.346+0000 7f6f7b59e640 1 -- 172.21.15.53:0/2655103263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f7c0c4ec0 msgr2=0x7f6f7c1489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:37.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.346+0000 7f6f7b59e640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f7c0c4ec0 0x7f6f7c1489c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:37.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.346+0000 7f6f7b59e640 1 -- 172.21.15.53:0/2655103263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f70009420 con 0x7f6f7c157ef0 2023-12-08T20:55:37.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.350+0000 7f6f7b59e640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f7c157ef0 0x7f6f7c149240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400b9e0 tx=0x7f6f7400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:37.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.354+0000 7f6f637fe640 1 -- 172.21.15.53:0/2655103263 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7400cb20 con 0x7f6f7c157ef0 2023-12-08T20:55:37.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.354+0000 7f6f637fe640 1 -- 172.21.15.53:0/2655103263 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7400cc80 con 0x7f6f7c157ef0 2023-12-08T20:55:37.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.354+0000 7f6f810b2640 1 -- 172.21.15.53:0/2655103263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c1ef6a0 con 0x7f6f7c157ef0 2023-12-08T20:55:37.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.354+0000 7f6f637fe640 1 -- 172.21.15.53:0/2655103263 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74014680 con 0x7f6f7c157ef0 2023-12-08T20:55:37.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.354+0000 7f6f810b2640 1 -- 172.21.15.53:0/2655103263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c1ef070 con 0x7f6f7c157ef0 2023-12-08T20:55:37.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.358+0000 7f6f810b2640 1 -- 172.21.15.53:0/2655103263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c14d880 con 0x7f6f7c157ef0 2023-12-08T20:55:37.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.378+0000 7f6f637fe640 1 -- 172.21.15.53:0/2655103263 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6f7401c360 con 0x7f6f7c157ef0 2023-12-08T20:55:37.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.378+0000 7f6f637fe640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6f680664f0 0x7f6f680689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:37.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.378+0000 7f6f7ad9d640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6f680664f0 0x7f6f680689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:37.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.378+0000 7f6f7ad9d640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6f680664f0 0x7f6f680689b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6f700b2000 tx=0x7f6f700aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:37.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.382+0000 7f6f637fe640 1 -- 172.21.15.53:0/2655103263 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f7400ce30 con 0x7f6f7c157ef0 2023-12-08T20:55:37.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.666+0000 7f6f637fe640 1 -- 172.21.15.53:0/2655103263 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f74051670 con 0x7f6f7c157ef0 2023-12-08T20:55:37.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:37.886+0000 7f6f810b2640 1 -- 172.21.15.53:0/2655103263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f6f7c074190 con 0x7f6f7c157ef0 2023-12-08T20:55:38.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.446+0000 7f6f637fe640 1 -- 172.21.15.53:0/2655103263 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) v1 ==== 115+0+0 (secure 0 0 0) 0x7f6f74019020 con 0x7f6f7c157ef0 2023-12-08T20:55:38.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.450+0000 7f6f810b2640 1 -- 172.21.15.53:0/2655103263 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6f680664f0 msgr2=0x7f6f680689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:38.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.450+0000 7f6f810b2640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6f680664f0 0x7f6f680689b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6f700b2000 tx=0x7f6f700aa070 comp rx=0 tx=0).stop 2023-12-08T20:55:38.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.450+0000 7f6f810b2640 1 -- 172.21.15.53:0/2655103263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f7c157ef0 msgr2=0x7f6f7c149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:38.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.450+0000 7f6f810b2640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f7c157ef0 0x7f6f7c149240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400b9e0 tx=0x7f6f7400bea0 comp rx=0 tx=0).stop 2023-12-08T20:55:38.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.450+0000 7f6f810b2640 1 -- 172.21.15.53:0/2655103263 shutdown_connections 2023-12-08T20:55:38.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.450+0000 7f6f810b2640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6f680664f0 0x7f6f680689b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:38.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.450+0000 7f6f810b2640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f7c157ef0 0x7f6f7c149240 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:38.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.450+0000 7f6f810b2640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f7c0c52a0 0x7f6f7c0c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:38.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.450+0000 7f6f810b2640 1 --2- 172.21.15.53:0/2655103263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f7c0c4ec0 0x7f6f7c1489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:38.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.450+0000 7f6f810b2640 1 -- 172.21.15.53:0/2655103263 >> 172.21.15.53:0/2655103263 conn(0x7f6f7c0cbb50 msgr2=0x7f6f7c071640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:38.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.450+0000 7f6f810b2640 1 -- 172.21.15.53:0/2655103263 shutdown_connections 2023-12-08T20:55:38.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.450+0000 7f6f810b2640 1 -- 172.21.15.53:0/2655103263 wait complete. 2023-12-08T20:55:38.472 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-08T20:55:38.472 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T20:55:38.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.602+0000 7fb027436640 1 Processor -- start 2023-12-08T20:55:38.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.602+0000 7fb027436640 1 -- start start 2023-12-08T20:55:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.602+0000 7fb027436640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0200c1cf0 0x7fb02015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.602+0000 7fb027436640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0200c01a0 con 0x7fb0200c6410 2023-12-08T20:55:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.602+0000 7fb027436640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02006f3a0 con 0x7fb0200c1910 2023-12-08T20:55:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.602+0000 7fb027436640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02006ede0 con 0x7fb0200c1cf0 2023-12-08T20:55:38.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.602+0000 7fb0259d3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb0200c6410 0x7fb020160bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58338/0 (socket says 172.21.15.53:58338) 2023-12-08T20:55:38.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.602+0000 7fb0259d3640 1 -- 172.21.15.53:0/509861900 learned_addr learned my addr 172.21.15.53:0/509861900 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:38.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.606+0000 7fb0249d1640 1 --2- 172.21.15.53:0/509861900 >> v2:172.21.15.146:3300/0 conn(0x7fb0200c1cf0 0x7fb02015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:38.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.606+0000 7fb017fff640 1 -- 172.21.15.53:0/509861900 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130581101 0 0) 0x7fb0200c01a0 con 0x7fb0200c6410 2023-12-08T20:55:38.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.606+0000 7fb017fff640 1 -- 172.21.15.53:0/509861900 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb00c005740 con 0x7fb0200c6410 2023-12-08T20:55:38.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.614+0000 7fb0249d1640 1 -- 172.21.15.53:0/509861900 >> v1:172.21.15.146:6789/0 conn(0x7fb0200c1910 legacy=0x7fb02014cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:38.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.614+0000 7fb0249d1640 1 -- 172.21.15.53:0/509861900 >> v1:172.21.15.53:6789/0 conn(0x7fb0200c6410 legacy=0x7fb020160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:38.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.614+0000 7fb0249d1640 1 -- 172.21.15.53:0/509861900 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02006f0c0 con 0x7fb0200c1cf0 2023-12-08T20:55:38.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.618+0000 7fb0249d1640 1 --2- 172.21.15.53:0/509861900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0200c1cf0 0x7fb02015a440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0097c0 tx=0x7fb01c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b95d6a05e2448310 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:38.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.622+0000 7fb017fff640 1 -- 172.21.15.53:0/509861900 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c004230 con 0x7fb0200c1cf0 2023-12-08T20:55:38.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.622+0000 7fb017fff640 1 -- 172.21.15.53:0/509861900 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c0a7050 con 0x7fb0200c1cf0 2023-12-08T20:55:38.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.622+0000 7fb017fff640 1 -- 172.21.15.53:0/509861900 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c003620 con 0x7fb0200c1cf0 2023-12-08T20:55:38.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 -- 172.21.15.53:0/509861900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0200c1cf0 msgr2=0x7fb02015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:38.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 --2- 172.21.15.53:0/509861900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0200c1cf0 0x7fb02015a440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0097c0 tx=0x7fb01c01c450 comp rx=0 tx=0).stop 2023-12-08T20:55:38.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 -- 172.21.15.53:0/509861900 shutdown_connections 2023-12-08T20:55:38.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 --2- 172.21.15.53:0/509861900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0200c1cf0 0x7fb02015a440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:38.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 -- 172.21.15.53:0/509861900 >> 172.21.15.53:0/509861900 conn(0x7fb0200caef0 msgr2=0x7fb0200cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:38.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 -- 172.21.15.53:0/509861900 shutdown_connections 2023-12-08T20:55:38.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 -- 172.21.15.53:0/509861900 wait complete. 2023-12-08T20:55:38.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 Processor -- start 2023-12-08T20:55:38.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 -- start start 2023-12-08T20:55:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0200c1910 0x7fb0201ef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0200c1cf0 0x7fb0200c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0200c6410 0x7fb020141a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0200c2df0 con 0x7fb0200c1910 2023-12-08T20:55:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0201ef6f0 con 0x7fb0200c1cf0 2023-12-08T20:55:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb027436640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb020141570 con 0x7fb0200c6410 2023-12-08T20:55:38.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb0251d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0200c1910 0x7fb0201ef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:38.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb0259d3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0200c6410 0x7fb020141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:38.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb0251d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0200c1910 0x7fb0201ef1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35062/0 (socket says 172.21.15.53:35062) 2023-12-08T20:55:38.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.626+0000 7fb0251d2640 1 -- 172.21.15.53:0/1435418001 learned_addr learned my addr 172.21.15.53:0/1435418001 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:38.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.630+0000 7fb0249d1640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0200c1cf0 0x7fb0200c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:38.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.630+0000 7fb0251d2640 1 -- 172.21.15.53:0/1435418001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0200c6410 msgr2=0x7fb020141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:38.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.630+0000 7fb0251d2640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0200c6410 0x7fb020141a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:38.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.630+0000 7fb0251d2640 1 -- 172.21.15.53:0/1435418001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0200c1cf0 msgr2=0x7fb0200c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:38.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.630+0000 7fb0251d2640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0200c1cf0 0x7fb0200c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:38.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.630+0000 7fb0251d2640 1 -- 172.21.15.53:0/1435418001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c009420 con 0x7fb0200c1910 2023-12-08T20:55:38.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.634+0000 7fb0251d2640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0200c1910 0x7fb0201ef1b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb01000c420 tx=0x7fb01000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:38.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.638+0000 7fb015ffb640 1 -- 172.21.15.53:0/1435418001 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100052d0 con 0x7fb0200c1910 2023-12-08T20:55:38.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.638+0000 7fb015ffb640 1 -- 172.21.15.53:0/1435418001 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb010005430 con 0x7fb0200c1910 2023-12-08T20:55:38.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.638+0000 7fb015ffb640 1 -- 172.21.15.53:0/1435418001 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010007260 con 0x7fb0200c1910 2023-12-08T20:55:38.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.638+0000 7fb027436640 1 -- 172.21.15.53:0/1435418001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02006ebb0 con 0x7fb0200c1910 2023-12-08T20:55:38.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.638+0000 7fb027436640 1 -- 172.21.15.53:0/1435418001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0200c2550 con 0x7fb0200c1910 2023-12-08T20:55:38.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.638+0000 7fb027436640 1 -- 172.21.15.53:0/1435418001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0200675b0 con 0x7fb0200c1910 2023-12-08T20:55:38.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.938+0000 7fb015ffb640 1 -- 172.21.15.53:0/1435418001 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb0100073c0 con 0x7fb0200c1910 2023-12-08T20:55:38.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.938+0000 7fb015ffb640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb0040664f0 0x7fb0040689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:38.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.938+0000 7fb0249d1640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb0040664f0 0x7fb0040689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:38.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.938+0000 7fb0249d1640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb0040664f0 0x7fb0040689b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0ad000 tx=0x7fb01c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.974+0000 7fb015ffb640 1 -- 172.21.15.53:0/1435418001 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb010054bb0 con 0x7fb0200c1910 2023-12-08T20:55:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:38.974+0000 7fb015ffb640 1 -- 172.21.15.53:0/1435418001 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb010050ef0 con 0x7fb0200c1910 2023-12-08T20:55:39.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.178+0000 7fb027436640 1 -- 172.21.15.53:0/1435418001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb020141340 con 0x7fb0200c1910 2023-12-08T20:55:39.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.218+0000 7fb015ffb640 1 -- 172.21.15.53:0/1435418001 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6501 (secure 0 0 0) 0x7fb010020070 con 0x7fb0200c1910 2023-12-08T20:55:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:39.218 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6838/3541484412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3541484412},{"type":"v1","addr":"172.21.15.53:6838","nonce":3541484412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/2329639389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6837","nonce":2329639389},{"type":"v1","addr":"172.21.15.53:6839","nonce":2329639389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3938297948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3938297948},{"type":"v1","addr":"172.21.15.146:6833","nonce":3938297948}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2026540331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2026540331},{"type":"v1","addr":"172.21.15.146:6836","nonce":2026540331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/4236922545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4236922545},{"type":"v1","addr":"172.21.15.146:6837","nonce":4236922545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T20:54:56.254252+0000","modified":"2023-12-08T20:55:37.903706+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6835/3454931938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3454931938},{"type":"v1","addr":"172.21.15.53:6835","nonce":3454931938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T20:55:39.218 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 10 2023-12-08T20:55:39.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.222+0000 7fb027436640 1 -- 172.21.15.53:0/1435418001 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb0040664f0 msgr2=0x7fb0040689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:39.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.222+0000 7fb027436640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb0040664f0 0x7fb0040689b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0ad000 tx=0x7fb01c0a6000 comp rx=0 tx=0).stop 2023-12-08T20:55:39.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.222+0000 7fb027436640 1 -- 172.21.15.53:0/1435418001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0200c1910 msgr2=0x7fb0201ef1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:39.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.222+0000 7fb027436640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0200c1910 0x7fb0201ef1b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb01000c420 tx=0x7fb01000c8e0 comp rx=0 tx=0).stop 2023-12-08T20:55:39.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.222+0000 7fb027436640 1 -- 172.21.15.53:0/1435418001 shutdown_connections 2023-12-08T20:55:39.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.222+0000 7fb027436640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb0040664f0 0x7fb0040689b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:39.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.222+0000 7fb027436640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0200c6410 0x7fb020141a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:39.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.222+0000 7fb027436640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0200c1cf0 0x7fb0200c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:39.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.222+0000 7fb027436640 1 --2- 172.21.15.53:0/1435418001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0200c1910 0x7fb0201ef1b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:39.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.222+0000 7fb027436640 1 -- 172.21.15.53:0/1435418001 >> 172.21.15.53:0/1435418001 conn(0x7fb0200caef0 msgr2=0x7fb020073900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:39.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.222+0000 7fb027436640 1 -- 172.21.15.53:0/1435418001 shutdown_connections 2023-12-08T20:55:39.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.222+0000 7fb027436640 1 -- 172.21.15.53:0/1435418001 wait complete. 2023-12-08T20:55:39.243 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:55:39.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.366+0000 7fafc54b7640 1 Processor -- start 2023-12-08T20:55:39.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.366+0000 7fafc54b7640 1 -- start start 2023-12-08T20:55:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.366+0000 7fafc54b7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0153910 0x7fafc00ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.366+0000 7fafc54b7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc00cb190 con 0x7fafc015a180 2023-12-08T20:55:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.366+0000 7fafc54b7640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc00cc2d0 con 0x7fafc00ceed0 2023-12-08T20:55:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.366+0000 7fafc54b7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc00ca120 con 0x7fafc0153910 2023-12-08T20:55:39.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.374+0000 7fafbe7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fafc015a180 0x7fafc00c3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58348/0 (socket says 172.21.15.53:58348) 2023-12-08T20:55:39.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.374+0000 7fafbe7fc640 1 -- 172.21.15.53:0/1707308894 learned_addr learned my addr 172.21.15.53:0/1707308894 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:39.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.378+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555560246 0 0) 0x7fafc00cb190 con 0x7fafc015a180 2023-12-08T20:55:39.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.378+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa8003530 con 0x7fafc015a180 2023-12-08T20:55:39.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.382+0000 7fafbeffd640 1 --2- 172.21.15.53:0/1707308894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0153910 0x7fafc00ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4281310330 0 0) 0x7fafa8003530 con 0x7fafc015a180 2023-12-08T20:55:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0153910 msgr2=0x7fafc00ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 --2- 172.21.15.53:0/1707308894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0153910 0x7fafc00ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 >> v1:172.21.15.146:6789/0 conn(0x7fafc00ceed0 legacy=0x7fafc0164080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc00c4530 con 0x7fafc015a180 2023-12-08T20:55:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 149952835 0 0) 0x7fafb4001680 con 0x7fafc015a180 2023-12-08T20:55:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 >> v1:172.21.15.53:6789/0 conn(0x7fafc015a180 legacy=0x7fafc00c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 --2- 172.21.15.53:0/1707308894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa80039b0 0x7fafa8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 --2- 172.21.15.53:0/1707308894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0153910 0x7fafa80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 --2- 172.21.15.53:0/1707308894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa8004de0 0x7fafa8005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc00ca120 con 0x7fafa8004de0 2023-12-08T20:55:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa800bc80 con 0x7fafa80039b0 2023-12-08T20:55:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.386+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa800be40 con 0x7fafc0153910 2023-12-08T20:55:39.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.390+0000 7fafbeffd640 1 --2- 172.21.15.53:0/1707308894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa80039b0 0x7fafa8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.394+0000 7fafbf7fe640 1 --2- 172.21.15.53:0/1707308894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa8004de0 0x7fafa8005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.394+0000 7fafbe7fc640 1 --2- 172.21.15.53:0/1707308894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0153910 0x7fafa80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:39.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.398+0000 7fafbf7fe640 1 -- 172.21.15.53:0/1707308894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0153910 msgr2=0x7fafa80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:39.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.398+0000 7fafbf7fe640 1 --2- 172.21.15.53:0/1707308894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0153910 0x7fafa80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:39.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.398+0000 7fafbf7fe640 1 -- 172.21.15.53:0/1707308894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa80039b0 msgr2=0x7fafa8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:39.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.398+0000 7fafbf7fe640 1 --2- 172.21.15.53:0/1707308894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa80039b0 0x7fafa8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:39.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.398+0000 7fafbf7fe640 1 -- 172.21.15.53:0/1707308894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa8003530 con 0x7fafa8004de0 2023-12-08T20:55:39.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.402+0000 7fafbf7fe640 1 --2- 172.21.15.53:0/1707308894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa8004de0 0x7fafa8005260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fafb8001e70 tx=0x7fafb801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daed0c3995caa7d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:39.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.406+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8003b80 con 0x7fafa8004de0 2023-12-08T20:55:39.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.406+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb8003ce0 con 0x7fafa8004de0 2023-12-08T20:55:39.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.406+0000 7fafbdffb640 1 -- 172.21.15.53:0/1707308894 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb80052c0 con 0x7fafa8004de0 2023-12-08T20:55:39.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.406+0000 7fafc54b7640 1 -- 172.21.15.53:0/1707308894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa8004de0 msgr2=0x7fafa8005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:39.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.406+0000 7fafc54b7640 1 --2- 172.21.15.53:0/1707308894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa8004de0 0x7fafa8005260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fafb8001e70 tx=0x7fafb801c760 comp rx=0 tx=0).stop 2023-12-08T20:55:39.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.406+0000 7fafbf7fe640 1 -- 172.21.15.53:0/1707308894 reap_dead start 2023-12-08T20:55:39.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.406+0000 7fafc54b7640 1 -- 172.21.15.53:0/1707308894 shutdown_connections 2023-12-08T20:55:39.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.406+0000 7fafc54b7640 1 -- 172.21.15.53:0/1707308894 >> 172.21.15.53:0/1707308894 conn(0x7fafc008afc0 msgr2=0x7fafc008b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:39.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.406+0000 7fafc54b7640 1 -- 172.21.15.53:0/1707308894 shutdown_connections 2023-12-08T20:55:39.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.406+0000 7fafc54b7640 1 -- 172.21.15.53:0/1707308894 wait complete. 2023-12-08T20:55:39.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafc54b7640 1 Processor -- start 2023-12-08T20:55:39.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafc54b7640 1 -- start start 2023-12-08T20:55:39.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafc54b7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0148860 0x7fafc015c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:39.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafc54b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafc0148c40 0x7fafc01f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:39.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafc54b7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafc01584c0 0x7fafc0145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:39.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafc54b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc015ce90 con 0x7fafc0148c40 2023-12-08T20:55:39.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafc54b7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc014e240 con 0x7fafc01584c0 2023-12-08T20:55:39.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafc54b7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc01f3350 con 0x7fafc0148860 2023-12-08T20:55:39.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafbe7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafc0148c40 0x7fafc01f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:39.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafbe7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafc0148c40 0x7fafc01f2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35084/0 (socket says 172.21.15.53:35084) 2023-12-08T20:55:39.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafbe7fc640 1 -- 172.21.15.53:0/4165327947 learned_addr learned my addr 172.21.15.53:0/4165327947 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:39.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafbeffd640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0148860 0x7fafc015c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:39.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.410+0000 7fafbf7fe640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafc01584c0 0x7fafc0145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:39.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.414+0000 7fafbe7fc640 1 -- 172.21.15.53:0/4165327947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0148860 msgr2=0x7fafc015c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:39.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.414+0000 7fafbe7fc640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0148860 0x7fafc015c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:39.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.414+0000 7fafbe7fc640 1 -- 172.21.15.53:0/4165327947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafc01584c0 msgr2=0x7fafc0145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:39.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.414+0000 7fafbe7fc640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafc01584c0 0x7fafc0145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:39.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.414+0000 7fafbe7fc640 1 -- 172.21.15.53:0/4165327947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc015a8c0 con 0x7fafc0148c40 2023-12-08T20:55:39.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.418+0000 7fafbe7fc640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafc0148c40 0x7fafc01f2e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fafb40072c0 tx=0x7fafb4004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:39.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.422+0000 7fafa77fe640 1 -- 172.21.15.53:0/4165327947 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400f960 con 0x7fafc0148c40 2023-12-08T20:55:39.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.422+0000 7fafa77fe640 1 -- 172.21.15.53:0/4165327947 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb400fae0 con 0x7fafc0148c40 2023-12-08T20:55:39.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.422+0000 7fafc54b7640 1 -- 172.21.15.53:0/4165327947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc015b0d0 con 0x7fafc0148c40 2023-12-08T20:55:39.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.422+0000 7fafa77fe640 1 -- 172.21.15.53:0/4165327947 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400fe90 con 0x7fafc0148c40 2023-12-08T20:55:39.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.422+0000 7fafc54b7640 1 -- 172.21.15.53:0/4165327947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc015dad0 con 0x7fafc0148c40 2023-12-08T20:55:39.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.422+0000 7fafc54b7640 1 -- 172.21.15.53:0/4165327947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc00675b0 con 0x7fafc0148c40 2023-12-08T20:55:39.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.442+0000 7fafa77fe640 1 -- 172.21.15.53:0/4165327947 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fafb401d460 con 0x7fafc0148c40 2023-12-08T20:55:39.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.442+0000 7fafa77fe640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fafac0664c0 0x7fafac068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:39.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.442+0000 7fafbeffd640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fafac0664c0 0x7fafac068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:39.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.442+0000 7fafbeffd640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fafac0664c0 0x7fafac068980 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fafb00045b0 tx=0x7fafb0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:39.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.742+0000 7fafa77fe640 1 -- 172.21.15.53:0/4165327947 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fafb4055ca0 con 0x7fafc0148c40 2023-12-08T20:55:39.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.742+0000 7fafa77fe640 1 -- 172.21.15.53:0/4165327947 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fafb4051fe0 con 0x7fafc0148c40 2023-12-08T20:55:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:39.918+0000 7fafc54b7640 1 -- 172.21.15.53:0/4165327947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafc014d9a0 con 0x7fafc0148c40 2023-12-08T20:55:40.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafa77fe640 1 -- 172.21.15.53:0/4165327947 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fafb4055600 con 0x7fafc0148c40 2023-12-08T20:55:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:40.005 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:05.168215+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:55:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafc54b7640 1 -- 172.21.15.53:0/4165327947 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fafac0664c0 msgr2=0x7fafac068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafc54b7640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fafac0664c0 0x7fafac068980 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fafb00045b0 tx=0x7fafb0008040 comp rx=0 tx=0).stop 2023-12-08T20:55:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafc54b7640 1 -- 172.21.15.53:0/4165327947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafc0148c40 msgr2=0x7fafc01f2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafc54b7640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafc0148c40 0x7fafc01f2e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fafb40072c0 tx=0x7fafb4004f90 comp rx=0 tx=0).stop 2023-12-08T20:55:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafc54b7640 1 -- 172.21.15.53:0/4165327947 shutdown_connections 2023-12-08T20:55:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafc54b7640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fafac0664c0 0x7fafac068980 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafc54b7640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafc01584c0 0x7fafc0145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafc54b7640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafc0148c40 0x7fafc01f2e10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafc54b7640 1 --2- 172.21.15.53:0/4165327947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafc0148860 0x7fafc015c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafc54b7640 1 -- 172.21.15.53:0/4165327947 >> 172.21.15.53:0/4165327947 conn(0x7fafc008afc0 msgr2=0x7fafc00ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafc54b7640 1 -- 172.21.15.53:0/4165327947 shutdown_connections 2023-12-08T20:55:40.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.006+0000 7fafc54b7640 1 -- 172.21.15.53:0/4165327947 wait complete. 2023-12-08T20:55:40.031 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T20:55:40.031 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T20:55:40.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.158+0000 7fdfd56f7640 1 Processor -- start 2023-12-08T20:55:40.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.158+0000 7fdfd56f7640 1 -- start start 2023-12-08T20:55:40.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.162+0000 7fdfd56f7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdfd006ed30 0x7fdfd00c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:40.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.162+0000 7fdfd56f7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfd0071140 0x7fdfd0157290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:40.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.162+0000 7fdfd56f7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd0157e90 con 0x7fdfd006f110 2023-12-08T20:55:40.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.162+0000 7fdfd56f7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd0158170 con 0x7fdfd006ed30 2023-12-08T20:55:40.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.162+0000 7fdfd56f7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd015a920 con 0x7fdfd0071140 2023-12-08T20:55:40.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.162+0000 7fdfce7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdfd006f110 0x7fdfd006d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58354/0 (socket says 172.21.15.53:58354) 2023-12-08T20:55:40.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.162+0000 7fdfce7fc640 1 -- 172.21.15.53:0/732614113 learned_addr learned my addr 172.21.15.53:0/732614113 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:40.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.162+0000 7fdfcf7fe640 1 --2- 172.21.15.53:0/732614113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfd0071140 0x7fdfd0157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:40.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.162+0000 7fdfceffd640 1 --2- 172.21.15.53:0/732614113 >> v2:172.21.15.53:3300/0 conn(0x7fdfd006ed30 0x7fdfd00c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:40.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.166+0000 7fdfcdffb640 1 -- 172.21.15.53:0/732614113 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625454418 0 0) 0x7fdfd0157e90 con 0x7fdfd006f110 2023-12-08T20:55:40.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.166+0000 7fdfcdffb640 1 -- 172.21.15.53:0/732614113 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb8003530 con 0x7fdfd006f110 2023-12-08T20:55:40.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.170+0000 7fdfceffd640 1 -- 172.21.15.53:0/732614113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfd0071140 msgr2=0x7fdfd0157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:40.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.170+0000 7fdfceffd640 1 --2- 172.21.15.53:0/732614113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfd0071140 0x7fdfd0157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.170+0000 7fdfceffd640 1 -- 172.21.15.53:0/732614113 >> v1:172.21.15.53:6789/0 conn(0x7fdfd006f110 legacy=0x7fdfd006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:40.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.170+0000 7fdfceffd640 1 -- 172.21.15.53:0/732614113 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd015ac00 con 0x7fdfd006ed30 2023-12-08T20:55:40.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.174+0000 7fdfceffd640 1 --2- 172.21.15.53:0/732614113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd006ed30 0x7fdfd00c58f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00097c0 tx=0x7fdfc001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583e245fce9504dd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:40.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.178+0000 7fdfcdffb640 1 -- 172.21.15.53:0/732614113 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc00a8970 con 0x7fdfd006ed30 2023-12-08T20:55:40.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.178+0000 7fdfcdffb640 1 -- 172.21.15.53:0/732614113 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc00a8ad0 con 0x7fdfd006ed30 2023-12-08T20:55:40.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.178+0000 7fdfcdffb640 1 -- 172.21.15.53:0/732614113 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc00a8e60 con 0x7fdfd006ed30 2023-12-08T20:55:40.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 -- 172.21.15.53:0/732614113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd006ed30 msgr2=0x7fdfd00c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:40.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 --2- 172.21.15.53:0/732614113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd006ed30 0x7fdfd00c58f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00097c0 tx=0x7fdfc001ec70 comp rx=0 tx=0).stop 2023-12-08T20:55:40.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 -- 172.21.15.53:0/732614113 shutdown_connections 2023-12-08T20:55:40.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 --2- 172.21.15.53:0/732614113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfd0071140 0x7fdfd0157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 --2- 172.21.15.53:0/732614113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd006ed30 0x7fdfd00c58f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 -- 172.21.15.53:0/732614113 >> 172.21.15.53:0/732614113 conn(0x7fdfd00caef0 msgr2=0x7fdfd00cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:40.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 -- 172.21.15.53:0/732614113 shutdown_connections 2023-12-08T20:55:40.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 -- 172.21.15.53:0/732614113 wait complete. 2023-12-08T20:55:40.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 Processor -- start 2023-12-08T20:55:40.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 -- start start 2023-12-08T20:55:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfd006ed30 0x7fdfd0155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfd006f110 0x7fdfd0153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd0071140 0x7fdfd01567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd01eec30 con 0x7fdfd0071140 2023-12-08T20:55:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0156350 con 0x7fdfd006f110 2023-12-08T20:55:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfd56f7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd01eee40 con 0x7fdfd006ed30 2023-12-08T20:55:40.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.182+0000 7fdfcf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd0071140 0x7fdfd01567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:40.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.186+0000 7fdfcf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd0071140 0x7fdfd01567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35092/0 (socket says 172.21.15.53:35092) 2023-12-08T20:55:40.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.186+0000 7fdfcf7fe640 1 -- 172.21.15.53:0/3358478992 learned_addr learned my addr 172.21.15.53:0/3358478992 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:40.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.186+0000 7fdfce7fc640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfd006f110 0x7fdfd0153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:40.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.186+0000 7fdfceffd640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfd006ed30 0x7fdfd0155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.190+0000 7fdfcf7fe640 1 -- 172.21.15.53:0/3358478992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfd006ed30 msgr2=0x7fdfd0155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:40.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.190+0000 7fdfcf7fe640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfd006ed30 0x7fdfd0155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.190+0000 7fdfcf7fe640 1 -- 172.21.15.53:0/3358478992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfd006f110 msgr2=0x7fdfd0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:40.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.190+0000 7fdfcf7fe640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfd006f110 0x7fdfd0153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.190+0000 7fdfcf7fe640 1 -- 172.21.15.53:0/3358478992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0009420 con 0x7fdfd0071140 2023-12-08T20:55:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.190+0000 7fdfcf7fe640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd0071140 0x7fdfd01567e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009d30 tx=0x7fdfc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.194+0000 7fdfb77fe640 1 -- 172.21.15.53:0/3358478992 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8009ba0 con 0x7fdfd0071140 2023-12-08T20:55:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.194+0000 7fdfb77fe640 1 -- 172.21.15.53:0/3358478992 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc800f040 con 0x7fdfd0071140 2023-12-08T20:55:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.194+0000 7fdfb77fe640 1 -- 172.21.15.53:0/3358478992 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80146c0 con 0x7fdfd0071140 2023-12-08T20:55:40.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.194+0000 7fdfd56f7640 1 -- 172.21.15.53:0/3358478992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd01ef120 con 0x7fdfd0071140 2023-12-08T20:55:40.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.194+0000 7fdfd56f7640 1 -- 172.21.15.53:0/3358478992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd01ef6e0 con 0x7fdfd0071140 2023-12-08T20:55:40.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.194+0000 7fdfd56f7640 1 -- 172.21.15.53:0/3358478992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd00675b0 con 0x7fdfd0071140 2023-12-08T20:55:40.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.218+0000 7fdfb77fe640 1 -- 172.21.15.53:0/3358478992 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdfc8014820 con 0x7fdfd0071140 2023-12-08T20:55:40.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.218+0000 7fdfb77fe640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdfbc0664c0 0x7fdfbc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:40.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.218+0000 7fdfceffd640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdfbc0664c0 0x7fdfbc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:40.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.218+0000 7fdfceffd640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdfbc0664c0 0x7fdfbc068980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00b2000 tx=0x7fdfc00aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:40.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.222+0000 7fdfb77fe640 1 -- 172.21.15.53:0/3358478992 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdfc80561d0 con 0x7fdfd0071140 2023-12-08T20:55:40.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.518+0000 7fdfb77fe640 1 -- 172.21.15.53:0/3358478992 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdfc8052510 con 0x7fdfd0071140 2023-12-08T20:55:40.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.694+0000 7fdfd56f7640 1 -- 172.21.15.53:0/3358478992 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdfd015b6e0 con 0x7fdfbc0664c0 2023-12-08T20:55:40.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.718+0000 7fdfb77fe640 1 -- 172.21.15.53:0/3358478992 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368811 (secure 0 0 0) 0x7fdfc00b93d0 con 0x7fdfbc0664c0 2023-12-08T20:55:40.721 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:40.724 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-12-08T20:55:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.722+0000 7fdfd56f7640 1 -- 172.21.15.53:0/3358478992 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdfbc0664c0 msgr2=0x7fdfbc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.722+0000 7fdfd56f7640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdfbc0664c0 0x7fdfbc068980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00b2000 tx=0x7fdfc00aa070 comp rx=0 tx=0).stop 2023-12-08T20:55:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.722+0000 7fdfd56f7640 1 -- 172.21.15.53:0/3358478992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd0071140 msgr2=0x7fdfd01567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.722+0000 7fdfd56f7640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd0071140 0x7fdfd01567e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009d30 tx=0x7fdfc800c490 comp rx=0 tx=0).stop 2023-12-08T20:55:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.722+0000 7fdfd56f7640 1 -- 172.21.15.53:0/3358478992 shutdown_connections 2023-12-08T20:55:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.722+0000 7fdfd56f7640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdfbc0664c0 0x7fdfbc068980 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.722+0000 7fdfd56f7640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd0071140 0x7fdfd01567e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.722+0000 7fdfd56f7640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfd006f110 0x7fdfd0153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.722+0000 7fdfd56f7640 1 --2- 172.21.15.53:0/3358478992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfd006ed30 0x7fdfd0155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.722+0000 7fdfd56f7640 1 -- 172.21.15.53:0/3358478992 >> 172.21.15.53:0/3358478992 conn(0x7fdfd00caef0 msgr2=0x7fdfd00c9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:40.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.722+0000 7fdfd56f7640 1 -- 172.21.15.53:0/3358478992 shutdown_connections 2023-12-08T20:55:40.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.722+0000 7fdfd56f7640 1 -- 172.21.15.53:0/3358478992 wait complete. 2023-12-08T20:55:40.741 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-12-08T20:55:39.242578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235312,"kb_used_data":2496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739408,"statfs":{"total":773094113280,"available":772853153792,"internally_reserved":0,"allocated":2555904,"data_stored":2132114,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005234"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360564+0000","last_change":"2023-12-08T20:54:54.983255+0000","last_active":"2023-12-08T20:55:04.360564+0000","last_peered":"2023-12-08T20:55:04.360564+0000","last_clean":"2023-12-08T20:55:04.360564+0000","last_became_active":"2023-12-08T20:54:54.982479+0000","last_became_peered":"2023-12-08T20:54:54.982479+0000","last_unstale":"2023-12-08T20:55:04.360564+0000","last_undegraded":"2023-12-08T20:55:04.360564+0000","last_fullsized":"2023-12-08T20:55:04.360564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:17:36.784429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.542062+0000","last_change":"2023-12-08T20:54:56.407614+0000","last_active":"2023-12-08T20:55:04.542062+0000","last_peered":"2023-12-08T20:55:04.542062+0000","last_clean":"2023-12-08T20:55:04.542062+0000","last_became_active":"2023-12-08T20:54:56.406245+0000","last_became_peered":"2023-12-08T20:54:56.406245+0000","last_unstale":"2023-12-08T20:55:04.542062+0000","last_undegraded":"2023-12-08T20:55:04.542062+0000","last_fullsized":"2023-12-08T20:55:04.542062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:29.997818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.414972+0000","last_change":"2023-12-08T20:55:04.459400+0000","last_active":"2023-12-08T20:55:05.414972+0000","last_peered":"2023-12-08T20:55:05.414972+0000","last_clean":"2023-12-08T20:55:05.414972+0000","last_became_active":"2023-12-08T20:55:04.458087+0000","last_became_peered":"2023-12-08T20:55:04.458087+0000","last_unstale":"2023-12-08T20:55:05.414972+0000","last_undegraded":"2023-12-08T20:55:05.414972+0000","last_fullsized":"2023-12-08T20:55:05.414972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:23.378911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.542369+0000","last_change":"2023-12-08T20:54:54.929925+0000","last_active":"2023-12-08T20:55:04.542369+0000","last_peered":"2023-12-08T20:55:04.542369+0000","last_clean":"2023-12-08T20:55:04.542369+0000","last_became_active":"2023-12-08T20:54:54.929391+0000","last_became_peered":"2023-12-08T20:54:54.929391+0000","last_unstale":"2023-12-08T20:55:04.542369+0000","last_undegraded":"2023-12-08T20:55:04.542369+0000","last_fullsized":"2023-12-08T20:55:04.542369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:15:29.148520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540789+0000","last_change":"2023-12-08T20:54:56.409201+0000","last_active":"2023-12-08T20:55:04.540789+0000","last_peered":"2023-12-08T20:55:04.540789+0000","last_clean":"2023-12-08T20:55:04.540789+0000","last_became_active":"2023-12-08T20:54:56.408361+0000","last_became_peered":"2023-12-08T20:54:56.408361+0000","last_unstale":"2023-12-08T20:55:04.540789+0000","last_undegraded":"2023-12-08T20:55:04.540789+0000","last_fullsized":"2023-12-08T20:55:04.540789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:43:42.044530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491431+0000","last_change":"2023-12-08T20:55:04.529086+0000","last_active":"2023-12-08T20:55:05.491431+0000","last_peered":"2023-12-08T20:55:05.491431+0000","last_clean":"2023-12-08T20:55:05.491431+0000","last_became_active":"2023-12-08T20:55:04.528732+0000","last_became_peered":"2023-12-08T20:55:04.528732+0000","last_unstale":"2023-12-08T20:55:05.491431+0000","last_undegraded":"2023-12-08T20:55:05.491431+0000","last_fullsized":"2023-12-08T20:55:05.491431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:09:07.484233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504210+0000","last_change":"2023-12-08T20:54:54.935973+0000","last_active":"2023-12-08T20:55:04.504210+0000","last_peered":"2023-12-08T20:55:04.504210+0000","last_clean":"2023-12-08T20:55:04.504210+0000","last_became_active":"2023-12-08T20:54:54.935620+0000","last_became_peered":"2023-12-08T20:54:54.935620+0000","last_unstale":"2023-12-08T20:55:04.504210+0000","last_undegraded":"2023-12-08T20:55:04.504210+0000","last_fullsized":"2023-12-08T20:55:04.504210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:57.947192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456300+0000","last_change":"2023-12-08T20:54:56.382016+0000","last_active":"2023-12-08T20:55:04.456300+0000","last_peered":"2023-12-08T20:55:04.456300+0000","last_clean":"2023-12-08T20:55:04.456300+0000","last_became_active":"2023-12-08T20:54:56.380927+0000","last_became_peered":"2023-12-08T20:54:56.380927+0000","last_unstale":"2023-12-08T20:55:04.456300+0000","last_undegraded":"2023-12-08T20:55:04.456300+0000","last_fullsized":"2023-12-08T20:55:04.456300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491749+0000","last_change":"2023-12-08T20:55:04.527024+0000","last_active":"2023-12-08T20:55:05.491749+0000","last_peered":"2023-12-08T20:55:05.491749+0000","last_clean":"2023-12-08T20:55:05.491749+0000","last_became_active":"2023-12-08T20:55:04.526605+0000","last_became_peered":"2023-12-08T20:55:04.526605+0000","last_unstale":"2023-12-08T20:55:05.491749+0000","last_undegraded":"2023-12-08T20:55:05.491749+0000","last_fullsized":"2023-12-08T20:55:05.491749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:15.471006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.505308+0000","last_change":"2023-12-08T20:54:54.929388+0000","last_active":"2023-12-08T20:55:04.505308+0000","last_peered":"2023-12-08T20:55:04.505308+0000","last_clean":"2023-12-08T20:55:04.505308+0000","last_became_active":"2023-12-08T20:54:54.926132+0000","last_became_peered":"2023-12-08T20:54:54.926132+0000","last_unstale":"2023-12-08T20:55:04.505308+0000","last_undegraded":"2023-12-08T20:55:04.505308+0000","last_fullsized":"2023-12-08T20:55:04.505308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:00.435948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508722+0000","last_change":"2023-12-08T20:54:56.388306+0000","last_active":"2023-12-08T20:55:04.508722+0000","last_peered":"2023-12-08T20:55:04.508722+0000","last_clean":"2023-12-08T20:55:04.508722+0000","last_became_active":"2023-12-08T20:54:56.387528+0000","last_became_peered":"2023-12-08T20:54:56.387528+0000","last_unstale":"2023-12-08T20:55:04.508722+0000","last_undegraded":"2023-12-08T20:55:04.508722+0000","last_fullsized":"2023-12-08T20:55:04.508722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:22.236935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491559+0000","last_change":"2023-12-08T20:55:04.523251+0000","last_active":"2023-12-08T20:55:05.491559+0000","last_peered":"2023-12-08T20:55:05.491559+0000","last_clean":"2023-12-08T20:55:05.491559+0000","last_became_active":"2023-12-08T20:55:04.522777+0000","last_became_peered":"2023-12-08T20:55:04.522777+0000","last_unstale":"2023-12-08T20:55:05.491559+0000","last_undegraded":"2023-12-08T20:55:05.491559+0000","last_fullsized":"2023-12-08T20:55:05.491559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:09.972989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508344+0000","last_change":"2023-12-08T20:54:56.319638+0000","last_active":"2023-12-08T20:55:04.508344+0000","last_peered":"2023-12-08T20:55:04.508344+0000","last_clean":"2023-12-08T20:55:04.508344+0000","last_became_active":"2023-12-08T20:54:56.318855+0000","last_became_peered":"2023-12-08T20:54:56.318855+0000","last_unstale":"2023-12-08T20:55:04.508344+0000","last_undegraded":"2023-12-08T20:55:04.508344+0000","last_fullsized":"2023-12-08T20:55:04.508344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:27.151902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508472+0000","last_change":"2023-12-08T20:54:54.929584+0000","last_active":"2023-12-08T20:55:04.508472+0000","last_peered":"2023-12-08T20:55:04.508472+0000","last_clean":"2023-12-08T20:55:04.508472+0000","last_became_active":"2023-12-08T20:54:54.928702+0000","last_became_peered":"2023-12-08T20:54:54.928702+0000","last_unstale":"2023-12-08T20:55:04.508472+0000","last_undegraded":"2023-12-08T20:55:04.508472+0000","last_fullsized":"2023-12-08T20:55:04.508472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:40.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.450640+0000","last_change":"2023-12-08T20:55:04.535786+0000","last_active":"2023-12-08T20:55:05.450640+0000","last_peered":"2023-12-08T20:55:05.450640+0000","last_clean":"2023-12-08T20:55:05.450640+0000","last_became_active":"2023-12-08T20:55:04.535119+0000","last_became_peered":"2023-12-08T20:55:04.535119+0000","last_unstale":"2023-12-08T20:55:05.450640+0000","last_undegraded":"2023-12-08T20:55:05.450640+0000","last_fullsized":"2023-12-08T20:55:05.450640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:23:32.647822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.305734+0000","last_change":"2023-12-08T20:54:56.370877+0000","last_active":"2023-12-08T20:55:04.305734+0000","last_peered":"2023-12-08T20:55:04.305734+0000","last_clean":"2023-12-08T20:55:04.305734+0000","last_became_active":"2023-12-08T20:54:56.370044+0000","last_became_peered":"2023-12-08T20:54:56.370044+0000","last_unstale":"2023-12-08T20:55:04.305734+0000","last_undegraded":"2023-12-08T20:55:04.305734+0000","last_fullsized":"2023-12-08T20:55:04.305734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.407476+0000","last_change":"2023-12-08T20:54:54.923604+0000","last_active":"2023-12-08T20:55:04.407476+0000","last_peered":"2023-12-08T20:55:04.407476+0000","last_clean":"2023-12-08T20:55:04.407476+0000","last_became_active":"2023-12-08T20:54:54.922960+0000","last_became_peered":"2023-12-08T20:54:54.922960+0000","last_unstale":"2023-12-08T20:55:04.407476+0000","last_undegraded":"2023-12-08T20:55:04.407476+0000","last_fullsized":"2023-12-08T20:55:04.407476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:41:46.444603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.554984+0000","last_change":"2023-12-08T20:55:04.522655+0000","last_active":"2023-12-08T20:55:05.554984+0000","last_peered":"2023-12-08T20:55:05.554984+0000","last_clean":"2023-12-08T20:55:05.554984+0000","last_became_active":"2023-12-08T20:55:04.522172+0000","last_became_peered":"2023-12-08T20:55:04.522172+0000","last_unstale":"2023-12-08T20:55:05.554984+0000","last_undegraded":"2023-12-08T20:55:05.554984+0000","last_fullsized":"2023-12-08T20:55:05.554984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:09:00.038275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360579+0000","last_change":"2023-12-08T20:54:56.366227+0000","last_active":"2023-12-08T20:55:04.360579+0000","last_peered":"2023-12-08T20:55:04.360579+0000","last_clean":"2023-12-08T20:55:04.360579+0000","last_became_active":"2023-12-08T20:54:56.365552+0000","last_became_peered":"2023-12-08T20:54:56.365552+0000","last_unstale":"2023-12-08T20:55:04.360579+0000","last_undegraded":"2023-12-08T20:55:04.360579+0000","last_fullsized":"2023-12-08T20:55:04.360579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:00.821031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.361153+0000","last_change":"2023-12-08T20:54:54.980466+0000","last_active":"2023-12-08T20:55:04.361153+0000","last_peered":"2023-12-08T20:55:04.361153+0000","last_clean":"2023-12-08T20:55:04.361153+0000","last_became_active":"2023-12-08T20:54:54.979668+0000","last_became_peered":"2023-12-08T20:54:54.979668+0000","last_unstale":"2023-12-08T20:55:04.361153+0000","last_undegraded":"2023-12-08T20:55:04.361153+0000","last_fullsized":"2023-12-08T20:55:04.361153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:53.529738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.415715+0000","last_change":"2023-12-08T20:55:04.513186+0000","last_active":"2023-12-08T20:55:05.415715+0000","last_peered":"2023-12-08T20:55:05.415715+0000","last_clean":"2023-12-08T20:55:05.415715+0000","last_became_active":"2023-12-08T20:55:04.512549+0000","last_became_peered":"2023-12-08T20:55:04.512549+0000","last_unstale":"2023-12-08T20:55:05.415715+0000","last_undegraded":"2023-12-08T20:55:05.415715+0000","last_fullsized":"2023-12-08T20:55:05.415715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:49:31.307794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508158+0000","last_change":"2023-12-08T20:54:56.261452+0000","last_active":"2023-12-08T20:55:04.508158+0000","last_peered":"2023-12-08T20:55:04.508158+0000","last_clean":"2023-12-08T20:55:04.508158+0000","last_became_active":"2023-12-08T20:54:56.260355+0000","last_became_peered":"2023-12-08T20:54:56.260355+0000","last_unstale":"2023-12-08T20:55:04.508158+0000","last_undegraded":"2023-12-08T20:55:04.508158+0000","last_fullsized":"2023-12-08T20:55:04.508158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:47:02.249125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503832+0000","last_change":"2023-12-08T20:54:54.926546+0000","last_active":"2023-12-08T20:55:04.503832+0000","last_peered":"2023-12-08T20:55:04.503832+0000","last_clean":"2023-12-08T20:55:04.503832+0000","last_became_active":"2023-12-08T20:54:54.925888+0000","last_became_peered":"2023-12-08T20:54:54.925888+0000","last_unstale":"2023-12-08T20:55:04.503832+0000","last_undegraded":"2023-12-08T20:55:04.503832+0000","last_fullsized":"2023-12-08T20:55:04.503832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:25:20.796728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.492624+0000","last_change":"2023-12-08T20:55:04.529041+0000","last_active":"2023-12-08T20:55:05.492624+0000","last_peered":"2023-12-08T20:55:05.492624+0000","last_clean":"2023-12-08T20:55:05.492624+0000","last_became_active":"2023-12-08T20:55:04.528640+0000","last_became_peered":"2023-12-08T20:55:04.528640+0000","last_unstale":"2023-12-08T20:55:05.492624+0000","last_undegraded":"2023-12-08T20:55:05.492624+0000","last_fullsized":"2023-12-08T20:55:05.492624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:18.653508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360612+0000","last_change":"2023-12-08T20:54:56.365339+0000","last_active":"2023-12-08T20:55:04.360612+0000","last_peered":"2023-12-08T20:55:04.360612+0000","last_clean":"2023-12-08T20:55:04.360612+0000","last_became_active":"2023-12-08T20:54:56.364597+0000","last_became_peered":"2023-12-08T20:54:56.364597+0000","last_unstale":"2023-12-08T20:55:04.360612+0000","last_undegraded":"2023-12-08T20:55:04.360612+0000","last_fullsized":"2023-12-08T20:55:04.360612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:17:58.931401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.509296+0000","last_change":"2023-12-08T20:54:54.928399+0000","last_active":"2023-12-08T20:55:04.509296+0000","last_peered":"2023-12-08T20:55:04.509296+0000","last_clean":"2023-12-08T20:55:04.509296+0000","last_became_active":"2023-12-08T20:54:54.927814+0000","last_became_peered":"2023-12-08T20:54:54.927814+0000","last_unstale":"2023-12-08T20:55:04.509296+0000","last_undegraded":"2023-12-08T20:55:04.509296+0000","last_fullsized":"2023-12-08T20:55:04.509296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:04:22.986992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491362+0000","last_change":"2023-12-08T20:55:04.523561+0000","last_active":"2023-12-08T20:55:05.491362+0000","last_peered":"2023-12-08T20:55:05.491362+0000","last_clean":"2023-12-08T20:55:05.491362+0000","last_became_active":"2023-12-08T20:55:04.522714+0000","last_became_peered":"2023-12-08T20:55:04.522714+0000","last_unstale":"2023-12-08T20:55:05.491362+0000","last_undegraded":"2023-12-08T20:55:05.491362+0000","last_fullsized":"2023-12-08T20:55:05.491362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:14.534456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360043+0000","last_change":"2023-12-08T20:54:56.331268+0000","last_active":"2023-12-08T20:55:04.360043+0000","last_peered":"2023-12-08T20:55:04.360043+0000","last_clean":"2023-12-08T20:55:04.360043+0000","last_became_active":"2023-12-08T20:54:56.330508+0000","last_became_peered":"2023-12-08T20:54:56.330508+0000","last_unstale":"2023-12-08T20:55:04.360043+0000","last_undegraded":"2023-12-08T20:55:04.360043+0000","last_fullsized":"2023-12-08T20:55:04.360043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:52.392589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.361147+0000","last_change":"2023-12-08T20:54:54.982136+0000","last_active":"2023-12-08T20:55:04.361147+0000","last_peered":"2023-12-08T20:55:04.361147+0000","last_clean":"2023-12-08T20:55:04.361147+0000","last_became_active":"2023-12-08T20:54:54.981168+0000","last_became_peered":"2023-12-08T20:54:54.981168+0000","last_unstale":"2023-12-08T20:55:04.361147+0000","last_undegraded":"2023-12-08T20:55:04.361147+0000","last_fullsized":"2023-12-08T20:55:04.361147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:13.841870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.556069+0000","last_change":"2023-12-08T20:55:04.513360+0000","last_active":"2023-12-08T20:55:05.556069+0000","last_peered":"2023-12-08T20:55:05.556069+0000","last_clean":"2023-12-08T20:55:05.556069+0000","last_became_active":"2023-12-08T20:55:04.511032+0000","last_became_peered":"2023-12-08T20:55:04.511032+0000","last_unstale":"2023-12-08T20:55:05.556069+0000","last_undegraded":"2023-12-08T20:55:05.556069+0000","last_fullsized":"2023-12-08T20:55:05.556069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:38:04.841172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.413307+0000","last_change":"2023-12-08T20:54:56.409829+0000","last_active":"2023-12-08T20:55:04.413307+0000","last_peered":"2023-12-08T20:55:04.413307+0000","last_clean":"2023-12-08T20:55:04.413307+0000","last_became_active":"2023-12-08T20:54:56.409291+0000","last_became_peered":"2023-12-08T20:54:56.409291+0000","last_unstale":"2023-12-08T20:55:04.413307+0000","last_undegraded":"2023-12-08T20:55:04.413307+0000","last_fullsized":"2023-12-08T20:55:04.413307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:06:37.234510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508973+0000","last_change":"2023-12-08T20:54:54.978750+0000","last_active":"2023-12-08T20:55:04.508973+0000","last_peered":"2023-12-08T20:55:04.508973+0000","last_clean":"2023-12-08T20:55:04.508973+0000","last_became_active":"2023-12-08T20:54:54.978416+0000","last_became_peered":"2023-12-08T20:54:54.978416+0000","last_unstale":"2023-12-08T20:55:04.508973+0000","last_undegraded":"2023-12-08T20:55:04.508973+0000","last_fullsized":"2023-12-08T20:55:04.508973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:00:08.584168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553308+0000","last_change":"2023-12-08T20:55:04.507859+0000","last_active":"2023-12-08T20:55:05.553308+0000","last_peered":"2023-12-08T20:55:05.553308+0000","last_clean":"2023-12-08T20:55:05.553308+0000","last_became_active":"2023-12-08T20:55:04.507454+0000","last_became_peered":"2023-12-08T20:55:04.507454+0000","last_unstale":"2023-12-08T20:55:05.553308+0000","last_undegraded":"2023-12-08T20:55:05.553308+0000","last_fullsized":"2023-12-08T20:55:05.553308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:56:57.279368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.498994+0000","last_change":"2023-12-08T20:54:56.372983+0000","last_active":"2023-12-08T20:55:04.498994+0000","last_peered":"2023-12-08T20:55:04.498994+0000","last_clean":"2023-12-08T20:55:04.498994+0000","last_became_active":"2023-12-08T20:54:56.369974+0000","last_became_peered":"2023-12-08T20:54:56.369974+0000","last_unstale":"2023-12-08T20:55:04.498994+0000","last_undegraded":"2023-12-08T20:55:04.498994+0000","last_fullsized":"2023-12-08T20:55:04.498994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.531685+0000","last_change":"2023-12-08T20:54:54.925560+0000","last_active":"2023-12-08T20:55:04.531685+0000","last_peered":"2023-12-08T20:55:04.531685+0000","last_clean":"2023-12-08T20:55:04.531685+0000","last_became_active":"2023-12-08T20:54:54.925022+0000","last_became_peered":"2023-12-08T20:54:54.925022+0000","last_unstale":"2023-12-08T20:55:04.531685+0000","last_undegraded":"2023-12-08T20:55:04.531685+0000","last_fullsized":"2023-12-08T20:55:04.531685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:10:52.902793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.552418+0000","last_change":"2023-12-08T20:55:04.531931+0000","last_active":"2023-12-08T20:55:05.552418+0000","last_peered":"2023-12-08T20:55:05.552418+0000","last_clean":"2023-12-08T20:55:05.552418+0000","last_became_active":"2023-12-08T20:55:04.530774+0000","last_became_peered":"2023-12-08T20:55:04.530774+0000","last_unstale":"2023-12-08T20:55:05.552418+0000","last_undegraded":"2023-12-08T20:55:05.552418+0000","last_fullsized":"2023-12-08T20:55:05.552418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:39:26.927665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503831+0000","last_change":"2023-12-08T20:54:56.391492+0000","last_active":"2023-12-08T20:55:04.503831+0000","last_peered":"2023-12-08T20:55:04.503831+0000","last_clean":"2023-12-08T20:55:04.503831+0000","last_became_active":"2023-12-08T20:54:56.385090+0000","last_became_peered":"2023-12-08T20:54:56.385090+0000","last_unstale":"2023-12-08T20:55:04.503831+0000","last_undegraded":"2023-12-08T20:55:04.503831+0000","last_fullsized":"2023-12-08T20:55:04.503831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:21:29.009005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508632+0000","last_change":"2023-12-08T20:54:54.932503+0000","last_active":"2023-12-08T20:55:04.508632+0000","last_peered":"2023-12-08T20:55:04.508632+0000","last_clean":"2023-12-08T20:55:04.508632+0000","last_became_active":"2023-12-08T20:54:54.932121+0000","last_became_peered":"2023-12-08T20:54:54.932121+0000","last_unstale":"2023-12-08T20:55:04.508632+0000","last_undegraded":"2023-12-08T20:55:04.508632+0000","last_fullsized":"2023-12-08T20:55:04.508632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:58.013744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553088+0000","last_change":"2023-12-08T20:55:04.529911+0000","last_active":"2023-12-08T20:55:05.553088+0000","last_peered":"2023-12-08T20:55:05.553088+0000","last_clean":"2023-12-08T20:55:05.553088+0000","last_became_active":"2023-12-08T20:55:04.528698+0000","last_became_peered":"2023-12-08T20:55:04.528698+0000","last_unstale":"2023-12-08T20:55:05.553088+0000","last_undegraded":"2023-12-08T20:55:05.553088+0000","last_fullsized":"2023-12-08T20:55:05.553088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:33:11.874876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.512905+0000","last_change":"2023-12-08T20:54:56.413886+0000","last_active":"2023-12-08T20:55:04.512905+0000","last_peered":"2023-12-08T20:55:04.512905+0000","last_clean":"2023-12-08T20:55:04.512905+0000","last_became_active":"2023-12-08T20:54:56.412786+0000","last_became_peered":"2023-12-08T20:54:56.412786+0000","last_unstale":"2023-12-08T20:55:04.512905+0000","last_undegraded":"2023-12-08T20:55:04.512905+0000","last_fullsized":"2023-12-08T20:55:04.512905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:39.331476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.305732+0000","last_change":"2023-12-08T20:54:54.922605+0000","last_active":"2023-12-08T20:55:04.305732+0000","last_peered":"2023-12-08T20:55:04.305732+0000","last_clean":"2023-12-08T20:55:04.305732+0000","last_became_active":"2023-12-08T20:54:54.922014+0000","last_became_peered":"2023-12-08T20:54:54.922014+0000","last_unstale":"2023-12-08T20:55:04.305732+0000","last_undegraded":"2023-12-08T20:55:04.305732+0000","last_fullsized":"2023-12-08T20:55:04.305732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:08:48.601596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.554232+0000","last_change":"2023-12-08T20:55:04.509438+0000","last_active":"2023-12-08T20:55:05.554232+0000","last_peered":"2023-12-08T20:55:05.554232+0000","last_clean":"2023-12-08T20:55:05.554232+0000","last_became_active":"2023-12-08T20:55:04.508219+0000","last_became_peered":"2023-12-08T20:55:04.508219+0000","last_unstale":"2023-12-08T20:55:05.554232+0000","last_undegraded":"2023-12-08T20:55:05.554232+0000","last_fullsized":"2023-12-08T20:55:05.554232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:16:31.758437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.406374+0000","last_change":"2023-12-08T20:54:56.370599+0000","last_active":"2023-12-08T20:55:04.406374+0000","last_peered":"2023-12-08T20:55:04.406374+0000","last_clean":"2023-12-08T20:55:04.406374+0000","last_became_active":"2023-12-08T20:54:56.370121+0000","last_became_peered":"2023-12-08T20:54:56.370121+0000","last_unstale":"2023-12-08T20:55:04.406374+0000","last_undegraded":"2023-12-08T20:55:04.406374+0000","last_fullsized":"2023-12-08T20:55:04.406374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:58:13.927241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507925+0000","last_change":"2023-12-08T20:54:54.927599+0000","last_active":"2023-12-08T20:55:04.507925+0000","last_peered":"2023-12-08T20:55:04.507925+0000","last_clean":"2023-12-08T20:55:04.507925+0000","last_became_active":"2023-12-08T20:54:54.927120+0000","last_became_peered":"2023-12-08T20:54:54.927120+0000","last_unstale":"2023-12-08T20:55:04.507925+0000","last_undegraded":"2023-12-08T20:55:04.507925+0000","last_fullsized":"2023-12-08T20:55:04.507925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:38.042201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.557221+0000","last_change":"2023-12-08T20:55:04.546945+0000","last_active":"2023-12-08T20:55:05.557221+0000","last_peered":"2023-12-08T20:55:05.557221+0000","last_clean":"2023-12-08T20:55:05.557221+0000","last_became_active":"2023-12-08T20:55:04.546439+0000","last_became_peered":"2023-12-08T20:55:04.546439+0000","last_unstale":"2023-12-08T20:55:05.557221+0000","last_undegraded":"2023-12-08T20:55:05.557221+0000","last_fullsized":"2023-12-08T20:55:05.557221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:30.484701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.361611+0000","last_change":"2023-12-08T20:54:56.372770+0000","last_active":"2023-12-08T20:55:04.361611+0000","last_peered":"2023-12-08T20:55:04.361611+0000","last_clean":"2023-12-08T20:55:04.361611+0000","last_became_active":"2023-12-08T20:54:56.372205+0000","last_became_peered":"2023-12-08T20:54:56.372205+0000","last_unstale":"2023-12-08T20:55:04.361611+0000","last_undegraded":"2023-12-08T20:55:04.361611+0000","last_fullsized":"2023-12-08T20:55:04.361611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:06.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508582+0000","last_change":"2023-12-08T20:54:54.929937+0000","last_active":"2023-12-08T20:55:04.508582+0000","last_peered":"2023-12-08T20:55:04.508582+0000","last_clean":"2023-12-08T20:55:04.508582+0000","last_became_active":"2023-12-08T20:54:54.929177+0000","last_became_peered":"2023-12-08T20:54:54.929177+0000","last_unstale":"2023-12-08T20:55:04.508582+0000","last_undegraded":"2023-12-08T20:55:04.508582+0000","last_fullsized":"2023-12-08T20:55:04.508582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:39:58.988364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.455933+0000","last_change":"2023-12-08T20:54:16.149485+0000","last_active":"2023-12-08T20:55:04.455933+0000","last_peered":"2023-12-08T20:55:04.455933+0000","last_clean":"2023-12-08T20:55:04.455933+0000","last_became_active":"2023-12-08T20:54:16.147507+0000","last_became_peered":"2023-12-08T20:54:16.147507+0000","last_unstale":"2023-12-08T20:55:04.455933+0000","last_undegraded":"2023-12-08T20:55:04.455933+0000","last_fullsized":"2023-12-08T20:55:04.455933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_clean_scrub_stamp":"2023-12-08T20:54:14.141045+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:17.484651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.451649+0000","last_change":"2023-12-08T20:55:04.515531+0000","last_active":"2023-12-08T20:55:05.451649+0000","last_peered":"2023-12-08T20:55:05.451649+0000","last_clean":"2023-12-08T20:55:05.451649+0000","last_became_active":"2023-12-08T20:55:04.515200+0000","last_became_peered":"2023-12-08T20:55:04.515200+0000","last_unstale":"2023-12-08T20:55:05.451649+0000","last_undegraded":"2023-12-08T20:55:05.451649+0000","last_fullsized":"2023-12-08T20:55:05.451649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:00:08.085700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508800+0000","last_change":"2023-12-08T20:54:56.318724+0000","last_active":"2023-12-08T20:55:04.508800+0000","last_peered":"2023-12-08T20:55:04.508800+0000","last_clean":"2023-12-08T20:55:04.508800+0000","last_became_active":"2023-12-08T20:54:56.318408+0000","last_became_peered":"2023-12-08T20:54:56.318408+0000","last_unstale":"2023-12-08T20:55:04.508800+0000","last_undegraded":"2023-12-08T20:55:04.508800+0000","last_fullsized":"2023-12-08T20:55:04.508800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:14:20.217847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.413648+0000","last_change":"2023-12-08T20:54:54.926031+0000","last_active":"2023-12-08T20:55:04.413648+0000","last_peered":"2023-12-08T20:55:04.413648+0000","last_clean":"2023-12-08T20:55:04.413648+0000","last_became_active":"2023-12-08T20:54:54.925610+0000","last_became_peered":"2023-12-08T20:54:54.925610+0000","last_unstale":"2023-12-08T20:55:04.413648+0000","last_undegraded":"2023-12-08T20:55:04.413648+0000","last_fullsized":"2023-12-08T20:55:04.413648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:05:08.857673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491648+0000","last_change":"2023-12-08T20:55:04.523264+0000","last_active":"2023-12-08T20:55:05.491648+0000","last_peered":"2023-12-08T20:55:05.491648+0000","last_clean":"2023-12-08T20:55:05.491648+0000","last_became_active":"2023-12-08T20:55:04.522245+0000","last_became_peered":"2023-12-08T20:55:04.522245+0000","last_unstale":"2023-12-08T20:55:05.491648+0000","last_undegraded":"2023-12-08T20:55:05.491648+0000","last_fullsized":"2023-12-08T20:55:05.491648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:23.322536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.505093+0000","last_change":"2023-12-08T20:54:56.378291+0000","last_active":"2023-12-08T20:55:04.505093+0000","last_peered":"2023-12-08T20:55:04.505093+0000","last_clean":"2023-12-08T20:55:04.505093+0000","last_became_active":"2023-12-08T20:54:56.377762+0000","last_became_peered":"2023-12-08T20:54:56.377762+0000","last_unstale":"2023-12-08T20:55:04.505093+0000","last_undegraded":"2023-12-08T20:55:04.505093+0000","last_fullsized":"2023-12-08T20:55:04.505093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:11:11.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540684+0000","last_change":"2023-12-08T20:54:54.936008+0000","last_active":"2023-12-08T20:55:04.540684+0000","last_peered":"2023-12-08T20:55:04.540684+0000","last_clean":"2023-12-08T20:55:04.540684+0000","last_became_active":"2023-12-08T20:54:54.935472+0000","last_became_peered":"2023-12-08T20:54:54.935472+0000","last_unstale":"2023-12-08T20:55:04.540684+0000","last_undegraded":"2023-12-08T20:55:04.540684+0000","last_fullsized":"2023-12-08T20:55:04.540684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:11:02.460764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.557220+0000","last_change":"2023-12-08T20:55:04.534674+0000","last_active":"2023-12-08T20:55:05.557220+0000","last_peered":"2023-12-08T20:55:05.557220+0000","last_clean":"2023-12-08T20:55:05.557220+0000","last_became_active":"2023-12-08T20:55:04.533305+0000","last_became_peered":"2023-12-08T20:55:04.533305+0000","last_unstale":"2023-12-08T20:55:05.557220+0000","last_undegraded":"2023-12-08T20:55:05.557220+0000","last_fullsized":"2023-12-08T20:55:05.557220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:18.790378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504316+0000","last_change":"2023-12-08T20:54:56.380702+0000","last_active":"2023-12-08T20:55:04.504316+0000","last_peered":"2023-12-08T20:55:04.504316+0000","last_clean":"2023-12-08T20:55:04.504316+0000","last_became_active":"2023-12-08T20:54:56.379933+0000","last_became_peered":"2023-12-08T20:54:56.379933+0000","last_unstale":"2023-12-08T20:55:04.504316+0000","last_undegraded":"2023-12-08T20:55:04.504316+0000","last_fullsized":"2023-12-08T20:55:04.504316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:31:18.872161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360865+0000","last_change":"2023-12-08T20:54:54.983221+0000","last_active":"2023-12-08T20:55:04.360865+0000","last_peered":"2023-12-08T20:55:04.360865+0000","last_clean":"2023-12-08T20:55:04.360865+0000","last_became_active":"2023-12-08T20:54:54.982414+0000","last_became_peered":"2023-12-08T20:54:54.982414+0000","last_unstale":"2023-12-08T20:55:04.360865+0000","last_undegraded":"2023-12-08T20:55:04.360865+0000","last_fullsized":"2023-12-08T20:55:04.360865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:36:42.874558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.449898+0000","last_change":"2023-12-08T20:55:04.515310+0000","last_active":"2023-12-08T20:55:05.449898+0000","last_peered":"2023-12-08T20:55:05.449898+0000","last_clean":"2023-12-08T20:55:05.449898+0000","last_became_active":"2023-12-08T20:55:04.514907+0000","last_became_peered":"2023-12-08T20:55:04.514907+0000","last_unstale":"2023-12-08T20:55:05.449898+0000","last_undegraded":"2023-12-08T20:55:05.449898+0000","last_fullsized":"2023-12-08T20:55:05.449898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:26:19.536478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499717+0000","last_change":"2023-12-08T20:54:56.378176+0000","last_active":"2023-12-08T20:55:04.499717+0000","last_peered":"2023-12-08T20:55:04.499717+0000","last_clean":"2023-12-08T20:55:04.499717+0000","last_became_active":"2023-12-08T20:54:56.377430+0000","last_became_peered":"2023-12-08T20:54:56.377430+0000","last_unstale":"2023-12-08T20:55:04.499717+0000","last_undegraded":"2023-12-08T20:55:04.499717+0000","last_fullsized":"2023-12-08T20:55:04.499717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504536+0000","last_change":"2023-12-08T20:54:54.926769+0000","last_active":"2023-12-08T20:55:04.504536+0000","last_peered":"2023-12-08T20:55:04.504536+0000","last_clean":"2023-12-08T20:55:04.504536+0000","last_became_active":"2023-12-08T20:54:54.926386+0000","last_became_peered":"2023-12-08T20:54:54.926386+0000","last_unstale":"2023-12-08T20:55:04.504536+0000","last_undegraded":"2023-12-08T20:55:04.504536+0000","last_fullsized":"2023-12-08T20:55:04.504536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:05.933965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553168+0000","last_change":"2023-12-08T20:55:04.523709+0000","last_active":"2023-12-08T20:55:05.553168+0000","last_peered":"2023-12-08T20:55:05.553168+0000","last_clean":"2023-12-08T20:55:05.553168+0000","last_became_active":"2023-12-08T20:55:04.523074+0000","last_became_peered":"2023-12-08T20:55:04.523074+0000","last_unstale":"2023-12-08T20:55:05.553168+0000","last_undegraded":"2023-12-08T20:55:05.553168+0000","last_fullsized":"2023-12-08T20:55:05.553168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508063+0000","last_change":"2023-12-08T20:54:56.373188+0000","last_active":"2023-12-08T20:55:04.508063+0000","last_peered":"2023-12-08T20:55:04.508063+0000","last_clean":"2023-12-08T20:55:04.508063+0000","last_became_active":"2023-12-08T20:54:56.371132+0000","last_became_peered":"2023-12-08T20:54:56.371132+0000","last_unstale":"2023-12-08T20:55:04.508063+0000","last_undegraded":"2023-12-08T20:55:04.508063+0000","last_fullsized":"2023-12-08T20:55:04.508063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:30:06.387412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360789+0000","last_change":"2023-12-08T20:54:54.985432+0000","last_active":"2023-12-08T20:55:04.360789+0000","last_peered":"2023-12-08T20:55:04.360789+0000","last_clean":"2023-12-08T20:55:04.360789+0000","last_became_active":"2023-12-08T20:54:54.984661+0000","last_became_peered":"2023-12-08T20:54:54.984661+0000","last_unstale":"2023-12-08T20:55:04.360789+0000","last_undegraded":"2023-12-08T20:55:04.360789+0000","last_fullsized":"2023-12-08T20:55:04.360789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:16:34.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.558071+0000","last_change":"2023-12-08T20:55:04.543349+0000","last_active":"2023-12-08T20:55:05.558071+0000","last_peered":"2023-12-08T20:55:05.558071+0000","last_clean":"2023-12-08T20:55:05.558071+0000","last_became_active":"2023-12-08T20:55:04.541074+0000","last_became_peered":"2023-12-08T20:55:04.541074+0000","last_unstale":"2023-12-08T20:55:05.558071+0000","last_undegraded":"2023-12-08T20:55:05.558071+0000","last_fullsized":"2023-12-08T20:55:05.558071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:35.399668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.455813+0000","last_change":"2023-12-08T20:54:56.413772+0000","last_active":"2023-12-08T20:55:04.455813+0000","last_peered":"2023-12-08T20:55:04.455813+0000","last_clean":"2023-12-08T20:55:04.455813+0000","last_became_active":"2023-12-08T20:54:56.413023+0000","last_became_peered":"2023-12-08T20:54:56.413023+0000","last_unstale":"2023-12-08T20:55:04.455813+0000","last_undegraded":"2023-12-08T20:55:04.455813+0000","last_fullsized":"2023-12-08T20:55:04.455813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504120+0000","last_change":"2023-12-08T20:54:54.929238+0000","last_active":"2023-12-08T20:55:04.504120+0000","last_peered":"2023-12-08T20:55:04.504120+0000","last_clean":"2023-12-08T20:55:04.504120+0000","last_became_active":"2023-12-08T20:54:54.928543+0000","last_became_peered":"2023-12-08T20:54:54.928543+0000","last_unstale":"2023-12-08T20:55:04.504120+0000","last_undegraded":"2023-12-08T20:55:04.504120+0000","last_fullsized":"2023-12-08T20:55:04.504120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:04.997415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.557550+0000","last_change":"2023-12-08T20:55:04.540347+0000","last_active":"2023-12-08T20:55:05.557550+0000","last_peered":"2023-12-08T20:55:05.557550+0000","last_clean":"2023-12-08T20:55:05.557550+0000","last_became_active":"2023-12-08T20:55:04.535002+0000","last_became_peered":"2023-12-08T20:55:04.535002+0000","last_unstale":"2023-12-08T20:55:05.557550+0000","last_undegraded":"2023-12-08T20:55:05.557550+0000","last_fullsized":"2023-12-08T20:55:05.557550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:09.576246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508370+0000","last_change":"2023-12-08T20:54:56.394016+0000","last_active":"2023-12-08T20:55:04.508370+0000","last_peered":"2023-12-08T20:55:04.508370+0000","last_clean":"2023-12-08T20:55:04.508370+0000","last_became_active":"2023-12-08T20:54:56.393187+0000","last_became_peered":"2023-12-08T20:54:56.393187+0000","last_unstale":"2023-12-08T20:55:04.508370+0000","last_undegraded":"2023-12-08T20:55:04.508370+0000","last_fullsized":"2023-12-08T20:55:04.508370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:20:56.762499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508542+0000","last_change":"2023-12-08T20:54:54.930839+0000","last_active":"2023-12-08T20:55:04.508542+0000","last_peered":"2023-12-08T20:55:04.508542+0000","last_clean":"2023-12-08T20:55:04.508542+0000","last_became_active":"2023-12-08T20:54:54.928065+0000","last_became_peered":"2023-12-08T20:54:54.928065+0000","last_unstale":"2023-12-08T20:55:04.508542+0000","last_undegraded":"2023-12-08T20:55:04.508542+0000","last_fullsized":"2023-12-08T20:55:04.508542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:28.708543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.552940+0000","last_change":"2023-12-08T20:55:04.520698+0000","last_active":"2023-12-08T20:55:05.552940+0000","last_peered":"2023-12-08T20:55:05.552940+0000","last_clean":"2023-12-08T20:55:05.552940+0000","last_became_active":"2023-12-08T20:55:04.516783+0000","last_became_peered":"2023-12-08T20:55:04.516783+0000","last_unstale":"2023-12-08T20:55:05.552940+0000","last_undegraded":"2023-12-08T20:55:05.552940+0000","last_fullsized":"2023-12-08T20:55:05.552940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:46:00.331700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.407130+0000","last_change":"2023-12-08T20:54:56.331045+0000","last_active":"2023-12-08T20:55:04.407130+0000","last_peered":"2023-12-08T20:55:04.407130+0000","last_clean":"2023-12-08T20:55:04.407130+0000","last_became_active":"2023-12-08T20:54:56.330346+0000","last_became_peered":"2023-12-08T20:54:56.330346+0000","last_unstale":"2023-12-08T20:55:04.407130+0000","last_undegraded":"2023-12-08T20:55:04.407130+0000","last_fullsized":"2023-12-08T20:55:04.407130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:43:36.950589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.306013+0000","last_change":"2023-12-08T20:54:54.927094+0000","last_active":"2023-12-08T20:55:04.306013+0000","last_peered":"2023-12-08T20:55:04.306013+0000","last_clean":"2023-12-08T20:55:04.306013+0000","last_became_active":"2023-12-08T20:54:54.926435+0000","last_became_peered":"2023-12-08T20:54:54.926435+0000","last_unstale":"2023-12-08T20:55:04.306013+0000","last_undegraded":"2023-12-08T20:55:04.306013+0000","last_fullsized":"2023-12-08T20:55:04.306013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.450954+0000","last_change":"2023-12-08T20:55:04.534630+0000","last_active":"2023-12-08T20:55:05.450954+0000","last_peered":"2023-12-08T20:55:05.450954+0000","last_clean":"2023-12-08T20:55:05.450954+0000","last_became_active":"2023-12-08T20:55:04.534289+0000","last_became_peered":"2023-12-08T20:55:04.534289+0000","last_unstale":"2023-12-08T20:55:05.450954+0000","last_undegraded":"2023-12-08T20:55:05.450954+0000","last_fullsized":"2023-12-08T20:55:05.450954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:36:33.771845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504120+0000","last_change":"2023-12-08T20:54:56.376691+0000","last_active":"2023-12-08T20:55:04.504120+0000","last_peered":"2023-12-08T20:55:04.504120+0000","last_clean":"2023-12-08T20:55:04.504120+0000","last_became_active":"2023-12-08T20:54:56.375922+0000","last_became_peered":"2023-12-08T20:54:56.375922+0000","last_unstale":"2023-12-08T20:55:04.504120+0000","last_undegraded":"2023-12-08T20:55:04.504120+0000","last_fullsized":"2023-12-08T20:55:04.504120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:37:56.593406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'10","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:15.154004+0000","last_change":"2023-12-08T20:54:54.978427+0000","last_active":"2023-12-08T20:55:15.154004+0000","last_peered":"2023-12-08T20:55:15.154004+0000","last_clean":"2023-12-08T20:55:15.154004+0000","last_became_active":"2023-12-08T20:54:54.977999+0000","last_became_peered":"2023-12-08T20:54:54.977999+0000","last_unstale":"2023-12-08T20:55:15.154004+0000","last_undegraded":"2023-12-08T20:55:15.154004+0000","last_fullsized":"2023-12-08T20:55:15.154004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.554268+0000","last_change":"2023-12-08T20:55:04.522691+0000","last_active":"2023-12-08T20:55:05.554268+0000","last_peered":"2023-12-08T20:55:05.554268+0000","last_clean":"2023-12-08T20:55:05.554268+0000","last_became_active":"2023-12-08T20:55:04.522190+0000","last_became_peered":"2023-12-08T20:55:04.522190+0000","last_unstale":"2023-12-08T20:55:05.554268+0000","last_undegraded":"2023-12-08T20:55:05.554268+0000","last_fullsized":"2023-12-08T20:55:05.554268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:52.945031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508584+0000","last_change":"2023-12-08T20:54:56.384439+0000","last_active":"2023-12-08T20:55:04.508584+0000","last_peered":"2023-12-08T20:55:04.508584+0000","last_clean":"2023-12-08T20:55:04.508584+0000","last_became_active":"2023-12-08T20:54:56.383561+0000","last_became_peered":"2023-12-08T20:54:56.383561+0000","last_unstale":"2023-12-08T20:55:04.508584+0000","last_undegraded":"2023-12-08T20:55:04.508584+0000","last_fullsized":"2023-12-08T20:55:04.508584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:01.328480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.307220+0000","last_change":"2023-12-08T20:54:54.980625+0000","last_active":"2023-12-08T20:55:04.307220+0000","last_peered":"2023-12-08T20:55:04.307220+0000","last_clean":"2023-12-08T20:55:04.307220+0000","last_became_active":"2023-12-08T20:54:54.980023+0000","last_became_peered":"2023-12-08T20:54:54.980023+0000","last_unstale":"2023-12-08T20:55:04.307220+0000","last_undegraded":"2023-12-08T20:55:04.307220+0000","last_fullsized":"2023-12-08T20:55:04.307220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:44:27.401600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.492065+0000","last_change":"2023-12-08T20:55:04.523658+0000","last_active":"2023-12-08T20:55:05.492065+0000","last_peered":"2023-12-08T20:55:05.492065+0000","last_clean":"2023-12-08T20:55:05.492065+0000","last_became_active":"2023-12-08T20:55:04.522325+0000","last_became_peered":"2023-12-08T20:55:04.522325+0000","last_unstale":"2023-12-08T20:55:05.492065+0000","last_undegraded":"2023-12-08T20:55:05.492065+0000","last_fullsized":"2023-12-08T20:55:05.492065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:32:03.125815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540898+0000","last_change":"2023-12-08T20:54:56.410075+0000","last_active":"2023-12-08T20:55:04.540898+0000","last_peered":"2023-12-08T20:55:04.540898+0000","last_clean":"2023-12-08T20:55:04.540898+0000","last_became_active":"2023-12-08T20:54:56.409539+0000","last_became_peered":"2023-12-08T20:54:56.409539+0000","last_unstale":"2023-12-08T20:55:04.540898+0000","last_undegraded":"2023-12-08T20:55:04.540898+0000","last_fullsized":"2023-12-08T20:55:04.540898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:37:03.173965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504113+0000","last_change":"2023-12-08T20:54:54.936311+0000","last_active":"2023-12-08T20:55:04.504113+0000","last_peered":"2023-12-08T20:55:04.504113+0000","last_clean":"2023-12-08T20:55:04.504113+0000","last_became_active":"2023-12-08T20:54:54.935889+0000","last_became_peered":"2023-12-08T20:54:54.935889+0000","last_unstale":"2023-12-08T20:55:04.504113+0000","last_undegraded":"2023-12-08T20:55:04.504113+0000","last_fullsized":"2023-12-08T20:55:04.504113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:13.785495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.414801+0000","last_change":"2023-12-08T20:55:04.519274+0000","last_active":"2023-12-08T20:55:05.414801+0000","last_peered":"2023-12-08T20:55:05.414801+0000","last_clean":"2023-12-08T20:55:05.414801+0000","last_became_active":"2023-12-08T20:55:04.518048+0000","last_became_peered":"2023-12-08T20:55:04.518048+0000","last_unstale":"2023-12-08T20:55:05.414801+0000","last_undegraded":"2023-12-08T20:55:05.414801+0000","last_fullsized":"2023-12-08T20:55:05.414801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:36:52.411600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499617+0000","last_change":"2023-12-08T20:54:56.376709+0000","last_active":"2023-12-08T20:55:04.499617+0000","last_peered":"2023-12-08T20:55:04.499617+0000","last_clean":"2023-12-08T20:55:04.499617+0000","last_became_active":"2023-12-08T20:54:56.369709+0000","last_became_peered":"2023-12-08T20:54:56.369709+0000","last_unstale":"2023-12-08T20:55:04.499617+0000","last_undegraded":"2023-12-08T20:55:04.499617+0000","last_fullsized":"2023-12-08T20:55:04.499617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456242+0000","last_change":"2023-12-08T20:54:54.980040+0000","last_active":"2023-12-08T20:55:04.456242+0000","last_peered":"2023-12-08T20:55:04.456242+0000","last_clean":"2023-12-08T20:55:04.456242+0000","last_became_active":"2023-12-08T20:54:54.979751+0000","last_became_peered":"2023-12-08T20:54:54.979751+0000","last_unstale":"2023-12-08T20:55:04.456242+0000","last_undegraded":"2023-12-08T20:55:04.456242+0000","last_fullsized":"2023-12-08T20:55:04.456242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:08.789175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553699+0000","last_change":"2023-12-08T20:55:04.513429+0000","last_active":"2023-12-08T20:55:05.553699+0000","last_peered":"2023-12-08T20:55:05.553699+0000","last_clean":"2023-12-08T20:55:05.553699+0000","last_became_active":"2023-12-08T20:55:04.511405+0000","last_became_peered":"2023-12-08T20:55:04.511405+0000","last_unstale":"2023-12-08T20:55:05.553699+0000","last_undegraded":"2023-12-08T20:55:05.553699+0000","last_fullsized":"2023-12-08T20:55:05.553699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:48:08.081679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553779+0000","last_change":"2023-12-08T20:55:04.537067+0000","last_active":"2023-12-08T20:55:05.553779+0000","last_peered":"2023-12-08T20:55:05.553779+0000","last_clean":"2023-12-08T20:55:05.553779+0000","last_became_active":"2023-12-08T20:55:04.536497+0000","last_became_peered":"2023-12-08T20:55:04.536497+0000","last_unstale":"2023-12-08T20:55:05.553779+0000","last_undegraded":"2023-12-08T20:55:05.553779+0000","last_fullsized":"2023-12-08T20:55:05.553779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:49.322641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360960+0000","last_change":"2023-12-08T20:54:56.318249+0000","last_active":"2023-12-08T20:55:04.360960+0000","last_peered":"2023-12-08T20:55:04.360960+0000","last_clean":"2023-12-08T20:55:04.360960+0000","last_became_active":"2023-12-08T20:54:56.317895+0000","last_became_peered":"2023-12-08T20:54:56.317895+0000","last_unstale":"2023-12-08T20:55:04.360960+0000","last_undegraded":"2023-12-08T20:55:04.360960+0000","last_fullsized":"2023-12-08T20:55:04.360960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:47:45.185235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507838+0000","last_change":"2023-12-08T20:54:54.935924+0000","last_active":"2023-12-08T20:55:04.507838+0000","last_peered":"2023-12-08T20:55:04.507838+0000","last_clean":"2023-12-08T20:55:04.507838+0000","last_became_active":"2023-12-08T20:54:54.935578+0000","last_became_peered":"2023-12-08T20:54:54.935578+0000","last_unstale":"2023-12-08T20:55:04.507838+0000","last_undegraded":"2023-12-08T20:55:04.507838+0000","last_fullsized":"2023-12-08T20:55:04.507838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:22.627774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.451614+0000","last_change":"2023-12-08T20:55:04.535940+0000","last_active":"2023-12-08T20:55:05.451614+0000","last_peered":"2023-12-08T20:55:05.451614+0000","last_clean":"2023-12-08T20:55:05.451614+0000","last_became_active":"2023-12-08T20:55:04.535525+0000","last_became_peered":"2023-12-08T20:55:04.535525+0000","last_unstale":"2023-12-08T20:55:05.451614+0000","last_undegraded":"2023-12-08T20:55:05.451614+0000","last_fullsized":"2023-12-08T20:55:05.451614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:30:14.451021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.513649+0000","last_change":"2023-12-08T20:54:56.413484+0000","last_active":"2023-12-08T20:55:04.513649+0000","last_peered":"2023-12-08T20:55:04.513649+0000","last_clean":"2023-12-08T20:55:04.513649+0000","last_became_active":"2023-12-08T20:54:56.412133+0000","last_became_peered":"2023-12-08T20:54:56.412133+0000","last_unstale":"2023-12-08T20:55:04.513649+0000","last_undegraded":"2023-12-08T20:55:04.513649+0000","last_fullsized":"2023-12-08T20:55:04.513649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:41:41.172811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.406565+0000","last_change":"2023-12-08T20:54:54.927237+0000","last_active":"2023-12-08T20:55:04.406565+0000","last_peered":"2023-12-08T20:55:04.406565+0000","last_clean":"2023-12-08T20:55:04.406565+0000","last_became_active":"2023-12-08T20:54:54.926804+0000","last_became_peered":"2023-12-08T20:54:54.926804+0000","last_unstale":"2023-12-08T20:55:04.406565+0000","last_undegraded":"2023-12-08T20:55:04.406565+0000","last_fullsized":"2023-12-08T20:55:04.406565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:30:21.341630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508451+0000","last_change":"2023-12-08T20:54:54.931212+0000","last_active":"2023-12-08T20:55:04.508451+0000","last_peered":"2023-12-08T20:55:04.508451+0000","last_clean":"2023-12-08T20:55:04.508451+0000","last_became_active":"2023-12-08T20:54:54.930324+0000","last_became_peered":"2023-12-08T20:54:54.930324+0000","last_unstale":"2023-12-08T20:55:04.508451+0000","last_undegraded":"2023-12-08T20:55:04.508451+0000","last_fullsized":"2023-12-08T20:55:04.508451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:54.461219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360041+0000","last_change":"2023-12-08T20:54:56.383879+0000","last_active":"2023-12-08T20:55:04.360041+0000","last_peered":"2023-12-08T20:55:04.360041+0000","last_clean":"2023-12-08T20:55:04.360041+0000","last_became_active":"2023-12-08T20:54:56.383467+0000","last_became_peered":"2023-12-08T20:54:56.383467+0000","last_unstale":"2023-12-08T20:55:04.360041+0000","last_undegraded":"2023-12-08T20:55:04.360041+0000","last_fullsized":"2023-12-08T20:55:04.360041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:59.236467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553946+0000","last_change":"2023-12-08T20:55:04.541743+0000","last_active":"2023-12-08T20:55:05.553946+0000","last_peered":"2023-12-08T20:55:05.553946+0000","last_clean":"2023-12-08T20:55:05.553946+0000","last_became_active":"2023-12-08T20:55:04.536537+0000","last_became_peered":"2023-12-08T20:55:04.536537+0000","last_unstale":"2023-12-08T20:55:05.553946+0000","last_undegraded":"2023-12-08T20:55:05.553946+0000","last_fullsized":"2023-12-08T20:55:05.553946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:45.443252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.532310+0000","last_change":"2023-12-08T20:54:54.925711+0000","last_active":"2023-12-08T20:55:04.532310+0000","last_peered":"2023-12-08T20:55:04.532310+0000","last_clean":"2023-12-08T20:55:04.532310+0000","last_became_active":"2023-12-08T20:54:54.925229+0000","last_became_peered":"2023-12-08T20:54:54.925229+0000","last_unstale":"2023-12-08T20:55:04.532310+0000","last_undegraded":"2023-12-08T20:55:04.532310+0000","last_fullsized":"2023-12-08T20:55:04.532310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:33:15.472131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456015+0000","last_change":"2023-12-08T20:54:56.404755+0000","last_active":"2023-12-08T20:55:04.456015+0000","last_peered":"2023-12-08T20:55:04.456015+0000","last_clean":"2023-12-08T20:55:04.456015+0000","last_became_active":"2023-12-08T20:54:56.403996+0000","last_became_peered":"2023-12-08T20:54:56.403996+0000","last_unstale":"2023-12-08T20:55:04.456015+0000","last_undegraded":"2023-12-08T20:55:04.456015+0000","last_fullsized":"2023-12-08T20:55:04.456015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.416387+0000","last_change":"2023-12-08T20:55:04.523477+0000","last_active":"2023-12-08T20:55:05.416387+0000","last_peered":"2023-12-08T20:55:05.416387+0000","last_clean":"2023-12-08T20:55:05.416387+0000","last_became_active":"2023-12-08T20:55:04.523137+0000","last_became_peered":"2023-12-08T20:55:04.523137+0000","last_unstale":"2023-12-08T20:55:05.416387+0000","last_undegraded":"2023-12-08T20:55:05.416387+0000","last_fullsized":"2023-12-08T20:55:05.416387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499296+0000","last_change":"2023-12-08T20:54:56.379055+0000","last_active":"2023-12-08T20:55:04.499296+0000","last_peered":"2023-12-08T20:55:04.499296+0000","last_clean":"2023-12-08T20:55:04.499296+0000","last_became_active":"2023-12-08T20:54:56.373080+0000","last_became_peered":"2023-12-08T20:54:56.373080+0000","last_unstale":"2023-12-08T20:55:04.499296+0000","last_undegraded":"2023-12-08T20:55:04.499296+0000","last_fullsized":"2023-12-08T20:55:04.499296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.305471+0000","last_change":"2023-12-08T20:54:56.378688+0000","last_active":"2023-12-08T20:55:04.305471+0000","last_peered":"2023-12-08T20:55:04.305471+0000","last_clean":"2023-12-08T20:55:04.305471+0000","last_became_active":"2023-12-08T20:54:56.378154+0000","last_became_peered":"2023-12-08T20:54:56.378154+0000","last_unstale":"2023-12-08T20:55:04.305471+0000","last_undegraded":"2023-12-08T20:55:04.305471+0000","last_fullsized":"2023-12-08T20:55:04.305471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:22:06.625769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508260+0000","last_change":"2023-12-08T20:54:56.410526+0000","last_active":"2023-12-08T20:55:04.508260+0000","last_peered":"2023-12-08T20:55:04.508260+0000","last_clean":"2023-12-08T20:55:04.508260+0000","last_became_active":"2023-12-08T20:54:56.409863+0000","last_became_peered":"2023-12-08T20:54:56.409863+0000","last_unstale":"2023-12-08T20:55:04.508260+0000","last_undegraded":"2023-12-08T20:55:04.508260+0000","last_fullsized":"2023-12-08T20:55:04.508260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:10.542611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.525819+0000","last_change":"2023-12-08T20:54:56.408750+0000","last_active":"2023-12-08T20:55:04.525819+0000","last_peered":"2023-12-08T20:55:04.525819+0000","last_clean":"2023-12-08T20:55:04.525819+0000","last_became_active":"2023-12-08T20:54:56.408205+0000","last_became_peered":"2023-12-08T20:54:56.408205+0000","last_unstale":"2023-12-08T20:55:04.525819+0000","last_undegraded":"2023-12-08T20:55:04.525819+0000","last_fullsized":"2023-12-08T20:55:04.525819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:55.750494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.413106+0000","last_change":"2023-12-08T20:54:56.386660+0000","last_active":"2023-12-08T20:55:04.413106+0000","last_peered":"2023-12-08T20:55:04.413106+0000","last_clean":"2023-12-08T20:55:04.413106+0000","last_became_active":"2023-12-08T20:54:56.386344+0000","last_became_peered":"2023-12-08T20:54:56.386344+0000","last_unstale":"2023-12-08T20:55:04.413106+0000","last_undegraded":"2023-12-08T20:55:04.413106+0000","last_fullsized":"2023-12-08T20:55:04.413106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:33:27.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.408612+0000","last_change":"2023-12-08T20:54:56.367640+0000","last_active":"2023-12-08T20:55:04.408612+0000","last_peered":"2023-12-08T20:55:04.408612+0000","last_clean":"2023-12-08T20:55:04.408612+0000","last_became_active":"2023-12-08T20:54:56.366967+0000","last_became_peered":"2023-12-08T20:54:56.366967+0000","last_unstale":"2023-12-08T20:55:04.408612+0000","last_undegraded":"2023-12-08T20:55:04.408612+0000","last_fullsized":"2023-12-08T20:55:04.408612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:22:24.171129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499446+0000","last_change":"2023-12-08T20:54:56.376663+0000","last_active":"2023-12-08T20:55:04.499446+0000","last_peered":"2023-12-08T20:55:04.499446+0000","last_clean":"2023-12-08T20:55:04.499446+0000","last_became_active":"2023-12-08T20:54:56.371954+0000","last_became_peered":"2023-12-08T20:54:56.371954+0000","last_unstale":"2023-12-08T20:55:04.499446+0000","last_undegraded":"2023-12-08T20:55:04.499446+0000","last_fullsized":"2023-12-08T20:55:04.499446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540616+0000","last_change":"2023-12-08T20:54:56.410398+0000","last_active":"2023-12-08T20:55:04.540616+0000","last_peered":"2023-12-08T20:55:04.540616+0000","last_clean":"2023-12-08T20:55:04.540616+0000","last_became_active":"2023-12-08T20:54:56.409462+0000","last_became_peered":"2023-12-08T20:54:56.409462+0000","last_unstale":"2023-12-08T20:55:04.540616+0000","last_undegraded":"2023-12-08T20:55:04.540616+0000","last_fullsized":"2023-12-08T20:55:04.540616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:07:04.340773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507752+0000","last_change":"2023-12-08T20:54:56.415800+0000","last_active":"2023-12-08T20:55:04.507752+0000","last_peered":"2023-12-08T20:55:04.507752+0000","last_clean":"2023-12-08T20:55:04.507752+0000","last_became_active":"2023-12-08T20:54:56.415176+0000","last_became_peered":"2023-12-08T20:54:56.415176+0000","last_unstale":"2023-12-08T20:55:04.507752+0000","last_undegraded":"2023-12-08T20:55:04.507752+0000","last_fullsized":"2023-12-08T20:55:04.507752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:24:27.173941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.524613+0000","last_change":"2023-12-08T20:54:56.401521+0000","last_active":"2023-12-08T20:55:04.524613+0000","last_peered":"2023-12-08T20:55:04.524613+0000","last_clean":"2023-12-08T20:55:04.524613+0000","last_became_active":"2023-12-08T20:54:56.400980+0000","last_became_peered":"2023-12-08T20:54:56.400980+0000","last_unstale":"2023-12-08T20:55:04.524613+0000","last_undegraded":"2023-12-08T20:55:04.524613+0000","last_fullsized":"2023-12-08T20:55:04.524613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:42.093754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.455672+0000","last_change":"2023-12-08T20:54:56.387218+0000","last_active":"2023-12-08T20:55:04.455672+0000","last_peered":"2023-12-08T20:55:04.455672+0000","last_clean":"2023-12-08T20:55:04.455672+0000","last_became_active":"2023-12-08T20:54:56.386413+0000","last_became_peered":"2023-12-08T20:54:56.386413+0000","last_unstale":"2023-12-08T20:55:04.455672+0000","last_undegraded":"2023-12-08T20:55:04.455672+0000","last_fullsized":"2023-12-08T20:55:04.455672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.359808+0000","last_change":"2023-12-08T20:54:56.371962+0000","last_active":"2023-12-08T20:55:04.359808+0000","last_peered":"2023-12-08T20:55:04.359808+0000","last_clean":"2023-12-08T20:55:04.359808+0000","last_became_active":"2023-12-08T20:54:56.371456+0000","last_became_peered":"2023-12-08T20:54:56.371456+0000","last_unstale":"2023-12-08T20:55:04.359808+0000","last_undegraded":"2023-12-08T20:55:04.359808+0000","last_fullsized":"2023-12-08T20:55:04.359808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:01.725223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.505002+0000","last_change":"2023-12-08T20:54:56.381311+0000","last_active":"2023-12-08T20:55:04.505002+0000","last_peered":"2023-12-08T20:55:04.505002+0000","last_clean":"2023-12-08T20:55:04.505002+0000","last_became_active":"2023-12-08T20:54:56.380860+0000","last_became_peered":"2023-12-08T20:54:56.380860+0000","last_unstale":"2023-12-08T20:55:04.505002+0000","last_undegraded":"2023-12-08T20:55:04.505002+0000","last_fullsized":"2023-12-08T20:55:04.505002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:11:11.173329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508899+0000","last_change":"2023-12-08T20:54:56.261370+0000","last_active":"2023-12-08T20:55:04.508899+0000","last_peered":"2023-12-08T20:55:04.508899+0000","last_clean":"2023-12-08T20:55:04.508899+0000","last_became_active":"2023-12-08T20:54:56.260387+0000","last_became_peered":"2023-12-08T20:54:56.260387+0000","last_unstale":"2023-12-08T20:55:04.508899+0000","last_undegraded":"2023-12-08T20:55:04.508899+0000","last_fullsized":"2023-12-08T20:55:04.508899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:17:07.046357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.306216+0000","last_change":"2023-12-08T20:54:56.388280+0000","last_active":"2023-12-08T20:55:04.306216+0000","last_peered":"2023-12-08T20:55:04.306216+0000","last_clean":"2023-12-08T20:55:04.306216+0000","last_became_active":"2023-12-08T20:54:56.387774+0000","last_became_peered":"2023-12-08T20:54:56.387774+0000","last_unstale":"2023-12-08T20:55:04.306216+0000","last_undegraded":"2023-12-08T20:55:04.306216+0000","last_fullsized":"2023-12-08T20:55:04.306216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:15:20.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.509158+0000","last_change":"2023-12-08T20:54:56.378804+0000","last_active":"2023-12-08T20:55:04.509158+0000","last_peered":"2023-12-08T20:55:04.509158+0000","last_clean":"2023-12-08T20:55:04.509158+0000","last_became_active":"2023-12-08T20:54:56.377029+0000","last_became_peered":"2023-12-08T20:54:56.377029+0000","last_unstale":"2023-12-08T20:55:04.509158+0000","last_undegraded":"2023-12-08T20:55:04.509158+0000","last_fullsized":"2023-12-08T20:55:04.509158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:55:29.247824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507664+0000","last_change":"2023-12-08T20:54:56.372118+0000","last_active":"2023-12-08T20:55:04.507664+0000","last_peered":"2023-12-08T20:55:04.507664+0000","last_clean":"2023-12-08T20:55:04.507664+0000","last_became_active":"2023-12-08T20:54:56.370707+0000","last_became_peered":"2023-12-08T20:54:56.370707+0000","last_unstale":"2023-12-08T20:55:04.507664+0000","last_undegraded":"2023-12-08T20:55:04.507664+0000","last_fullsized":"2023-12-08T20:55:04.507664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:35.994091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.524392+0000","last_change":"2023-12-08T20:54:56.405033+0000","last_active":"2023-12-08T20:55:04.524392+0000","last_peered":"2023-12-08T20:55:04.524392+0000","last_clean":"2023-12-08T20:55:04.524392+0000","last_became_active":"2023-12-08T20:54:56.401544+0000","last_became_peered":"2023-12-08T20:54:56.401544+0000","last_unstale":"2023-12-08T20:55:04.524392+0000","last_undegraded":"2023-12-08T20:55:04.524392+0000","last_fullsized":"2023-12-08T20:55:04.524392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:59.303019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.406433+0000","last_change":"2023-12-08T20:54:56.366037+0000","last_active":"2023-12-08T20:55:04.406433+0000","last_peered":"2023-12-08T20:55:04.406433+0000","last_clean":"2023-12-08T20:55:04.406433+0000","last_became_active":"2023-12-08T20:54:56.365432+0000","last_became_peered":"2023-12-08T20:54:56.365432+0000","last_unstale":"2023-12-08T20:55:04.406433+0000","last_undegraded":"2023-12-08T20:55:04.406433+0000","last_fullsized":"2023-12-08T20:55:04.406433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:48:49.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.407208+0000","last_change":"2023-12-08T20:54:56.393022+0000","last_active":"2023-12-08T20:55:04.407208+0000","last_peered":"2023-12-08T20:55:04.407208+0000","last_clean":"2023-12-08T20:55:04.407208+0000","last_became_active":"2023-12-08T20:54:56.392408+0000","last_became_peered":"2023-12-08T20:54:56.392408+0000","last_unstale":"2023-12-08T20:55:04.407208+0000","last_undegraded":"2023-12-08T20:55:04.407208+0000","last_fullsized":"2023-12-08T20:55:04.407208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:30:22.435898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504911+0000","last_change":"2023-12-08T20:54:56.380654+0000","last_active":"2023-12-08T20:55:04.504911+0000","last_peered":"2023-12-08T20:55:04.504911+0000","last_clean":"2023-12-08T20:55:04.504911+0000","last_became_active":"2023-12-08T20:54:56.380137+0000","last_became_peered":"2023-12-08T20:54:56.380137+0000","last_unstale":"2023-12-08T20:55:04.504911+0000","last_undegraded":"2023-12-08T20:55:04.504911+0000","last_fullsized":"2023-12-08T20:55:04.504911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:47:59.833913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504032+0000","last_change":"2023-12-08T20:54:56.392997+0000","last_active":"2023-12-08T20:55:04.504032+0000","last_peered":"2023-12-08T20:55:04.504032+0000","last_clean":"2023-12-08T20:55:04.504032+0000","last_became_active":"2023-12-08T20:54:56.391299+0000","last_became_peered":"2023-12-08T20:54:56.391299+0000","last_unstale":"2023-12-08T20:55:04.504032+0000","last_undegraded":"2023-12-08T20:55:04.504032+0000","last_fullsized":"2023-12-08T20:55:04.504032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:37.195485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503945+0000","last_change":"2023-12-08T20:54:56.393461+0000","last_active":"2023-12-08T20:55:04.503945+0000","last_peered":"2023-12-08T20:55:04.503945+0000","last_clean":"2023-12-08T20:55:04.503945+0000","last_became_active":"2023-12-08T20:54:56.392708+0000","last_became_peered":"2023-12-08T20:54:56.392708+0000","last_unstale":"2023-12-08T20:55:04.503945+0000","last_undegraded":"2023-12-08T20:55:04.503945+0000","last_fullsized":"2023-12-08T20:55:04.503945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:44.697264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456232+0000","last_change":"2023-12-08T20:54:56.319183+0000","last_active":"2023-12-08T20:55:04.456232+0000","last_peered":"2023-12-08T20:55:04.456232+0000","last_clean":"2023-12-08T20:55:04.456232+0000","last_became_active":"2023-12-08T20:54:56.318400+0000","last_became_peered":"2023-12-08T20:54:56.318400+0000","last_unstale":"2023-12-08T20:55:04.456232+0000","last_undegraded":"2023-12-08T20:55:04.456232+0000","last_fullsized":"2023-12-08T20:55:04.456232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.512685+0000","last_change":"2023-12-08T20:54:56.414028+0000","last_active":"2023-12-08T20:55:04.512685+0000","last_peered":"2023-12-08T20:55:04.512685+0000","last_clean":"2023-12-08T20:55:04.512685+0000","last_became_active":"2023-12-08T20:54:56.413220+0000","last_became_peered":"2023-12-08T20:54:56.413220+0000","last_unstale":"2023-12-08T20:55:04.512685+0000","last_undegraded":"2023-12-08T20:55:04.512685+0000","last_fullsized":"2023-12-08T20:55:04.512685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:23.917049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504035+0000","last_change":"2023-12-08T20:54:56.366203+0000","last_active":"2023-12-08T20:55:04.504035+0000","last_peered":"2023-12-08T20:55:04.504035+0000","last_clean":"2023-12-08T20:55:04.504035+0000","last_became_active":"2023-12-08T20:54:56.365448+0000","last_became_peered":"2023-12-08T20:54:56.365448+0000","last_unstale":"2023-12-08T20:55:04.504035+0000","last_undegraded":"2023-12-08T20:55:04.504035+0000","last_fullsized":"2023-12-08T20:55:04.504035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:10.405742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499135+0000","last_change":"2023-12-08T20:54:56.373847+0000","last_active":"2023-12-08T20:55:04.499135+0000","last_peered":"2023-12-08T20:55:04.499135+0000","last_clean":"2023-12-08T20:55:04.499135+0000","last_became_active":"2023-12-08T20:54:56.369574+0000","last_became_peered":"2023-12-08T20:54:56.369574+0000","last_unstale":"2023-12-08T20:55:04.499135+0000","last_undegraded":"2023-12-08T20:55:04.499135+0000","last_fullsized":"2023-12-08T20:55:04.499135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:10.078450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503926+0000","last_change":"2023-12-08T20:54:56.411972+0000","last_active":"2023-12-08T20:55:04.503926+0000","last_peered":"2023-12-08T20:55:04.503926+0000","last_clean":"2023-12-08T20:55:04.503926+0000","last_became_active":"2023-12-08T20:54:56.411339+0000","last_became_peered":"2023-12-08T20:54:56.411339+0000","last_unstale":"2023-12-08T20:55:04.503926+0000","last_undegraded":"2023-12-08T20:55:04.503926+0000","last_fullsized":"2023-12-08T20:55:04.503926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:41.074875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499247+0000","last_change":"2023-12-08T20:54:56.370763+0000","last_active":"2023-12-08T20:55:04.499247+0000","last_peered":"2023-12-08T20:55:04.499247+0000","last_clean":"2023-12-08T20:55:04.499247+0000","last_became_active":"2023-12-08T20:54:56.369650+0000","last_became_peered":"2023-12-08T20:54:56.369650+0000","last_unstale":"2023-12-08T20:55:04.499247+0000","last_undegraded":"2023-12-08T20:55:04.499247+0000","last_fullsized":"2023-12-08T20:55:04.499247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540578+0000","last_change":"2023-12-08T20:54:56.409124+0000","last_active":"2023-12-08T20:55:04.540578+0000","last_peered":"2023-12-08T20:55:04.540578+0000","last_clean":"2023-12-08T20:55:04.540578+0000","last_became_active":"2023-12-08T20:54:56.408861+0000","last_became_peered":"2023-12-08T20:54:56.408861+0000","last_unstale":"2023-12-08T20:55:04.540578+0000","last_undegraded":"2023-12-08T20:55:04.540578+0000","last_fullsized":"2023-12-08T20:55:04.540578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:40:00.277639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.541600+0000","last_change":"2023-12-08T20:54:56.407010+0000","last_active":"2023-12-08T20:55:04.541600+0000","last_peered":"2023-12-08T20:55:04.541600+0000","last_clean":"2023-12-08T20:55:04.541600+0000","last_became_active":"2023-12-08T20:54:56.404697+0000","last_became_peered":"2023-12-08T20:54:56.404697+0000","last_unstale":"2023-12-08T20:55:04.541600+0000","last_undegraded":"2023-12-08T20:55:04.541600+0000","last_fullsized":"2023-12-08T20:55:04.541600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:58:49.474462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504231+0000","last_change":"2023-12-08T20:54:56.378873+0000","last_active":"2023-12-08T20:55:04.504231+0000","last_peered":"2023-12-08T20:55:04.504231+0000","last_clean":"2023-12-08T20:55:04.504231+0000","last_became_active":"2023-12-08T20:54:56.377835+0000","last_became_peered":"2023-12-08T20:54:56.377835+0000","last_unstale":"2023-12-08T20:55:04.504231+0000","last_undegraded":"2023-12-08T20:55:04.504231+0000","last_fullsized":"2023-12-08T20:55:04.504231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:54:57.439693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":708223,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.0329999999999999}]},{"osd":2,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.83399999999999996}]},{"osd":3,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.0529999999999999}]},{"osd":4,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.232}]},{"osd":7,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.2589999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":118345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73599999999999999}]},{"osd":1,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.623},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.018}]},{"osd":2,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.337},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.91300000000000003}]},{"osd":5,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.149},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.1870000000000001}]},{"osd":6,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.2210000000000001}]},{"osd":7,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.2589999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":121602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.92200000000000004}]},{"osd":1,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.623},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.69299999999999995}]},{"osd":3,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.0029999999999999}]},{"osd":5,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.0409999999999999}]},{"osd":6,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.86499999999999999}]},{"osd":7,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.077}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":364544,"data_stored":708201,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.113}]},{"osd":5,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.79100000000000004}]},{"osd":6,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.319},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84699999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":303104,"data_stored":117819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.80300000000000005}]},{"osd":3,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.89100000000000001}]},{"osd":6,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.034}]},{"osd":7,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.006},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.77100000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":117887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.84699999999999998}]},{"osd":3,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.89200000000000002}]},{"osd":4,"last update":"Fri Dec 8 20:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.143},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":1.121}]},{"osd":5,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2250000000000001}]},{"osd":6,"last update":"Fri Dec 8 20:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.294}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":117763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.93999999999999995}]},{"osd":1,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":1.034},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65800000000000003}]},{"osd":2,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.879},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.22}]},{"osd":4,"last update":"Fri Dec 8 20:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.0700000000000001}]},{"osd":7,"last update":"Fri Dec 8 20:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.1499999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":122274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.96499999999999997}]},{"osd":2,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.76600000000000001}]},{"osd":3,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.0549999999999999}]},{"osd":5,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.032}]},{"osd":6,"last update":"Fri Dec 8 20:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.006},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.877}]},{"osd":7,"last update":"Fri Dec 8 20:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T20:55:40.749 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T20:55:40.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.914+0000 7f2bba65e640 1 Processor -- start 2023-12-08T20:55:40.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.914+0000 7f2bba65e640 1 -- start start 2023-12-08T20:55:40.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.914+0000 7f2bba65e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2bb4153890 0x7f2bb40ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:40.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.914+0000 7f2bba65e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bb40c94b0 0x7f2bb40c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:40.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.914+0000 7f2bba65e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2bb40c8ef0 0x7f2bb4159d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:40.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.914+0000 7f2bba65e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb40c7cd0 con 0x7f2bb40c8ef0 2023-12-08T20:55:40.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.914+0000 7f2bba65e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb4159870 con 0x7f2bb4153890 2023-12-08T20:55:40.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.914+0000 7f2bba65e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb40c98f0 con 0x7f2bb40c94b0 2023-12-08T20:55:40.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.942+0000 7f2bb8bfb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2bb40c8ef0 0x7f2bb4159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:40.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.942+0000 7f2bb37fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bb40c94b0 0x7f2bb40c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:40.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.942+0000 7f2bb37fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bb40c94b0 0x7f2bb40c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:38454/0 (socket says 172.21.15.53:38454) 2023-12-08T20:55:40.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.942+0000 7f2bb37fe640 1 -- 172.21.15.53:0/2773580296 learned_addr learned my addr 172.21.15.53:0/2773580296 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:40.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.950+0000 7f2bb8bfb640 1 -- 172.21.15.53:0/2773580296 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bb40c94b0 msgr2=0x7f2bb40c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:40.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.950+0000 7f2bb8bfb640 1 --2- 172.21.15.53:0/2773580296 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bb40c94b0 0x7f2bb40c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.950+0000 7f2bb8bfb640 1 -- 172.21.15.53:0/2773580296 >> v2:172.21.15.146:3300/0 conn(0x7f2bb4153890 msgr2=0x7f2bb40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:40.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.950+0000 7f2bb8bfb640 1 --2- 172.21.15.53:0/2773580296 >> v2:172.21.15.146:3300/0 conn(0x7f2bb4153890 0x7f2bb40ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.950+0000 7f2bb8bfb640 1 -- 172.21.15.53:0/2773580296 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb415d020 con 0x7f2bb40c8ef0 2023-12-08T20:55:40.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.954+0000 7f2bb8bfb640 1 --2- 172.21.15.53:0/2773580296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb40c8ef0 0x7f2bb4159d00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40716e0 tx=0x7f2bac01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5dea4e200c4805 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:40.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.962+0000 7f2bb2ffd640 1 -- 172.21.15.53:0/2773580296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0a5870 con 0x7f2bb40c8ef0 2023-12-08T20:55:40.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.962+0000 7f2bb2ffd640 1 -- 172.21.15.53:0/2773580296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac0a59d0 con 0x7f2bb40c8ef0 2023-12-08T20:55:40.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.962+0000 7f2bb2ffd640 1 -- 172.21.15.53:0/2773580296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0a5d60 con 0x7f2bb40c8ef0 2023-12-08T20:55:40.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.962+0000 7f2bba65e640 1 -- 172.21.15.53:0/2773580296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb40c8ef0 msgr2=0x7f2bb4159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:40.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.962+0000 7f2bba65e640 1 --2- 172.21.15.53:0/2773580296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb40c8ef0 0x7f2bb4159d00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40716e0 tx=0x7f2bac01c8e0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.962+0000 7f2bba65e640 1 -- 172.21.15.53:0/2773580296 shutdown_connections 2023-12-08T20:55:40.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.962+0000 7f2bba65e640 1 --2- 172.21.15.53:0/2773580296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb40c8ef0 0x7f2bb4159d00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.962+0000 7f2bba65e640 1 --2- 172.21.15.53:0/2773580296 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bb40c94b0 0x7f2bb40c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.962+0000 7f2bba65e640 1 --2- 172.21.15.53:0/2773580296 >> v2:172.21.15.146:3300/0 conn(0x7f2bb4153890 0x7f2bb40ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.962+0000 7f2bba65e640 1 -- 172.21.15.53:0/2773580296 >> 172.21.15.53:0/2773580296 conn(0x7f2bb4070320 msgr2=0x7f2bb406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:40.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.962+0000 7f2bba65e640 1 -- 172.21.15.53:0/2773580296 shutdown_connections 2023-12-08T20:55:40.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.962+0000 7f2bba65e640 1 -- 172.21.15.53:0/2773580296 wait complete. 2023-12-08T20:55:40.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.966+0000 7f2bba65e640 1 Processor -- start 2023-12-08T20:55:40.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.966+0000 7f2bba65e640 1 -- start start 2023-12-08T20:55:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.966+0000 7f2bba65e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb40c8ef0 0x7f2bb414e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.966+0000 7f2bba65e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bb40c94b0 0x7f2bb40b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.966+0000 7f2bba65e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb4153890 0x7f2bb40b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.966+0000 7f2bba65e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb40cca70 con 0x7f2bb4153890 2023-12-08T20:55:40.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.966+0000 7f2bba65e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb40cbea0 con 0x7f2bb40c8ef0 2023-12-08T20:55:40.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.966+0000 7f2bba65e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb414eff0 con 0x7f2bb40c94b0 2023-12-08T20:55:40.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.970+0000 7f2bb37fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bb40c94b0 0x7f2bb40b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:40.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.970+0000 7f2bb37fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bb40c94b0 0x7f2bb40b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:38466/0 (socket says 172.21.15.53:38466) 2023-12-08T20:55:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.970+0000 7f2bb37fe640 1 -- 172.21.15.53:0/1892399288 learned_addr learned my addr 172.21.15.53:0/1892399288 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.970+0000 7f2bb8bfb640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb4153890 0x7f2bb40b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:40.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.974+0000 7f2bb8bfb640 1 -- 172.21.15.53:0/1892399288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bb40c94b0 msgr2=0x7f2bb40b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:40.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.974+0000 7f2bb8bfb640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bb40c94b0 0x7f2bb40b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.974+0000 7f2bb8bfb640 1 -- 172.21.15.53:0/1892399288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb40c8ef0 msgr2=0x7f2bb414e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:40.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.974+0000 7f2bb8bfb640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb40c8ef0 0x7f2bb414e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:40.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.974+0000 7f2bb8bfb640 1 -- 172.21.15.53:0/1892399288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac009a70 con 0x7f2bb4153890 2023-12-08T20:55:40.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.978+0000 7f2bb8bfb640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb4153890 0x7f2bb40b0fc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0ac000 tx=0x7f2bac019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:40.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.982+0000 7f2bb0ff9640 1 -- 172.21.15.53:0/1892399288 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0bf070 con 0x7f2bb4153890 2023-12-08T20:55:40.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.982+0000 7f2bb0ff9640 1 -- 172.21.15.53:0/1892399288 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac0ad440 con 0x7f2bb4153890 2023-12-08T20:55:40.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.982+0000 7f2bb0ff9640 1 -- 172.21.15.53:0/1892399288 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0ad7f0 con 0x7f2bb4153890 2023-12-08T20:55:40.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.982+0000 7f2bba65e640 1 -- 172.21.15.53:0/1892399288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb40cc140 con 0x7f2bb4153890 2023-12-08T20:55:40.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.982+0000 7f2bba65e640 1 -- 172.21.15.53:0/1892399288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb40cc700 con 0x7f2bb4153890 2023-12-08T20:55:40.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:40.982+0000 7f2bba65e640 1 -- 172.21.15.53:0/1892399288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb4074190 con 0x7f2bb4153890 2023-12-08T20:55:41.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.006+0000 7f2bb0ff9640 1 -- 172.21.15.53:0/1892399288 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2bac0b4050 con 0x7f2bb4153890 2023-12-08T20:55:41.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.006+0000 7f2bb0ff9640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2b940664c0 0x7f2b94068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:41.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.006+0000 7f2bb3fff640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2b940664c0 0x7f2b94068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:41.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.006+0000 7f2bb3fff640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2b940664c0 0x7f2b94068980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009690 tx=0x7f2b9c006c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:41.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.302+0000 7f2bb0ff9640 1 -- 172.21.15.53:0/1892399288 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2bac0f0910 con 0x7f2bb4153890 2023-12-08T20:55:41.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.302+0000 7f2bb0ff9640 1 -- 172.21.15.53:0/1892399288 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2bac0ec550 con 0x7f2bb4153890 2023-12-08T20:55:41.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.506+0000 7f2bba65e640 1 -- 172.21.15.53:0/1892399288 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bb414de30 con 0x7f2b940664c0 2023-12-08T20:55:41.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.530+0000 7f2bb0ff9640 1 -- 172.21.15.53:0/1892399288 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368809 (secure 0 0 0) 0x7f2bb414de30 con 0x7f2b940664c0 2023-12-08T20:55:41.533 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:41.537 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-12-08T20:55:41.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.538+0000 7f2bba65e640 1 -- 172.21.15.53:0/1892399288 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2b940664c0 msgr2=0x7f2b94068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:41.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.538+0000 7f2bba65e640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2b940664c0 0x7f2b94068980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009690 tx=0x7f2b9c006c00 comp rx=0 tx=0).stop 2023-12-08T20:55:41.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.538+0000 7f2bba65e640 1 -- 172.21.15.53:0/1892399288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb4153890 msgr2=0x7f2bb40b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:41.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.538+0000 7f2bba65e640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb4153890 0x7f2bb40b0fc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0ac000 tx=0x7f2bac019680 comp rx=0 tx=0).stop 2023-12-08T20:55:41.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.538+0000 7f2bba65e640 1 -- 172.21.15.53:0/1892399288 shutdown_connections 2023-12-08T20:55:41.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.538+0000 7f2bba65e640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2b940664c0 0x7f2b94068980 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:41.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.538+0000 7f2bba65e640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb4153890 0x7f2bb40b0fc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:41.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.538+0000 7f2bba65e640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bb40c94b0 0x7f2bb40b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:41.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.538+0000 7f2bba65e640 1 --2- 172.21.15.53:0/1892399288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb40c8ef0 0x7f2bb414e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:41.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.538+0000 7f2bba65e640 1 -- 172.21.15.53:0/1892399288 >> 172.21.15.53:0/1892399288 conn(0x7f2bb4070320 msgr2=0x7f2bb4158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:41.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.538+0000 7f2bba65e640 1 -- 172.21.15.53:0/1892399288 shutdown_connections 2023-12-08T20:55:41.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.538+0000 7f2bba65e640 1 -- 172.21.15.53:0/1892399288 wait complete. 2023-12-08T20:55:41.562 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-12-08T20:55:41.243340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235312,"kb_used_data":2496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739408,"statfs":{"total":773094113280,"available":772853153792,"internally_reserved":0,"allocated":2555904,"data_stored":2132114,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005259"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360564+0000","last_change":"2023-12-08T20:54:54.983255+0000","last_active":"2023-12-08T20:55:04.360564+0000","last_peered":"2023-12-08T20:55:04.360564+0000","last_clean":"2023-12-08T20:55:04.360564+0000","last_became_active":"2023-12-08T20:54:54.982479+0000","last_became_peered":"2023-12-08T20:54:54.982479+0000","last_unstale":"2023-12-08T20:55:04.360564+0000","last_undegraded":"2023-12-08T20:55:04.360564+0000","last_fullsized":"2023-12-08T20:55:04.360564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:17:36.784429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.542062+0000","last_change":"2023-12-08T20:54:56.407614+0000","last_active":"2023-12-08T20:55:04.542062+0000","last_peered":"2023-12-08T20:55:04.542062+0000","last_clean":"2023-12-08T20:55:04.542062+0000","last_became_active":"2023-12-08T20:54:56.406245+0000","last_became_peered":"2023-12-08T20:54:56.406245+0000","last_unstale":"2023-12-08T20:55:04.542062+0000","last_undegraded":"2023-12-08T20:55:04.542062+0000","last_fullsized":"2023-12-08T20:55:04.542062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:29.997818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.414972+0000","last_change":"2023-12-08T20:55:04.459400+0000","last_active":"2023-12-08T20:55:05.414972+0000","last_peered":"2023-12-08T20:55:05.414972+0000","last_clean":"2023-12-08T20:55:05.414972+0000","last_became_active":"2023-12-08T20:55:04.458087+0000","last_became_peered":"2023-12-08T20:55:04.458087+0000","last_unstale":"2023-12-08T20:55:05.414972+0000","last_undegraded":"2023-12-08T20:55:05.414972+0000","last_fullsized":"2023-12-08T20:55:05.414972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:23.378911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.542369+0000","last_change":"2023-12-08T20:54:54.929925+0000","last_active":"2023-12-08T20:55:04.542369+0000","last_peered":"2023-12-08T20:55:04.542369+0000","last_clean":"2023-12-08T20:55:04.542369+0000","last_became_active":"2023-12-08T20:54:54.929391+0000","last_became_peered":"2023-12-08T20:54:54.929391+0000","last_unstale":"2023-12-08T20:55:04.542369+0000","last_undegraded":"2023-12-08T20:55:04.542369+0000","last_fullsized":"2023-12-08T20:55:04.542369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:15:29.148520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540789+0000","last_change":"2023-12-08T20:54:56.409201+0000","last_active":"2023-12-08T20:55:04.540789+0000","last_peered":"2023-12-08T20:55:04.540789+0000","last_clean":"2023-12-08T20:55:04.540789+0000","last_became_active":"2023-12-08T20:54:56.408361+0000","last_became_peered":"2023-12-08T20:54:56.408361+0000","last_unstale":"2023-12-08T20:55:04.540789+0000","last_undegraded":"2023-12-08T20:55:04.540789+0000","last_fullsized":"2023-12-08T20:55:04.540789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:43:42.044530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491431+0000","last_change":"2023-12-08T20:55:04.529086+0000","last_active":"2023-12-08T20:55:05.491431+0000","last_peered":"2023-12-08T20:55:05.491431+0000","last_clean":"2023-12-08T20:55:05.491431+0000","last_became_active":"2023-12-08T20:55:04.528732+0000","last_became_peered":"2023-12-08T20:55:04.528732+0000","last_unstale":"2023-12-08T20:55:05.491431+0000","last_undegraded":"2023-12-08T20:55:05.491431+0000","last_fullsized":"2023-12-08T20:55:05.491431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:09:07.484233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504210+0000","last_change":"2023-12-08T20:54:54.935973+0000","last_active":"2023-12-08T20:55:04.504210+0000","last_peered":"2023-12-08T20:55:04.504210+0000","last_clean":"2023-12-08T20:55:04.504210+0000","last_became_active":"2023-12-08T20:54:54.935620+0000","last_became_peered":"2023-12-08T20:54:54.935620+0000","last_unstale":"2023-12-08T20:55:04.504210+0000","last_undegraded":"2023-12-08T20:55:04.504210+0000","last_fullsized":"2023-12-08T20:55:04.504210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:57.947192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456300+0000","last_change":"2023-12-08T20:54:56.382016+0000","last_active":"2023-12-08T20:55:04.456300+0000","last_peered":"2023-12-08T20:55:04.456300+0000","last_clean":"2023-12-08T20:55:04.456300+0000","last_became_active":"2023-12-08T20:54:56.380927+0000","last_became_peered":"2023-12-08T20:54:56.380927+0000","last_unstale":"2023-12-08T20:55:04.456300+0000","last_undegraded":"2023-12-08T20:55:04.456300+0000","last_fullsized":"2023-12-08T20:55:04.456300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491749+0000","last_change":"2023-12-08T20:55:04.527024+0000","last_active":"2023-12-08T20:55:05.491749+0000","last_peered":"2023-12-08T20:55:05.491749+0000","last_clean":"2023-12-08T20:55:05.491749+0000","last_became_active":"2023-12-08T20:55:04.526605+0000","last_became_peered":"2023-12-08T20:55:04.526605+0000","last_unstale":"2023-12-08T20:55:05.491749+0000","last_undegraded":"2023-12-08T20:55:05.491749+0000","last_fullsized":"2023-12-08T20:55:05.491749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:15.471006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.505308+0000","last_change":"2023-12-08T20:54:54.929388+0000","last_active":"2023-12-08T20:55:04.505308+0000","last_peered":"2023-12-08T20:55:04.505308+0000","last_clean":"2023-12-08T20:55:04.505308+0000","last_became_active":"2023-12-08T20:54:54.926132+0000","last_became_peered":"2023-12-08T20:54:54.926132+0000","last_unstale":"2023-12-08T20:55:04.505308+0000","last_undegraded":"2023-12-08T20:55:04.505308+0000","last_fullsized":"2023-12-08T20:55:04.505308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:00.435948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508722+0000","last_change":"2023-12-08T20:54:56.388306+0000","last_active":"2023-12-08T20:55:04.508722+0000","last_peered":"2023-12-08T20:55:04.508722+0000","last_clean":"2023-12-08T20:55:04.508722+0000","last_became_active":"2023-12-08T20:54:56.387528+0000","last_became_peered":"2023-12-08T20:54:56.387528+0000","last_unstale":"2023-12-08T20:55:04.508722+0000","last_undegraded":"2023-12-08T20:55:04.508722+0000","last_fullsized":"2023-12-08T20:55:04.508722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:22.236935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491559+0000","last_change":"2023-12-08T20:55:04.523251+0000","last_active":"2023-12-08T20:55:05.491559+0000","last_peered":"2023-12-08T20:55:05.491559+0000","last_clean":"2023-12-08T20:55:05.491559+0000","last_became_active":"2023-12-08T20:55:04.522777+0000","last_became_peered":"2023-12-08T20:55:04.522777+0000","last_unstale":"2023-12-08T20:55:05.491559+0000","last_undegraded":"2023-12-08T20:55:05.491559+0000","last_fullsized":"2023-12-08T20:55:05.491559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:09.972989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508344+0000","last_change":"2023-12-08T20:54:56.319638+0000","last_active":"2023-12-08T20:55:04.508344+0000","last_peered":"2023-12-08T20:55:04.508344+0000","last_clean":"2023-12-08T20:55:04.508344+0000","last_became_active":"2023-12-08T20:54:56.318855+0000","last_became_peered":"2023-12-08T20:54:56.318855+0000","last_unstale":"2023-12-08T20:55:04.508344+0000","last_undegraded":"2023-12-08T20:55:04.508344+0000","last_fullsized":"2023-12-08T20:55:04.508344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:27.151902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508472+0000","last_change":"2023-12-08T20:54:54.929584+0000","last_active":"2023-12-08T20:55:04.508472+0000","last_peered":"2023-12-08T20:55:04.508472+0000","last_clean":"2023-12-08T20:55:04.508472+0000","last_became_active":"2023-12-08T20:54:54.928702+0000","last_became_peered":"2023-12-08T20:54:54.928702+0000","last_unstale":"2023-12-08T20:55:04.508472+0000","last_undegraded":"2023-12-08T20:55:04.508472+0000","last_fullsized":"2023-12-08T20:55:04.508472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:40.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.450640+0000","last_change":"2023-12-08T20:55:04.535786+0000","last_active":"2023-12-08T20:55:05.450640+0000","last_peered":"2023-12-08T20:55:05.450640+0000","last_clean":"2023-12-08T20:55:05.450640+0000","last_became_active":"2023-12-08T20:55:04.535119+0000","last_became_peered":"2023-12-08T20:55:04.535119+0000","last_unstale":"2023-12-08T20:55:05.450640+0000","last_undegraded":"2023-12-08T20:55:05.450640+0000","last_fullsized":"2023-12-08T20:55:05.450640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:23:32.647822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.305734+0000","last_change":"2023-12-08T20:54:56.370877+0000","last_active":"2023-12-08T20:55:04.305734+0000","last_peered":"2023-12-08T20:55:04.305734+0000","last_clean":"2023-12-08T20:55:04.305734+0000","last_became_active":"2023-12-08T20:54:56.370044+0000","last_became_peered":"2023-12-08T20:54:56.370044+0000","last_unstale":"2023-12-08T20:55:04.305734+0000","last_undegraded":"2023-12-08T20:55:04.305734+0000","last_fullsized":"2023-12-08T20:55:04.305734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.407476+0000","last_change":"2023-12-08T20:54:54.923604+0000","last_active":"2023-12-08T20:55:04.407476+0000","last_peered":"2023-12-08T20:55:04.407476+0000","last_clean":"2023-12-08T20:55:04.407476+0000","last_became_active":"2023-12-08T20:54:54.922960+0000","last_became_peered":"2023-12-08T20:54:54.922960+0000","last_unstale":"2023-12-08T20:55:04.407476+0000","last_undegraded":"2023-12-08T20:55:04.407476+0000","last_fullsized":"2023-12-08T20:55:04.407476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:41:46.444603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.554984+0000","last_change":"2023-12-08T20:55:04.522655+0000","last_active":"2023-12-08T20:55:05.554984+0000","last_peered":"2023-12-08T20:55:05.554984+0000","last_clean":"2023-12-08T20:55:05.554984+0000","last_became_active":"2023-12-08T20:55:04.522172+0000","last_became_peered":"2023-12-08T20:55:04.522172+0000","last_unstale":"2023-12-08T20:55:05.554984+0000","last_undegraded":"2023-12-08T20:55:05.554984+0000","last_fullsized":"2023-12-08T20:55:05.554984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:09:00.038275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360579+0000","last_change":"2023-12-08T20:54:56.366227+0000","last_active":"2023-12-08T20:55:04.360579+0000","last_peered":"2023-12-08T20:55:04.360579+0000","last_clean":"2023-12-08T20:55:04.360579+0000","last_became_active":"2023-12-08T20:54:56.365552+0000","last_became_peered":"2023-12-08T20:54:56.365552+0000","last_unstale":"2023-12-08T20:55:04.360579+0000","last_undegraded":"2023-12-08T20:55:04.360579+0000","last_fullsized":"2023-12-08T20:55:04.360579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:00.821031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.361153+0000","last_change":"2023-12-08T20:54:54.980466+0000","last_active":"2023-12-08T20:55:04.361153+0000","last_peered":"2023-12-08T20:55:04.361153+0000","last_clean":"2023-12-08T20:55:04.361153+0000","last_became_active":"2023-12-08T20:54:54.979668+0000","last_became_peered":"2023-12-08T20:54:54.979668+0000","last_unstale":"2023-12-08T20:55:04.361153+0000","last_undegraded":"2023-12-08T20:55:04.361153+0000","last_fullsized":"2023-12-08T20:55:04.361153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:53.529738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.415715+0000","last_change":"2023-12-08T20:55:04.513186+0000","last_active":"2023-12-08T20:55:05.415715+0000","last_peered":"2023-12-08T20:55:05.415715+0000","last_clean":"2023-12-08T20:55:05.415715+0000","last_became_active":"2023-12-08T20:55:04.512549+0000","last_became_peered":"2023-12-08T20:55:04.512549+0000","last_unstale":"2023-12-08T20:55:05.415715+0000","last_undegraded":"2023-12-08T20:55:05.415715+0000","last_fullsized":"2023-12-08T20:55:05.415715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:49:31.307794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508158+0000","last_change":"2023-12-08T20:54:56.261452+0000","last_active":"2023-12-08T20:55:04.508158+0000","last_peered":"2023-12-08T20:55:04.508158+0000","last_clean":"2023-12-08T20:55:04.508158+0000","last_became_active":"2023-12-08T20:54:56.260355+0000","last_became_peered":"2023-12-08T20:54:56.260355+0000","last_unstale":"2023-12-08T20:55:04.508158+0000","last_undegraded":"2023-12-08T20:55:04.508158+0000","last_fullsized":"2023-12-08T20:55:04.508158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:47:02.249125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503832+0000","last_change":"2023-12-08T20:54:54.926546+0000","last_active":"2023-12-08T20:55:04.503832+0000","last_peered":"2023-12-08T20:55:04.503832+0000","last_clean":"2023-12-08T20:55:04.503832+0000","last_became_active":"2023-12-08T20:54:54.925888+0000","last_became_peered":"2023-12-08T20:54:54.925888+0000","last_unstale":"2023-12-08T20:55:04.503832+0000","last_undegraded":"2023-12-08T20:55:04.503832+0000","last_fullsized":"2023-12-08T20:55:04.503832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:25:20.796728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.492624+0000","last_change":"2023-12-08T20:55:04.529041+0000","last_active":"2023-12-08T20:55:05.492624+0000","last_peered":"2023-12-08T20:55:05.492624+0000","last_clean":"2023-12-08T20:55:05.492624+0000","last_became_active":"2023-12-08T20:55:04.528640+0000","last_became_peered":"2023-12-08T20:55:04.528640+0000","last_unstale":"2023-12-08T20:55:05.492624+0000","last_undegraded":"2023-12-08T20:55:05.492624+0000","last_fullsized":"2023-12-08T20:55:05.492624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:18.653508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360612+0000","last_change":"2023-12-08T20:54:56.365339+0000","last_active":"2023-12-08T20:55:04.360612+0000","last_peered":"2023-12-08T20:55:04.360612+0000","last_clean":"2023-12-08T20:55:04.360612+0000","last_became_active":"2023-12-08T20:54:56.364597+0000","last_became_peered":"2023-12-08T20:54:56.364597+0000","last_unstale":"2023-12-08T20:55:04.360612+0000","last_undegraded":"2023-12-08T20:55:04.360612+0000","last_fullsized":"2023-12-08T20:55:04.360612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:17:58.931401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.509296+0000","last_change":"2023-12-08T20:54:54.928399+0000","last_active":"2023-12-08T20:55:04.509296+0000","last_peered":"2023-12-08T20:55:04.509296+0000","last_clean":"2023-12-08T20:55:04.509296+0000","last_became_active":"2023-12-08T20:54:54.927814+0000","last_became_peered":"2023-12-08T20:54:54.927814+0000","last_unstale":"2023-12-08T20:55:04.509296+0000","last_undegraded":"2023-12-08T20:55:04.509296+0000","last_fullsized":"2023-12-08T20:55:04.509296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:04:22.986992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491362+0000","last_change":"2023-12-08T20:55:04.523561+0000","last_active":"2023-12-08T20:55:05.491362+0000","last_peered":"2023-12-08T20:55:05.491362+0000","last_clean":"2023-12-08T20:55:05.491362+0000","last_became_active":"2023-12-08T20:55:04.522714+0000","last_became_peered":"2023-12-08T20:55:04.522714+0000","last_unstale":"2023-12-08T20:55:05.491362+0000","last_undegraded":"2023-12-08T20:55:05.491362+0000","last_fullsized":"2023-12-08T20:55:05.491362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:14.534456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360043+0000","last_change":"2023-12-08T20:54:56.331268+0000","last_active":"2023-12-08T20:55:04.360043+0000","last_peered":"2023-12-08T20:55:04.360043+0000","last_clean":"2023-12-08T20:55:04.360043+0000","last_became_active":"2023-12-08T20:54:56.330508+0000","last_became_peered":"2023-12-08T20:54:56.330508+0000","last_unstale":"2023-12-08T20:55:04.360043+0000","last_undegraded":"2023-12-08T20:55:04.360043+0000","last_fullsized":"2023-12-08T20:55:04.360043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:52.392589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.361147+0000","last_change":"2023-12-08T20:54:54.982136+0000","last_active":"2023-12-08T20:55:04.361147+0000","last_peered":"2023-12-08T20:55:04.361147+0000","last_clean":"2023-12-08T20:55:04.361147+0000","last_became_active":"2023-12-08T20:54:54.981168+0000","last_became_peered":"2023-12-08T20:54:54.981168+0000","last_unstale":"2023-12-08T20:55:04.361147+0000","last_undegraded":"2023-12-08T20:55:04.361147+0000","last_fullsized":"2023-12-08T20:55:04.361147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:13.841870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.556069+0000","last_change":"2023-12-08T20:55:04.513360+0000","last_active":"2023-12-08T20:55:05.556069+0000","last_peered":"2023-12-08T20:55:05.556069+0000","last_clean":"2023-12-08T20:55:05.556069+0000","last_became_active":"2023-12-08T20:55:04.511032+0000","last_became_peered":"2023-12-08T20:55:04.511032+0000","last_unstale":"2023-12-08T20:55:05.556069+0000","last_undegraded":"2023-12-08T20:55:05.556069+0000","last_fullsized":"2023-12-08T20:55:05.556069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:38:04.841172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.413307+0000","last_change":"2023-12-08T20:54:56.409829+0000","last_active":"2023-12-08T20:55:04.413307+0000","last_peered":"2023-12-08T20:55:04.413307+0000","last_clean":"2023-12-08T20:55:04.413307+0000","last_became_active":"2023-12-08T20:54:56.409291+0000","last_became_peered":"2023-12-08T20:54:56.409291+0000","last_unstale":"2023-12-08T20:55:04.413307+0000","last_undegraded":"2023-12-08T20:55:04.413307+0000","last_fullsized":"2023-12-08T20:55:04.413307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:06:37.234510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508973+0000","last_change":"2023-12-08T20:54:54.978750+0000","last_active":"2023-12-08T20:55:04.508973+0000","last_peered":"2023-12-08T20:55:04.508973+0000","last_clean":"2023-12-08T20:55:04.508973+0000","last_became_active":"2023-12-08T20:54:54.978416+0000","last_became_peered":"2023-12-08T20:54:54.978416+0000","last_unstale":"2023-12-08T20:55:04.508973+0000","last_undegraded":"2023-12-08T20:55:04.508973+0000","last_fullsized":"2023-12-08T20:55:04.508973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:00:08.584168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553308+0000","last_change":"2023-12-08T20:55:04.507859+0000","last_active":"2023-12-08T20:55:05.553308+0000","last_peered":"2023-12-08T20:55:05.553308+0000","last_clean":"2023-12-08T20:55:05.553308+0000","last_became_active":"2023-12-08T20:55:04.507454+0000","last_became_peered":"2023-12-08T20:55:04.507454+0000","last_unstale":"2023-12-08T20:55:05.553308+0000","last_undegraded":"2023-12-08T20:55:05.553308+0000","last_fullsized":"2023-12-08T20:55:05.553308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:56:57.279368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.498994+0000","last_change":"2023-12-08T20:54:56.372983+0000","last_active":"2023-12-08T20:55:04.498994+0000","last_peered":"2023-12-08T20:55:04.498994+0000","last_clean":"2023-12-08T20:55:04.498994+0000","last_became_active":"2023-12-08T20:54:56.369974+0000","last_became_peered":"2023-12-08T20:54:56.369974+0000","last_unstale":"2023-12-08T20:55:04.498994+0000","last_undegraded":"2023-12-08T20:55:04.498994+0000","last_fullsized":"2023-12-08T20:55:04.498994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.531685+0000","last_change":"2023-12-08T20:54:54.925560+0000","last_active":"2023-12-08T20:55:04.531685+0000","last_peered":"2023-12-08T20:55:04.531685+0000","last_clean":"2023-12-08T20:55:04.531685+0000","last_became_active":"2023-12-08T20:54:54.925022+0000","last_became_peered":"2023-12-08T20:54:54.925022+0000","last_unstale":"2023-12-08T20:55:04.531685+0000","last_undegraded":"2023-12-08T20:55:04.531685+0000","last_fullsized":"2023-12-08T20:55:04.531685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:10:52.902793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.552418+0000","last_change":"2023-12-08T20:55:04.531931+0000","last_active":"2023-12-08T20:55:05.552418+0000","last_peered":"2023-12-08T20:55:05.552418+0000","last_clean":"2023-12-08T20:55:05.552418+0000","last_became_active":"2023-12-08T20:55:04.530774+0000","last_became_peered":"2023-12-08T20:55:04.530774+0000","last_unstale":"2023-12-08T20:55:05.552418+0000","last_undegraded":"2023-12-08T20:55:05.552418+0000","last_fullsized":"2023-12-08T20:55:05.552418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:39:26.927665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503831+0000","last_change":"2023-12-08T20:54:56.391492+0000","last_active":"2023-12-08T20:55:04.503831+0000","last_peered":"2023-12-08T20:55:04.503831+0000","last_clean":"2023-12-08T20:55:04.503831+0000","last_became_active":"2023-12-08T20:54:56.385090+0000","last_became_peered":"2023-12-08T20:54:56.385090+0000","last_unstale":"2023-12-08T20:55:04.503831+0000","last_undegraded":"2023-12-08T20:55:04.503831+0000","last_fullsized":"2023-12-08T20:55:04.503831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:21:29.009005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508632+0000","last_change":"2023-12-08T20:54:54.932503+0000","last_active":"2023-12-08T20:55:04.508632+0000","last_peered":"2023-12-08T20:55:04.508632+0000","last_clean":"2023-12-08T20:55:04.508632+0000","last_became_active":"2023-12-08T20:54:54.932121+0000","last_became_peered":"2023-12-08T20:54:54.932121+0000","last_unstale":"2023-12-08T20:55:04.508632+0000","last_undegraded":"2023-12-08T20:55:04.508632+0000","last_fullsized":"2023-12-08T20:55:04.508632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:58.013744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553088+0000","last_change":"2023-12-08T20:55:04.529911+0000","last_active":"2023-12-08T20:55:05.553088+0000","last_peered":"2023-12-08T20:55:05.553088+0000","last_clean":"2023-12-08T20:55:05.553088+0000","last_became_active":"2023-12-08T20:55:04.528698+0000","last_became_peered":"2023-12-08T20:55:04.528698+0000","last_unstale":"2023-12-08T20:55:05.553088+0000","last_undegraded":"2023-12-08T20:55:05.553088+0000","last_fullsized":"2023-12-08T20:55:05.553088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:33:11.874876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.512905+0000","last_change":"2023-12-08T20:54:56.413886+0000","last_active":"2023-12-08T20:55:04.512905+0000","last_peered":"2023-12-08T20:55:04.512905+0000","last_clean":"2023-12-08T20:55:04.512905+0000","last_became_active":"2023-12-08T20:54:56.412786+0000","last_became_peered":"2023-12-08T20:54:56.412786+0000","last_unstale":"2023-12-08T20:55:04.512905+0000","last_undegraded":"2023-12-08T20:55:04.512905+0000","last_fullsized":"2023-12-08T20:55:04.512905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:39.331476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.305732+0000","last_change":"2023-12-08T20:54:54.922605+0000","last_active":"2023-12-08T20:55:04.305732+0000","last_peered":"2023-12-08T20:55:04.305732+0000","last_clean":"2023-12-08T20:55:04.305732+0000","last_became_active":"2023-12-08T20:54:54.922014+0000","last_became_peered":"2023-12-08T20:54:54.922014+0000","last_unstale":"2023-12-08T20:55:04.305732+0000","last_undegraded":"2023-12-08T20:55:04.305732+0000","last_fullsized":"2023-12-08T20:55:04.305732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:08:48.601596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.554232+0000","last_change":"2023-12-08T20:55:04.509438+0000","last_active":"2023-12-08T20:55:05.554232+0000","last_peered":"2023-12-08T20:55:05.554232+0000","last_clean":"2023-12-08T20:55:05.554232+0000","last_became_active":"2023-12-08T20:55:04.508219+0000","last_became_peered":"2023-12-08T20:55:04.508219+0000","last_unstale":"2023-12-08T20:55:05.554232+0000","last_undegraded":"2023-12-08T20:55:05.554232+0000","last_fullsized":"2023-12-08T20:55:05.554232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:16:31.758437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.406374+0000","last_change":"2023-12-08T20:54:56.370599+0000","last_active":"2023-12-08T20:55:04.406374+0000","last_peered":"2023-12-08T20:55:04.406374+0000","last_clean":"2023-12-08T20:55:04.406374+0000","last_became_active":"2023-12-08T20:54:56.370121+0000","last_became_peered":"2023-12-08T20:54:56.370121+0000","last_unstale":"2023-12-08T20:55:04.406374+0000","last_undegraded":"2023-12-08T20:55:04.406374+0000","last_fullsized":"2023-12-08T20:55:04.406374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:58:13.927241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507925+0000","last_change":"2023-12-08T20:54:54.927599+0000","last_active":"2023-12-08T20:55:04.507925+0000","last_peered":"2023-12-08T20:55:04.507925+0000","last_clean":"2023-12-08T20:55:04.507925+0000","last_became_active":"2023-12-08T20:54:54.927120+0000","last_became_peered":"2023-12-08T20:54:54.927120+0000","last_unstale":"2023-12-08T20:55:04.507925+0000","last_undegraded":"2023-12-08T20:55:04.507925+0000","last_fullsized":"2023-12-08T20:55:04.507925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:38.042201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.557221+0000","last_change":"2023-12-08T20:55:04.546945+0000","last_active":"2023-12-08T20:55:05.557221+0000","last_peered":"2023-12-08T20:55:05.557221+0000","last_clean":"2023-12-08T20:55:05.557221+0000","last_became_active":"2023-12-08T20:55:04.546439+0000","last_became_peered":"2023-12-08T20:55:04.546439+0000","last_unstale":"2023-12-08T20:55:05.557221+0000","last_undegraded":"2023-12-08T20:55:05.557221+0000","last_fullsized":"2023-12-08T20:55:05.557221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:30.484701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.361611+0000","last_change":"2023-12-08T20:54:56.372770+0000","last_active":"2023-12-08T20:55:04.361611+0000","last_peered":"2023-12-08T20:55:04.361611+0000","last_clean":"2023-12-08T20:55:04.361611+0000","last_became_active":"2023-12-08T20:54:56.372205+0000","last_became_peered":"2023-12-08T20:54:56.372205+0000","last_unstale":"2023-12-08T20:55:04.361611+0000","last_undegraded":"2023-12-08T20:55:04.361611+0000","last_fullsized":"2023-12-08T20:55:04.361611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:06.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508582+0000","last_change":"2023-12-08T20:54:54.929937+0000","last_active":"2023-12-08T20:55:04.508582+0000","last_peered":"2023-12-08T20:55:04.508582+0000","last_clean":"2023-12-08T20:55:04.508582+0000","last_became_active":"2023-12-08T20:54:54.929177+0000","last_became_peered":"2023-12-08T20:54:54.929177+0000","last_unstale":"2023-12-08T20:55:04.508582+0000","last_undegraded":"2023-12-08T20:55:04.508582+0000","last_fullsized":"2023-12-08T20:55:04.508582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:39:58.988364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.455933+0000","last_change":"2023-12-08T20:54:16.149485+0000","last_active":"2023-12-08T20:55:04.455933+0000","last_peered":"2023-12-08T20:55:04.455933+0000","last_clean":"2023-12-08T20:55:04.455933+0000","last_became_active":"2023-12-08T20:54:16.147507+0000","last_became_peered":"2023-12-08T20:54:16.147507+0000","last_unstale":"2023-12-08T20:55:04.455933+0000","last_undegraded":"2023-12-08T20:55:04.455933+0000","last_fullsized":"2023-12-08T20:55:04.455933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_clean_scrub_stamp":"2023-12-08T20:54:14.141045+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:17.484651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.451649+0000","last_change":"2023-12-08T20:55:04.515531+0000","last_active":"2023-12-08T20:55:05.451649+0000","last_peered":"2023-12-08T20:55:05.451649+0000","last_clean":"2023-12-08T20:55:05.451649+0000","last_became_active":"2023-12-08T20:55:04.515200+0000","last_became_peered":"2023-12-08T20:55:04.515200+0000","last_unstale":"2023-12-08T20:55:05.451649+0000","last_undegraded":"2023-12-08T20:55:05.451649+0000","last_fullsized":"2023-12-08T20:55:05.451649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:00:08.085700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508800+0000","last_change":"2023-12-08T20:54:56.318724+0000","last_active":"2023-12-08T20:55:04.508800+0000","last_peered":"2023-12-08T20:55:04.508800+0000","last_clean":"2023-12-08T20:55:04.508800+0000","last_became_active":"2023-12-08T20:54:56.318408+0000","last_became_peered":"2023-12-08T20:54:56.318408+0000","last_unstale":"2023-12-08T20:55:04.508800+0000","last_undegraded":"2023-12-08T20:55:04.508800+0000","last_fullsized":"2023-12-08T20:55:04.508800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:14:20.217847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.413648+0000","last_change":"2023-12-08T20:54:54.926031+0000","last_active":"2023-12-08T20:55:04.413648+0000","last_peered":"2023-12-08T20:55:04.413648+0000","last_clean":"2023-12-08T20:55:04.413648+0000","last_became_active":"2023-12-08T20:54:54.925610+0000","last_became_peered":"2023-12-08T20:54:54.925610+0000","last_unstale":"2023-12-08T20:55:04.413648+0000","last_undegraded":"2023-12-08T20:55:04.413648+0000","last_fullsized":"2023-12-08T20:55:04.413648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:05:08.857673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491648+0000","last_change":"2023-12-08T20:55:04.523264+0000","last_active":"2023-12-08T20:55:05.491648+0000","last_peered":"2023-12-08T20:55:05.491648+0000","last_clean":"2023-12-08T20:55:05.491648+0000","last_became_active":"2023-12-08T20:55:04.522245+0000","last_became_peered":"2023-12-08T20:55:04.522245+0000","last_unstale":"2023-12-08T20:55:05.491648+0000","last_undegraded":"2023-12-08T20:55:05.491648+0000","last_fullsized":"2023-12-08T20:55:05.491648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:23.322536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.505093+0000","last_change":"2023-12-08T20:54:56.378291+0000","last_active":"2023-12-08T20:55:04.505093+0000","last_peered":"2023-12-08T20:55:04.505093+0000","last_clean":"2023-12-08T20:55:04.505093+0000","last_became_active":"2023-12-08T20:54:56.377762+0000","last_became_peered":"2023-12-08T20:54:56.377762+0000","last_unstale":"2023-12-08T20:55:04.505093+0000","last_undegraded":"2023-12-08T20:55:04.505093+0000","last_fullsized":"2023-12-08T20:55:04.505093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:11:11.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540684+0000","last_change":"2023-12-08T20:54:54.936008+0000","last_active":"2023-12-08T20:55:04.540684+0000","last_peered":"2023-12-08T20:55:04.540684+0000","last_clean":"2023-12-08T20:55:04.540684+0000","last_became_active":"2023-12-08T20:54:54.935472+0000","last_became_peered":"2023-12-08T20:54:54.935472+0000","last_unstale":"2023-12-08T20:55:04.540684+0000","last_undegraded":"2023-12-08T20:55:04.540684+0000","last_fullsized":"2023-12-08T20:55:04.540684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:11:02.460764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.557220+0000","last_change":"2023-12-08T20:55:04.534674+0000","last_active":"2023-12-08T20:55:05.557220+0000","last_peered":"2023-12-08T20:55:05.557220+0000","last_clean":"2023-12-08T20:55:05.557220+0000","last_became_active":"2023-12-08T20:55:04.533305+0000","last_became_peered":"2023-12-08T20:55:04.533305+0000","last_unstale":"2023-12-08T20:55:05.557220+0000","last_undegraded":"2023-12-08T20:55:05.557220+0000","last_fullsized":"2023-12-08T20:55:05.557220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:18.790378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504316+0000","last_change":"2023-12-08T20:54:56.380702+0000","last_active":"2023-12-08T20:55:04.504316+0000","last_peered":"2023-12-08T20:55:04.504316+0000","last_clean":"2023-12-08T20:55:04.504316+0000","last_became_active":"2023-12-08T20:54:56.379933+0000","last_became_peered":"2023-12-08T20:54:56.379933+0000","last_unstale":"2023-12-08T20:55:04.504316+0000","last_undegraded":"2023-12-08T20:55:04.504316+0000","last_fullsized":"2023-12-08T20:55:04.504316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:31:18.872161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360865+0000","last_change":"2023-12-08T20:54:54.983221+0000","last_active":"2023-12-08T20:55:04.360865+0000","last_peered":"2023-12-08T20:55:04.360865+0000","last_clean":"2023-12-08T20:55:04.360865+0000","last_became_active":"2023-12-08T20:54:54.982414+0000","last_became_peered":"2023-12-08T20:54:54.982414+0000","last_unstale":"2023-12-08T20:55:04.360865+0000","last_undegraded":"2023-12-08T20:55:04.360865+0000","last_fullsized":"2023-12-08T20:55:04.360865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:36:42.874558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.449898+0000","last_change":"2023-12-08T20:55:04.515310+0000","last_active":"2023-12-08T20:55:05.449898+0000","last_peered":"2023-12-08T20:55:05.449898+0000","last_clean":"2023-12-08T20:55:05.449898+0000","last_became_active":"2023-12-08T20:55:04.514907+0000","last_became_peered":"2023-12-08T20:55:04.514907+0000","last_unstale":"2023-12-08T20:55:05.449898+0000","last_undegraded":"2023-12-08T20:55:05.449898+0000","last_fullsized":"2023-12-08T20:55:05.449898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:26:19.536478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499717+0000","last_change":"2023-12-08T20:54:56.378176+0000","last_active":"2023-12-08T20:55:04.499717+0000","last_peered":"2023-12-08T20:55:04.499717+0000","last_clean":"2023-12-08T20:55:04.499717+0000","last_became_active":"2023-12-08T20:54:56.377430+0000","last_became_peered":"2023-12-08T20:54:56.377430+0000","last_unstale":"2023-12-08T20:55:04.499717+0000","last_undegraded":"2023-12-08T20:55:04.499717+0000","last_fullsized":"2023-12-08T20:55:04.499717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504536+0000","last_change":"2023-12-08T20:54:54.926769+0000","last_active":"2023-12-08T20:55:04.504536+0000","last_peered":"2023-12-08T20:55:04.504536+0000","last_clean":"2023-12-08T20:55:04.504536+0000","last_became_active":"2023-12-08T20:54:54.926386+0000","last_became_peered":"2023-12-08T20:54:54.926386+0000","last_unstale":"2023-12-08T20:55:04.504536+0000","last_undegraded":"2023-12-08T20:55:04.504536+0000","last_fullsized":"2023-12-08T20:55:04.504536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:05.933965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553168+0000","last_change":"2023-12-08T20:55:04.523709+0000","last_active":"2023-12-08T20:55:05.553168+0000","last_peered":"2023-12-08T20:55:05.553168+0000","last_clean":"2023-12-08T20:55:05.553168+0000","last_became_active":"2023-12-08T20:55:04.523074+0000","last_became_peered":"2023-12-08T20:55:04.523074+0000","last_unstale":"2023-12-08T20:55:05.553168+0000","last_undegraded":"2023-12-08T20:55:05.553168+0000","last_fullsized":"2023-12-08T20:55:05.553168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508063+0000","last_change":"2023-12-08T20:54:56.373188+0000","last_active":"2023-12-08T20:55:04.508063+0000","last_peered":"2023-12-08T20:55:04.508063+0000","last_clean":"2023-12-08T20:55:04.508063+0000","last_became_active":"2023-12-08T20:54:56.371132+0000","last_became_peered":"2023-12-08T20:54:56.371132+0000","last_unstale":"2023-12-08T20:55:04.508063+0000","last_undegraded":"2023-12-08T20:55:04.508063+0000","last_fullsized":"2023-12-08T20:55:04.508063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:30:06.387412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360789+0000","last_change":"2023-12-08T20:54:54.985432+0000","last_active":"2023-12-08T20:55:04.360789+0000","last_peered":"2023-12-08T20:55:04.360789+0000","last_clean":"2023-12-08T20:55:04.360789+0000","last_became_active":"2023-12-08T20:54:54.984661+0000","last_became_peered":"2023-12-08T20:54:54.984661+0000","last_unstale":"2023-12-08T20:55:04.360789+0000","last_undegraded":"2023-12-08T20:55:04.360789+0000","last_fullsized":"2023-12-08T20:55:04.360789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:16:34.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.558071+0000","last_change":"2023-12-08T20:55:04.543349+0000","last_active":"2023-12-08T20:55:05.558071+0000","last_peered":"2023-12-08T20:55:05.558071+0000","last_clean":"2023-12-08T20:55:05.558071+0000","last_became_active":"2023-12-08T20:55:04.541074+0000","last_became_peered":"2023-12-08T20:55:04.541074+0000","last_unstale":"2023-12-08T20:55:05.558071+0000","last_undegraded":"2023-12-08T20:55:05.558071+0000","last_fullsized":"2023-12-08T20:55:05.558071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:35.399668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.455813+0000","last_change":"2023-12-08T20:54:56.413772+0000","last_active":"2023-12-08T20:55:04.455813+0000","last_peered":"2023-12-08T20:55:04.455813+0000","last_clean":"2023-12-08T20:55:04.455813+0000","last_became_active":"2023-12-08T20:54:56.413023+0000","last_became_peered":"2023-12-08T20:54:56.413023+0000","last_unstale":"2023-12-08T20:55:04.455813+0000","last_undegraded":"2023-12-08T20:55:04.455813+0000","last_fullsized":"2023-12-08T20:55:04.455813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504120+0000","last_change":"2023-12-08T20:54:54.929238+0000","last_active":"2023-12-08T20:55:04.504120+0000","last_peered":"2023-12-08T20:55:04.504120+0000","last_clean":"2023-12-08T20:55:04.504120+0000","last_became_active":"2023-12-08T20:54:54.928543+0000","last_became_peered":"2023-12-08T20:54:54.928543+0000","last_unstale":"2023-12-08T20:55:04.504120+0000","last_undegraded":"2023-12-08T20:55:04.504120+0000","last_fullsized":"2023-12-08T20:55:04.504120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:04.997415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.557550+0000","last_change":"2023-12-08T20:55:04.540347+0000","last_active":"2023-12-08T20:55:05.557550+0000","last_peered":"2023-12-08T20:55:05.557550+0000","last_clean":"2023-12-08T20:55:05.557550+0000","last_became_active":"2023-12-08T20:55:04.535002+0000","last_became_peered":"2023-12-08T20:55:04.535002+0000","last_unstale":"2023-12-08T20:55:05.557550+0000","last_undegraded":"2023-12-08T20:55:05.557550+0000","last_fullsized":"2023-12-08T20:55:05.557550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:09.576246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508370+0000","last_change":"2023-12-08T20:54:56.394016+0000","last_active":"2023-12-08T20:55:04.508370+0000","last_peered":"2023-12-08T20:55:04.508370+0000","last_clean":"2023-12-08T20:55:04.508370+0000","last_became_active":"2023-12-08T20:54:56.393187+0000","last_became_peered":"2023-12-08T20:54:56.393187+0000","last_unstale":"2023-12-08T20:55:04.508370+0000","last_undegraded":"2023-12-08T20:55:04.508370+0000","last_fullsized":"2023-12-08T20:55:04.508370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:20:56.762499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508542+0000","last_change":"2023-12-08T20:54:54.930839+0000","last_active":"2023-12-08T20:55:04.508542+0000","last_peered":"2023-12-08T20:55:04.508542+0000","last_clean":"2023-12-08T20:55:04.508542+0000","last_became_active":"2023-12-08T20:54:54.928065+0000","last_became_peered":"2023-12-08T20:54:54.928065+0000","last_unstale":"2023-12-08T20:55:04.508542+0000","last_undegraded":"2023-12-08T20:55:04.508542+0000","last_fullsized":"2023-12-08T20:55:04.508542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:28.708543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.552940+0000","last_change":"2023-12-08T20:55:04.520698+0000","last_active":"2023-12-08T20:55:05.552940+0000","last_peered":"2023-12-08T20:55:05.552940+0000","last_clean":"2023-12-08T20:55:05.552940+0000","last_became_active":"2023-12-08T20:55:04.516783+0000","last_became_peered":"2023-12-08T20:55:04.516783+0000","last_unstale":"2023-12-08T20:55:05.552940+0000","last_undegraded":"2023-12-08T20:55:05.552940+0000","last_fullsized":"2023-12-08T20:55:05.552940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:46:00.331700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.407130+0000","last_change":"2023-12-08T20:54:56.331045+0000","last_active":"2023-12-08T20:55:04.407130+0000","last_peered":"2023-12-08T20:55:04.407130+0000","last_clean":"2023-12-08T20:55:04.407130+0000","last_became_active":"2023-12-08T20:54:56.330346+0000","last_became_peered":"2023-12-08T20:54:56.330346+0000","last_unstale":"2023-12-08T20:55:04.407130+0000","last_undegraded":"2023-12-08T20:55:04.407130+0000","last_fullsized":"2023-12-08T20:55:04.407130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:43:36.950589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.306013+0000","last_change":"2023-12-08T20:54:54.927094+0000","last_active":"2023-12-08T20:55:04.306013+0000","last_peered":"2023-12-08T20:55:04.306013+0000","last_clean":"2023-12-08T20:55:04.306013+0000","last_became_active":"2023-12-08T20:54:54.926435+0000","last_became_peered":"2023-12-08T20:54:54.926435+0000","last_unstale":"2023-12-08T20:55:04.306013+0000","last_undegraded":"2023-12-08T20:55:04.306013+0000","last_fullsized":"2023-12-08T20:55:04.306013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.450954+0000","last_change":"2023-12-08T20:55:04.534630+0000","last_active":"2023-12-08T20:55:05.450954+0000","last_peered":"2023-12-08T20:55:05.450954+0000","last_clean":"2023-12-08T20:55:05.450954+0000","last_became_active":"2023-12-08T20:55:04.534289+0000","last_became_peered":"2023-12-08T20:55:04.534289+0000","last_unstale":"2023-12-08T20:55:05.450954+0000","last_undegraded":"2023-12-08T20:55:05.450954+0000","last_fullsized":"2023-12-08T20:55:05.450954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:36:33.771845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504120+0000","last_change":"2023-12-08T20:54:56.376691+0000","last_active":"2023-12-08T20:55:04.504120+0000","last_peered":"2023-12-08T20:55:04.504120+0000","last_clean":"2023-12-08T20:55:04.504120+0000","last_became_active":"2023-12-08T20:54:56.375922+0000","last_became_peered":"2023-12-08T20:54:56.375922+0000","last_unstale":"2023-12-08T20:55:04.504120+0000","last_undegraded":"2023-12-08T20:55:04.504120+0000","last_fullsized":"2023-12-08T20:55:04.504120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:37:56.593406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'10","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:15.154004+0000","last_change":"2023-12-08T20:54:54.978427+0000","last_active":"2023-12-08T20:55:15.154004+0000","last_peered":"2023-12-08T20:55:15.154004+0000","last_clean":"2023-12-08T20:55:15.154004+0000","last_became_active":"2023-12-08T20:54:54.977999+0000","last_became_peered":"2023-12-08T20:54:54.977999+0000","last_unstale":"2023-12-08T20:55:15.154004+0000","last_undegraded":"2023-12-08T20:55:15.154004+0000","last_fullsized":"2023-12-08T20:55:15.154004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.554268+0000","last_change":"2023-12-08T20:55:04.522691+0000","last_active":"2023-12-08T20:55:05.554268+0000","last_peered":"2023-12-08T20:55:05.554268+0000","last_clean":"2023-12-08T20:55:05.554268+0000","last_became_active":"2023-12-08T20:55:04.522190+0000","last_became_peered":"2023-12-08T20:55:04.522190+0000","last_unstale":"2023-12-08T20:55:05.554268+0000","last_undegraded":"2023-12-08T20:55:05.554268+0000","last_fullsized":"2023-12-08T20:55:05.554268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:52.945031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508584+0000","last_change":"2023-12-08T20:54:56.384439+0000","last_active":"2023-12-08T20:55:04.508584+0000","last_peered":"2023-12-08T20:55:04.508584+0000","last_clean":"2023-12-08T20:55:04.508584+0000","last_became_active":"2023-12-08T20:54:56.383561+0000","last_became_peered":"2023-12-08T20:54:56.383561+0000","last_unstale":"2023-12-08T20:55:04.508584+0000","last_undegraded":"2023-12-08T20:55:04.508584+0000","last_fullsized":"2023-12-08T20:55:04.508584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:01.328480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.307220+0000","last_change":"2023-12-08T20:54:54.980625+0000","last_active":"2023-12-08T20:55:04.307220+0000","last_peered":"2023-12-08T20:55:04.307220+0000","last_clean":"2023-12-08T20:55:04.307220+0000","last_became_active":"2023-12-08T20:54:54.980023+0000","last_became_peered":"2023-12-08T20:54:54.980023+0000","last_unstale":"2023-12-08T20:55:04.307220+0000","last_undegraded":"2023-12-08T20:55:04.307220+0000","last_fullsized":"2023-12-08T20:55:04.307220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:44:27.401600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.492065+0000","last_change":"2023-12-08T20:55:04.523658+0000","last_active":"2023-12-08T20:55:05.492065+0000","last_peered":"2023-12-08T20:55:05.492065+0000","last_clean":"2023-12-08T20:55:05.492065+0000","last_became_active":"2023-12-08T20:55:04.522325+0000","last_became_peered":"2023-12-08T20:55:04.522325+0000","last_unstale":"2023-12-08T20:55:05.492065+0000","last_undegraded":"2023-12-08T20:55:05.492065+0000","last_fullsized":"2023-12-08T20:55:05.492065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:32:03.125815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540898+0000","last_change":"2023-12-08T20:54:56.410075+0000","last_active":"2023-12-08T20:55:04.540898+0000","last_peered":"2023-12-08T20:55:04.540898+0000","last_clean":"2023-12-08T20:55:04.540898+0000","last_became_active":"2023-12-08T20:54:56.409539+0000","last_became_peered":"2023-12-08T20:54:56.409539+0000","last_unstale":"2023-12-08T20:55:04.540898+0000","last_undegraded":"2023-12-08T20:55:04.540898+0000","last_fullsized":"2023-12-08T20:55:04.540898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:37:03.173965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504113+0000","last_change":"2023-12-08T20:54:54.936311+0000","last_active":"2023-12-08T20:55:04.504113+0000","last_peered":"2023-12-08T20:55:04.504113+0000","last_clean":"2023-12-08T20:55:04.504113+0000","last_became_active":"2023-12-08T20:54:54.935889+0000","last_became_peered":"2023-12-08T20:54:54.935889+0000","last_unstale":"2023-12-08T20:55:04.504113+0000","last_undegraded":"2023-12-08T20:55:04.504113+0000","last_fullsized":"2023-12-08T20:55:04.504113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:13.785495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.414801+0000","last_change":"2023-12-08T20:55:04.519274+0000","last_active":"2023-12-08T20:55:05.414801+0000","last_peered":"2023-12-08T20:55:05.414801+0000","last_clean":"2023-12-08T20:55:05.414801+0000","last_became_active":"2023-12-08T20:55:04.518048+0000","last_became_peered":"2023-12-08T20:55:04.518048+0000","last_unstale":"2023-12-08T20:55:05.414801+0000","last_undegraded":"2023-12-08T20:55:05.414801+0000","last_fullsized":"2023-12-08T20:55:05.414801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:36:52.411600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499617+0000","last_change":"2023-12-08T20:54:56.376709+0000","last_active":"2023-12-08T20:55:04.499617+0000","last_peered":"2023-12-08T20:55:04.499617+0000","last_clean":"2023-12-08T20:55:04.499617+0000","last_became_active":"2023-12-08T20:54:56.369709+0000","last_became_peered":"2023-12-08T20:54:56.369709+0000","last_unstale":"2023-12-08T20:55:04.499617+0000","last_undegraded":"2023-12-08T20:55:04.499617+0000","last_fullsized":"2023-12-08T20:55:04.499617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456242+0000","last_change":"2023-12-08T20:54:54.980040+0000","last_active":"2023-12-08T20:55:04.456242+0000","last_peered":"2023-12-08T20:55:04.456242+0000","last_clean":"2023-12-08T20:55:04.456242+0000","last_became_active":"2023-12-08T20:54:54.979751+0000","last_became_peered":"2023-12-08T20:54:54.979751+0000","last_unstale":"2023-12-08T20:55:04.456242+0000","last_undegraded":"2023-12-08T20:55:04.456242+0000","last_fullsized":"2023-12-08T20:55:04.456242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:08.789175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553699+0000","last_change":"2023-12-08T20:55:04.513429+0000","last_active":"2023-12-08T20:55:05.553699+0000","last_peered":"2023-12-08T20:55:05.553699+0000","last_clean":"2023-12-08T20:55:05.553699+0000","last_became_active":"2023-12-08T20:55:04.511405+0000","last_became_peered":"2023-12-08T20:55:04.511405+0000","last_unstale":"2023-12-08T20:55:05.553699+0000","last_undegraded":"2023-12-08T20:55:05.553699+0000","last_fullsized":"2023-12-08T20:55:05.553699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:48:08.081679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553779+0000","last_change":"2023-12-08T20:55:04.537067+0000","last_active":"2023-12-08T20:55:05.553779+0000","last_peered":"2023-12-08T20:55:05.553779+0000","last_clean":"2023-12-08T20:55:05.553779+0000","last_became_active":"2023-12-08T20:55:04.536497+0000","last_became_peered":"2023-12-08T20:55:04.536497+0000","last_unstale":"2023-12-08T20:55:05.553779+0000","last_undegraded":"2023-12-08T20:55:05.553779+0000","last_fullsized":"2023-12-08T20:55:05.553779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:49.322641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360960+0000","last_change":"2023-12-08T20:54:56.318249+0000","last_active":"2023-12-08T20:55:04.360960+0000","last_peered":"2023-12-08T20:55:04.360960+0000","last_clean":"2023-12-08T20:55:04.360960+0000","last_became_active":"2023-12-08T20:54:56.317895+0000","last_became_peered":"2023-12-08T20:54:56.317895+0000","last_unstale":"2023-12-08T20:55:04.360960+0000","last_undegraded":"2023-12-08T20:55:04.360960+0000","last_fullsized":"2023-12-08T20:55:04.360960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:47:45.185235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507838+0000","last_change":"2023-12-08T20:54:54.935924+0000","last_active":"2023-12-08T20:55:04.507838+0000","last_peered":"2023-12-08T20:55:04.507838+0000","last_clean":"2023-12-08T20:55:04.507838+0000","last_became_active":"2023-12-08T20:54:54.935578+0000","last_became_peered":"2023-12-08T20:54:54.935578+0000","last_unstale":"2023-12-08T20:55:04.507838+0000","last_undegraded":"2023-12-08T20:55:04.507838+0000","last_fullsized":"2023-12-08T20:55:04.507838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:22.627774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.451614+0000","last_change":"2023-12-08T20:55:04.535940+0000","last_active":"2023-12-08T20:55:05.451614+0000","last_peered":"2023-12-08T20:55:05.451614+0000","last_clean":"2023-12-08T20:55:05.451614+0000","last_became_active":"2023-12-08T20:55:04.535525+0000","last_became_peered":"2023-12-08T20:55:04.535525+0000","last_unstale":"2023-12-08T20:55:05.451614+0000","last_undegraded":"2023-12-08T20:55:05.451614+0000","last_fullsized":"2023-12-08T20:55:05.451614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:30:14.451021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.513649+0000","last_change":"2023-12-08T20:54:56.413484+0000","last_active":"2023-12-08T20:55:04.513649+0000","last_peered":"2023-12-08T20:55:04.513649+0000","last_clean":"2023-12-08T20:55:04.513649+0000","last_became_active":"2023-12-08T20:54:56.412133+0000","last_became_peered":"2023-12-08T20:54:56.412133+0000","last_unstale":"2023-12-08T20:55:04.513649+0000","last_undegraded":"2023-12-08T20:55:04.513649+0000","last_fullsized":"2023-12-08T20:55:04.513649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:41:41.172811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.406565+0000","last_change":"2023-12-08T20:54:54.927237+0000","last_active":"2023-12-08T20:55:04.406565+0000","last_peered":"2023-12-08T20:55:04.406565+0000","last_clean":"2023-12-08T20:55:04.406565+0000","last_became_active":"2023-12-08T20:54:54.926804+0000","last_became_peered":"2023-12-08T20:54:54.926804+0000","last_unstale":"2023-12-08T20:55:04.406565+0000","last_undegraded":"2023-12-08T20:55:04.406565+0000","last_fullsized":"2023-12-08T20:55:04.406565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:30:21.341630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508451+0000","last_change":"2023-12-08T20:54:54.931212+0000","last_active":"2023-12-08T20:55:04.508451+0000","last_peered":"2023-12-08T20:55:04.508451+0000","last_clean":"2023-12-08T20:55:04.508451+0000","last_became_active":"2023-12-08T20:54:54.930324+0000","last_became_peered":"2023-12-08T20:54:54.930324+0000","last_unstale":"2023-12-08T20:55:04.508451+0000","last_undegraded":"2023-12-08T20:55:04.508451+0000","last_fullsized":"2023-12-08T20:55:04.508451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:54.461219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360041+0000","last_change":"2023-12-08T20:54:56.383879+0000","last_active":"2023-12-08T20:55:04.360041+0000","last_peered":"2023-12-08T20:55:04.360041+0000","last_clean":"2023-12-08T20:55:04.360041+0000","last_became_active":"2023-12-08T20:54:56.383467+0000","last_became_peered":"2023-12-08T20:54:56.383467+0000","last_unstale":"2023-12-08T20:55:04.360041+0000","last_undegraded":"2023-12-08T20:55:04.360041+0000","last_fullsized":"2023-12-08T20:55:04.360041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:59.236467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553946+0000","last_change":"2023-12-08T20:55:04.541743+0000","last_active":"2023-12-08T20:55:05.553946+0000","last_peered":"2023-12-08T20:55:05.553946+0000","last_clean":"2023-12-08T20:55:05.553946+0000","last_became_active":"2023-12-08T20:55:04.536537+0000","last_became_peered":"2023-12-08T20:55:04.536537+0000","last_unstale":"2023-12-08T20:55:05.553946+0000","last_undegraded":"2023-12-08T20:55:05.553946+0000","last_fullsized":"2023-12-08T20:55:05.553946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:45.443252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.532310+0000","last_change":"2023-12-08T20:54:54.925711+0000","last_active":"2023-12-08T20:55:04.532310+0000","last_peered":"2023-12-08T20:55:04.532310+0000","last_clean":"2023-12-08T20:55:04.532310+0000","last_became_active":"2023-12-08T20:54:54.925229+0000","last_became_peered":"2023-12-08T20:54:54.925229+0000","last_unstale":"2023-12-08T20:55:04.532310+0000","last_undegraded":"2023-12-08T20:55:04.532310+0000","last_fullsized":"2023-12-08T20:55:04.532310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:33:15.472131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456015+0000","last_change":"2023-12-08T20:54:56.404755+0000","last_active":"2023-12-08T20:55:04.456015+0000","last_peered":"2023-12-08T20:55:04.456015+0000","last_clean":"2023-12-08T20:55:04.456015+0000","last_became_active":"2023-12-08T20:54:56.403996+0000","last_became_peered":"2023-12-08T20:54:56.403996+0000","last_unstale":"2023-12-08T20:55:04.456015+0000","last_undegraded":"2023-12-08T20:55:04.456015+0000","last_fullsized":"2023-12-08T20:55:04.456015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.416387+0000","last_change":"2023-12-08T20:55:04.523477+0000","last_active":"2023-12-08T20:55:05.416387+0000","last_peered":"2023-12-08T20:55:05.416387+0000","last_clean":"2023-12-08T20:55:05.416387+0000","last_became_active":"2023-12-08T20:55:04.523137+0000","last_became_peered":"2023-12-08T20:55:04.523137+0000","last_unstale":"2023-12-08T20:55:05.416387+0000","last_undegraded":"2023-12-08T20:55:05.416387+0000","last_fullsized":"2023-12-08T20:55:05.416387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499296+0000","last_change":"2023-12-08T20:54:56.379055+0000","last_active":"2023-12-08T20:55:04.499296+0000","last_peered":"2023-12-08T20:55:04.499296+0000","last_clean":"2023-12-08T20:55:04.499296+0000","last_became_active":"2023-12-08T20:54:56.373080+0000","last_became_peered":"2023-12-08T20:54:56.373080+0000","last_unstale":"2023-12-08T20:55:04.499296+0000","last_undegraded":"2023-12-08T20:55:04.499296+0000","last_fullsized":"2023-12-08T20:55:04.499296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.305471+0000","last_change":"2023-12-08T20:54:56.378688+0000","last_active":"2023-12-08T20:55:04.305471+0000","last_peered":"2023-12-08T20:55:04.305471+0000","last_clean":"2023-12-08T20:55:04.305471+0000","last_became_active":"2023-12-08T20:54:56.378154+0000","last_became_peered":"2023-12-08T20:54:56.378154+0000","last_unstale":"2023-12-08T20:55:04.305471+0000","last_undegraded":"2023-12-08T20:55:04.305471+0000","last_fullsized":"2023-12-08T20:55:04.305471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:22:06.625769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508260+0000","last_change":"2023-12-08T20:54:56.410526+0000","last_active":"2023-12-08T20:55:04.508260+0000","last_peered":"2023-12-08T20:55:04.508260+0000","last_clean":"2023-12-08T20:55:04.508260+0000","last_became_active":"2023-12-08T20:54:56.409863+0000","last_became_peered":"2023-12-08T20:54:56.409863+0000","last_unstale":"2023-12-08T20:55:04.508260+0000","last_undegraded":"2023-12-08T20:55:04.508260+0000","last_fullsized":"2023-12-08T20:55:04.508260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:10.542611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.525819+0000","last_change":"2023-12-08T20:54:56.408750+0000","last_active":"2023-12-08T20:55:04.525819+0000","last_peered":"2023-12-08T20:55:04.525819+0000","last_clean":"2023-12-08T20:55:04.525819+0000","last_became_active":"2023-12-08T20:54:56.408205+0000","last_became_peered":"2023-12-08T20:54:56.408205+0000","last_unstale":"2023-12-08T20:55:04.525819+0000","last_undegraded":"2023-12-08T20:55:04.525819+0000","last_fullsized":"2023-12-08T20:55:04.525819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:55.750494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.413106+0000","last_change":"2023-12-08T20:54:56.386660+0000","last_active":"2023-12-08T20:55:04.413106+0000","last_peered":"2023-12-08T20:55:04.413106+0000","last_clean":"2023-12-08T20:55:04.413106+0000","last_became_active":"2023-12-08T20:54:56.386344+0000","last_became_peered":"2023-12-08T20:54:56.386344+0000","last_unstale":"2023-12-08T20:55:04.413106+0000","last_undegraded":"2023-12-08T20:55:04.413106+0000","last_fullsized":"2023-12-08T20:55:04.413106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:33:27.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.408612+0000","last_change":"2023-12-08T20:54:56.367640+0000","last_active":"2023-12-08T20:55:04.408612+0000","last_peered":"2023-12-08T20:55:04.408612+0000","last_clean":"2023-12-08T20:55:04.408612+0000","last_became_active":"2023-12-08T20:54:56.366967+0000","last_became_peered":"2023-12-08T20:54:56.366967+0000","last_unstale":"2023-12-08T20:55:04.408612+0000","last_undegraded":"2023-12-08T20:55:04.408612+0000","last_fullsized":"2023-12-08T20:55:04.408612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:22:24.171129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499446+0000","last_change":"2023-12-08T20:54:56.376663+0000","last_active":"2023-12-08T20:55:04.499446+0000","last_peered":"2023-12-08T20:55:04.499446+0000","last_clean":"2023-12-08T20:55:04.499446+0000","last_became_active":"2023-12-08T20:54:56.371954+0000","last_became_peered":"2023-12-08T20:54:56.371954+0000","last_unstale":"2023-12-08T20:55:04.499446+0000","last_undegraded":"2023-12-08T20:55:04.499446+0000","last_fullsized":"2023-12-08T20:55:04.499446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540616+0000","last_change":"2023-12-08T20:54:56.410398+0000","last_active":"2023-12-08T20:55:04.540616+0000","last_peered":"2023-12-08T20:55:04.540616+0000","last_clean":"2023-12-08T20:55:04.540616+0000","last_became_active":"2023-12-08T20:54:56.409462+0000","last_became_peered":"2023-12-08T20:54:56.409462+0000","last_unstale":"2023-12-08T20:55:04.540616+0000","last_undegraded":"2023-12-08T20:55:04.540616+0000","last_fullsized":"2023-12-08T20:55:04.540616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:07:04.340773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507752+0000","last_change":"2023-12-08T20:54:56.415800+0000","last_active":"2023-12-08T20:55:04.507752+0000","last_peered":"2023-12-08T20:55:04.507752+0000","last_clean":"2023-12-08T20:55:04.507752+0000","last_became_active":"2023-12-08T20:54:56.415176+0000","last_became_peered":"2023-12-08T20:54:56.415176+0000","last_unstale":"2023-12-08T20:55:04.507752+0000","last_undegraded":"2023-12-08T20:55:04.507752+0000","last_fullsized":"2023-12-08T20:55:04.507752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:24:27.173941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.524613+0000","last_change":"2023-12-08T20:54:56.401521+0000","last_active":"2023-12-08T20:55:04.524613+0000","last_peered":"2023-12-08T20:55:04.524613+0000","last_clean":"2023-12-08T20:55:04.524613+0000","last_became_active":"2023-12-08T20:54:56.400980+0000","last_became_peered":"2023-12-08T20:54:56.400980+0000","last_unstale":"2023-12-08T20:55:04.524613+0000","last_undegraded":"2023-12-08T20:55:04.524613+0000","last_fullsized":"2023-12-08T20:55:04.524613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:42.093754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.455672+0000","last_change":"2023-12-08T20:54:56.387218+0000","last_active":"2023-12-08T20:55:04.455672+0000","last_peered":"2023-12-08T20:55:04.455672+0000","last_clean":"2023-12-08T20:55:04.455672+0000","last_became_active":"2023-12-08T20:54:56.386413+0000","last_became_peered":"2023-12-08T20:54:56.386413+0000","last_unstale":"2023-12-08T20:55:04.455672+0000","last_undegraded":"2023-12-08T20:55:04.455672+0000","last_fullsized":"2023-12-08T20:55:04.455672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.359808+0000","last_change":"2023-12-08T20:54:56.371962+0000","last_active":"2023-12-08T20:55:04.359808+0000","last_peered":"2023-12-08T20:55:04.359808+0000","last_clean":"2023-12-08T20:55:04.359808+0000","last_became_active":"2023-12-08T20:54:56.371456+0000","last_became_peered":"2023-12-08T20:54:56.371456+0000","last_unstale":"2023-12-08T20:55:04.359808+0000","last_undegraded":"2023-12-08T20:55:04.359808+0000","last_fullsized":"2023-12-08T20:55:04.359808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:01.725223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.505002+0000","last_change":"2023-12-08T20:54:56.381311+0000","last_active":"2023-12-08T20:55:04.505002+0000","last_peered":"2023-12-08T20:55:04.505002+0000","last_clean":"2023-12-08T20:55:04.505002+0000","last_became_active":"2023-12-08T20:54:56.380860+0000","last_became_peered":"2023-12-08T20:54:56.380860+0000","last_unstale":"2023-12-08T20:55:04.505002+0000","last_undegraded":"2023-12-08T20:55:04.505002+0000","last_fullsized":"2023-12-08T20:55:04.505002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:11:11.173329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508899+0000","last_change":"2023-12-08T20:54:56.261370+0000","last_active":"2023-12-08T20:55:04.508899+0000","last_peered":"2023-12-08T20:55:04.508899+0000","last_clean":"2023-12-08T20:55:04.508899+0000","last_became_active":"2023-12-08T20:54:56.260387+0000","last_became_peered":"2023-12-08T20:54:56.260387+0000","last_unstale":"2023-12-08T20:55:04.508899+0000","last_undegraded":"2023-12-08T20:55:04.508899+0000","last_fullsized":"2023-12-08T20:55:04.508899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:17:07.046357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.306216+0000","last_change":"2023-12-08T20:54:56.388280+0000","last_active":"2023-12-08T20:55:04.306216+0000","last_peered":"2023-12-08T20:55:04.306216+0000","last_clean":"2023-12-08T20:55:04.306216+0000","last_became_active":"2023-12-08T20:54:56.387774+0000","last_became_peered":"2023-12-08T20:54:56.387774+0000","last_unstale":"2023-12-08T20:55:04.306216+0000","last_undegraded":"2023-12-08T20:55:04.306216+0000","last_fullsized":"2023-12-08T20:55:04.306216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:15:20.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.509158+0000","last_change":"2023-12-08T20:54:56.378804+0000","last_active":"2023-12-08T20:55:04.509158+0000","last_peered":"2023-12-08T20:55:04.509158+0000","last_clean":"2023-12-08T20:55:04.509158+0000","last_became_active":"2023-12-08T20:54:56.377029+0000","last_became_peered":"2023-12-08T20:54:56.377029+0000","last_unstale":"2023-12-08T20:55:04.509158+0000","last_undegraded":"2023-12-08T20:55:04.509158+0000","last_fullsized":"2023-12-08T20:55:04.509158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:55:29.247824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507664+0000","last_change":"2023-12-08T20:54:56.372118+0000","last_active":"2023-12-08T20:55:04.507664+0000","last_peered":"2023-12-08T20:55:04.507664+0000","last_clean":"2023-12-08T20:55:04.507664+0000","last_became_active":"2023-12-08T20:54:56.370707+0000","last_became_peered":"2023-12-08T20:54:56.370707+0000","last_unstale":"2023-12-08T20:55:04.507664+0000","last_undegraded":"2023-12-08T20:55:04.507664+0000","last_fullsized":"2023-12-08T20:55:04.507664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:35.994091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.524392+0000","last_change":"2023-12-08T20:54:56.405033+0000","last_active":"2023-12-08T20:55:04.524392+0000","last_peered":"2023-12-08T20:55:04.524392+0000","last_clean":"2023-12-08T20:55:04.524392+0000","last_became_active":"2023-12-08T20:54:56.401544+0000","last_became_peered":"2023-12-08T20:54:56.401544+0000","last_unstale":"2023-12-08T20:55:04.524392+0000","last_undegraded":"2023-12-08T20:55:04.524392+0000","last_fullsized":"2023-12-08T20:55:04.524392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:59.303019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.406433+0000","last_change":"2023-12-08T20:54:56.366037+0000","last_active":"2023-12-08T20:55:04.406433+0000","last_peered":"2023-12-08T20:55:04.406433+0000","last_clean":"2023-12-08T20:55:04.406433+0000","last_became_active":"2023-12-08T20:54:56.365432+0000","last_became_peered":"2023-12-08T20:54:56.365432+0000","last_unstale":"2023-12-08T20:55:04.406433+0000","last_undegraded":"2023-12-08T20:55:04.406433+0000","last_fullsized":"2023-12-08T20:55:04.406433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:48:49.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.407208+0000","last_change":"2023-12-08T20:54:56.393022+0000","last_active":"2023-12-08T20:55:04.407208+0000","last_peered":"2023-12-08T20:55:04.407208+0000","last_clean":"2023-12-08T20:55:04.407208+0000","last_became_active":"2023-12-08T20:54:56.392408+0000","last_became_peered":"2023-12-08T20:54:56.392408+0000","last_unstale":"2023-12-08T20:55:04.407208+0000","last_undegraded":"2023-12-08T20:55:04.407208+0000","last_fullsized":"2023-12-08T20:55:04.407208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:30:22.435898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504911+0000","last_change":"2023-12-08T20:54:56.380654+0000","last_active":"2023-12-08T20:55:04.504911+0000","last_peered":"2023-12-08T20:55:04.504911+0000","last_clean":"2023-12-08T20:55:04.504911+0000","last_became_active":"2023-12-08T20:54:56.380137+0000","last_became_peered":"2023-12-08T20:54:56.380137+0000","last_unstale":"2023-12-08T20:55:04.504911+0000","last_undegraded":"2023-12-08T20:55:04.504911+0000","last_fullsized":"2023-12-08T20:55:04.504911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:47:59.833913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504032+0000","last_change":"2023-12-08T20:54:56.392997+0000","last_active":"2023-12-08T20:55:04.504032+0000","last_peered":"2023-12-08T20:55:04.504032+0000","last_clean":"2023-12-08T20:55:04.504032+0000","last_became_active":"2023-12-08T20:54:56.391299+0000","last_became_peered":"2023-12-08T20:54:56.391299+0000","last_unstale":"2023-12-08T20:55:04.504032+0000","last_undegraded":"2023-12-08T20:55:04.504032+0000","last_fullsized":"2023-12-08T20:55:04.504032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:37.195485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503945+0000","last_change":"2023-12-08T20:54:56.393461+0000","last_active":"2023-12-08T20:55:04.503945+0000","last_peered":"2023-12-08T20:55:04.503945+0000","last_clean":"2023-12-08T20:55:04.503945+0000","last_became_active":"2023-12-08T20:54:56.392708+0000","last_became_peered":"2023-12-08T20:54:56.392708+0000","last_unstale":"2023-12-08T20:55:04.503945+0000","last_undegraded":"2023-12-08T20:55:04.503945+0000","last_fullsized":"2023-12-08T20:55:04.503945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:44.697264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456232+0000","last_change":"2023-12-08T20:54:56.319183+0000","last_active":"2023-12-08T20:55:04.456232+0000","last_peered":"2023-12-08T20:55:04.456232+0000","last_clean":"2023-12-08T20:55:04.456232+0000","last_became_active":"2023-12-08T20:54:56.318400+0000","last_became_peered":"2023-12-08T20:54:56.318400+0000","last_unstale":"2023-12-08T20:55:04.456232+0000","last_undegraded":"2023-12-08T20:55:04.456232+0000","last_fullsized":"2023-12-08T20:55:04.456232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.512685+0000","last_change":"2023-12-08T20:54:56.414028+0000","last_active":"2023-12-08T20:55:04.512685+0000","last_peered":"2023-12-08T20:55:04.512685+0000","last_clean":"2023-12-08T20:55:04.512685+0000","last_became_active":"2023-12-08T20:54:56.413220+0000","last_became_peered":"2023-12-08T20:54:56.413220+0000","last_unstale":"2023-12-08T20:55:04.512685+0000","last_undegraded":"2023-12-08T20:55:04.512685+0000","last_fullsized":"2023-12-08T20:55:04.512685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:23.917049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504035+0000","last_change":"2023-12-08T20:54:56.366203+0000","last_active":"2023-12-08T20:55:04.504035+0000","last_peered":"2023-12-08T20:55:04.504035+0000","last_clean":"2023-12-08T20:55:04.504035+0000","last_became_active":"2023-12-08T20:54:56.365448+0000","last_became_peered":"2023-12-08T20:54:56.365448+0000","last_unstale":"2023-12-08T20:55:04.504035+0000","last_undegraded":"2023-12-08T20:55:04.504035+0000","last_fullsized":"2023-12-08T20:55:04.504035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:10.405742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499135+0000","last_change":"2023-12-08T20:54:56.373847+0000","last_active":"2023-12-08T20:55:04.499135+0000","last_peered":"2023-12-08T20:55:04.499135+0000","last_clean":"2023-12-08T20:55:04.499135+0000","last_became_active":"2023-12-08T20:54:56.369574+0000","last_became_peered":"2023-12-08T20:54:56.369574+0000","last_unstale":"2023-12-08T20:55:04.499135+0000","last_undegraded":"2023-12-08T20:55:04.499135+0000","last_fullsized":"2023-12-08T20:55:04.499135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:10.078450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503926+0000","last_change":"2023-12-08T20:54:56.411972+0000","last_active":"2023-12-08T20:55:04.503926+0000","last_peered":"2023-12-08T20:55:04.503926+0000","last_clean":"2023-12-08T20:55:04.503926+0000","last_became_active":"2023-12-08T20:54:56.411339+0000","last_became_peered":"2023-12-08T20:54:56.411339+0000","last_unstale":"2023-12-08T20:55:04.503926+0000","last_undegraded":"2023-12-08T20:55:04.503926+0000","last_fullsized":"2023-12-08T20:55:04.503926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:41.074875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499247+0000","last_change":"2023-12-08T20:54:56.370763+0000","last_active":"2023-12-08T20:55:04.499247+0000","last_peered":"2023-12-08T20:55:04.499247+0000","last_clean":"2023-12-08T20:55:04.499247+0000","last_became_active":"2023-12-08T20:54:56.369650+0000","last_became_peered":"2023-12-08T20:54:56.369650+0000","last_unstale":"2023-12-08T20:55:04.499247+0000","last_undegraded":"2023-12-08T20:55:04.499247+0000","last_fullsized":"2023-12-08T20:55:04.499247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540578+0000","last_change":"2023-12-08T20:54:56.409124+0000","last_active":"2023-12-08T20:55:04.540578+0000","last_peered":"2023-12-08T20:55:04.540578+0000","last_clean":"2023-12-08T20:55:04.540578+0000","last_became_active":"2023-12-08T20:54:56.408861+0000","last_became_peered":"2023-12-08T20:54:56.408861+0000","last_unstale":"2023-12-08T20:55:04.540578+0000","last_undegraded":"2023-12-08T20:55:04.540578+0000","last_fullsized":"2023-12-08T20:55:04.540578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:40:00.277639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.541600+0000","last_change":"2023-12-08T20:54:56.407010+0000","last_active":"2023-12-08T20:55:04.541600+0000","last_peered":"2023-12-08T20:55:04.541600+0000","last_clean":"2023-12-08T20:55:04.541600+0000","last_became_active":"2023-12-08T20:54:56.404697+0000","last_became_peered":"2023-12-08T20:54:56.404697+0000","last_unstale":"2023-12-08T20:55:04.541600+0000","last_undegraded":"2023-12-08T20:55:04.541600+0000","last_fullsized":"2023-12-08T20:55:04.541600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:58:49.474462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504231+0000","last_change":"2023-12-08T20:54:56.378873+0000","last_active":"2023-12-08T20:55:04.504231+0000","last_peered":"2023-12-08T20:55:04.504231+0000","last_clean":"2023-12-08T20:55:04.504231+0000","last_became_active":"2023-12-08T20:54:56.377835+0000","last_became_peered":"2023-12-08T20:54:56.377835+0000","last_unstale":"2023-12-08T20:55:04.504231+0000","last_undegraded":"2023-12-08T20:55:04.504231+0000","last_fullsized":"2023-12-08T20:55:04.504231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:54:57.439693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":708223,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.0329999999999999}]},{"osd":2,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.83399999999999996}]},{"osd":3,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.0529999999999999}]},{"osd":4,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.232}]},{"osd":7,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.2589999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":118345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73599999999999999}]},{"osd":1,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.623},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.018}]},{"osd":2,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.337},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.91300000000000003}]},{"osd":5,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.149},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.1870000000000001}]},{"osd":6,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.2210000000000001}]},{"osd":7,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.2589999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":121602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.92200000000000004}]},{"osd":1,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.623},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.69299999999999995}]},{"osd":3,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.0029999999999999}]},{"osd":5,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.0409999999999999}]},{"osd":6,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.86499999999999999}]},{"osd":7,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.077}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":364544,"data_stored":708201,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.113}]},{"osd":5,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.79100000000000004}]},{"osd":6,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.319},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84699999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":303104,"data_stored":117819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.80300000000000005}]},{"osd":3,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.89100000000000001}]},{"osd":6,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.034}]},{"osd":7,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.006},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.77100000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":117887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.84699999999999998}]},{"osd":3,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.89200000000000002}]},{"osd":4,"last update":"Fri Dec 8 20:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.143},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":1.121}]},{"osd":5,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2250000000000001}]},{"osd":6,"last update":"Fri Dec 8 20:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.294}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":117763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.93999999999999995}]},{"osd":1,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":1.034},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65800000000000003}]},{"osd":2,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.879},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.22}]},{"osd":4,"last update":"Fri Dec 8 20:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.0700000000000001}]},{"osd":7,"last update":"Fri Dec 8 20:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.1499999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":122274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.96499999999999997}]},{"osd":2,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.76600000000000001}]},{"osd":3,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.0549999999999999}]},{"osd":5,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.032}]},{"osd":6,"last update":"Fri Dec 8 20:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.006},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.877}]},{"osd":7,"last update":"Fri Dec 8 20:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T20:55:41.569 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T20:55:41.570 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-08T20:55:41.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-08T20:55:41.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-08T20:55:41.574 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-08T20:55:41.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.738+0000 7f40c01e2640 1 Processor -- start 2023-12-08T20:55:41.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.738+0000 7f40c01e2640 1 -- start start 2023-12-08T20:55:41.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.738+0000 7f40c01e2640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f40b814fd00 0x7f40b81558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:41.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.738+0000 7f40c01e2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f40b80c0e50 0x7f40b80c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:41.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.738+0000 7f40c01e2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b80c62c0 con 0x7f40b80c6ff0 2023-12-08T20:55:41.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.738+0000 7f40c01e2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b81500e0 con 0x7f40b80c0e50 2023-12-08T20:55:41.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.738+0000 7f40c01e2640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b80c6b60 con 0x7f40b814fd00 2023-12-08T20:55:41.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.738+0000 7f40bdf7e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f40b814fd00 0x7f40b81558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:41.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.738+0000 7f40bd77d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f40b80c6ff0 0x7f40b8071ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53348/0 (socket says 172.21.15.53:53348) 2023-12-08T20:55:41.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.738+0000 7f40bd77d640 1 -- 172.21.15.53:0/3098815078 learned_addr learned my addr 172.21.15.53:0/3098815078 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:41.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.738+0000 7f40be77f640 1 --2- 172.21.15.53:0/3098815078 >> v2:172.21.15.53:3300/0 conn(0x7f40b80c0e50 0x7f40b80c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:41.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.742+0000 7f40be77f640 1 -- 172.21.15.53:0/3098815078 >> v2:172.21.15.146:3300/0 conn(0x7f40b814fd00 msgr2=0x7f40b81558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:41.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.742+0000 7f40be77f640 1 --2- 172.21.15.53:0/3098815078 >> v2:172.21.15.146:3300/0 conn(0x7f40b814fd00 0x7f40b81558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:41.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.742+0000 7f40be77f640 1 -- 172.21.15.53:0/3098815078 >> v1:172.21.15.53:6789/0 conn(0x7f40b80c6ff0 legacy=0x7f40b8071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:41.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.742+0000 7f40be77f640 1 -- 172.21.15.53:0/3098815078 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b80c1970 con 0x7f40b80c0e50 2023-12-08T20:55:41.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.750+0000 7f40be77f640 1 --2- 172.21.15.53:0/3098815078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40b80c0e50 0x7f40b80c12a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f40b80c7950 tx=0x7f40b001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a19b072f0b89923 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:41.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40bcf7c640 1 -- 172.21.15.53:0/3098815078 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b00a5920 con 0x7f40b80c0e50 2023-12-08T20:55:41.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40bcf7c640 1 -- 172.21.15.53:0/3098815078 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b00a5a80 con 0x7f40b80c0e50 2023-12-08T20:55:41.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40bcf7c640 1 -- 172.21.15.53:0/3098815078 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b00a5e10 con 0x7f40b80c0e50 2023-12-08T20:55:41.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 -- 172.21.15.53:0/3098815078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40b80c0e50 msgr2=0x7f40b80c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 --2- 172.21.15.53:0/3098815078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40b80c0e50 0x7f40b80c12a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f40b80c7950 tx=0x7f40b001c8e0 comp rx=0 tx=0).stop 2023-12-08T20:55:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 -- 172.21.15.53:0/3098815078 shutdown_connections 2023-12-08T20:55:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 --2- 172.21.15.53:0/3098815078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40b80c0e50 0x7f40b80c12a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 --2- 172.21.15.53:0/3098815078 >> v2:172.21.15.146:3300/0 conn(0x7f40b814fd00 0x7f40b81558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 -- 172.21.15.53:0/3098815078 >> 172.21.15.53:0/3098815078 conn(0x7f40b80caef0 msgr2=0x7f40b80cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 -- 172.21.15.53:0/3098815078 shutdown_connections 2023-12-08T20:55:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 -- 172.21.15.53:0/3098815078 wait complete. 2023-12-08T20:55:41.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 Processor -- start 2023-12-08T20:55:41.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 -- start start 2023-12-08T20:55:41.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f40b80c0e50 0x7f40b8151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:41.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40b80c6ff0 0x7f40b8148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:41.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40b814fd00 0x7f40b81f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:41.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8150230 con 0x7f40b814fd00 2023-12-08T20:55:41.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b81504d0 con 0x7f40b80c6ff0 2023-12-08T20:55:41.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.758+0000 7f40c01e2640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b81507b0 con 0x7f40b80c0e50 2023-12-08T20:55:41.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.762+0000 7f40be77f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40b814fd00 0x7f40b81f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:41.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.762+0000 7f40be77f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40b814fd00 0x7f40b81f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56364/0 (socket says 172.21.15.53:56364) 2023-12-08T20:55:41.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.762+0000 7f40be77f640 1 -- 172.21.15.53:0/789743892 learned_addr learned my addr 172.21.15.53:0/789743892 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:41.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.762+0000 7f40bd77d640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40b80c6ff0 0x7f40b8148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:41.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.762+0000 7f40bdf7e640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f40b80c0e50 0x7f40b8151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.766+0000 7f40be77f640 1 -- 172.21.15.53:0/789743892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f40b80c0e50 msgr2=0x7f40b8151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.766+0000 7f40be77f640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f40b80c0e50 0x7f40b8151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.766+0000 7f40be77f640 1 -- 172.21.15.53:0/789743892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40b80c6ff0 msgr2=0x7f40b8148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.766+0000 7f40be77f640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40b80c6ff0 0x7f40b8148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.766+0000 7f40be77f640 1 -- 172.21.15.53:0/789743892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b0009a70 con 0x7f40b814fd00 2023-12-08T20:55:41.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.766+0000 7f40be77f640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40b814fd00 0x7f40b81f5ea0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f40b00194f0 tx=0x7f40b0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.770+0000 7f40ae7fc640 1 -- 172.21.15.53:0/789743892 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b00aec60 con 0x7f40b814fd00 2023-12-08T20:55:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.770+0000 7f40ae7fc640 1 -- 172.21.15.53:0/789743892 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b00aedc0 con 0x7f40b814fd00 2023-12-08T20:55:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.770+0000 7f40ae7fc640 1 -- 172.21.15.53:0/789743892 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b00b7630 con 0x7f40b814fd00 2023-12-08T20:55:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.770+0000 7f40c01e2640 1 -- 172.21.15.53:0/789743892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b8150a90 con 0x7f40b814fd00 2023-12-08T20:55:41.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.770+0000 7f40c01e2640 1 -- 172.21.15.53:0/789743892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b81f56a0 con 0x7f40b814fd00 2023-12-08T20:55:41.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.774+0000 7f40c01e2640 1 -- 172.21.15.53:0/789743892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b80675b0 con 0x7f40b814fd00 2023-12-08T20:55:41.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.794+0000 7f40ae7fc640 1 -- 172.21.15.53:0/789743892 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f40b00b4050 con 0x7f40b814fd00 2023-12-08T20:55:41.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.794+0000 7f40ae7fc640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f409c0664f0 0x7f409c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:41.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.794+0000 7f40bdf7e640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f409c0664f0 0x7f409c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:41.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:41.794+0000 7f40bdf7e640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f409c0664f0 0x7f409c0689b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f40b400abc0 tx=0x7f40b400a2a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:42.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.094+0000 7f40ae7fc640 1 -- 172.21.15.53:0/789743892 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f40b00f0b50 con 0x7f40b814fd00 2023-12-08T20:55:42.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.094+0000 7f40ae7fc640 1 -- 172.21.15.53:0/789743892 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40b00ece90 con 0x7f40b814fd00 2023-12-08T20:55:42.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.310+0000 7f40c01e2640 1 -- 172.21.15.53:0/789743892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f40b8071980 con 0x7f40b814fd00 2023-12-08T20:55:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.522+0000 7f40ae7fc640 1 -- 172.21.15.53:0/789743892 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164429 (secure 0 0 0) 0x7f40b00b2030 con 0x7f40b814fd00 2023-12-08T20:55:42.525 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.530+0000 7f40c01e2640 1 -- 172.21.15.53:0/789743892 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f409c0664f0 msgr2=0x7f409c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.530+0000 7f40c01e2640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f409c0664f0 0x7f409c0689b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f40b400abc0 tx=0x7f40b400a2a0 comp rx=0 tx=0).stop 2023-12-08T20:55:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.530+0000 7f40c01e2640 1 -- 172.21.15.53:0/789743892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40b814fd00 msgr2=0x7f40b81f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.530+0000 7f40c01e2640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40b814fd00 0x7f40b81f5ea0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f40b00194f0 tx=0x7f40b0019680 comp rx=0 tx=0).stop 2023-12-08T20:55:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.530+0000 7f40c01e2640 1 -- 172.21.15.53:0/789743892 shutdown_connections 2023-12-08T20:55:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.530+0000 7f40c01e2640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f409c0664f0 0x7f409c0689b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.530+0000 7f40c01e2640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40b814fd00 0x7f40b81f5ea0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.530+0000 7f40c01e2640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40b80c6ff0 0x7f40b8148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.530+0000 7f40c01e2640 1 --2- 172.21.15.53:0/789743892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f40b80c0e50 0x7f40b8151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.530+0000 7f40c01e2640 1 -- 172.21.15.53:0/789743892 >> 172.21.15.53:0/789743892 conn(0x7f40b80caef0 msgr2=0x7f40b814de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.530+0000 7f40c01e2640 1 -- 172.21.15.53:0/789743892 shutdown_connections 2023-12-08T20:55:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.530+0000 7f40c01e2640 1 -- 172.21.15.53:0/789743892 wait complete. 2023-12-08T20:55:42.552 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":748035024},{"type":"v1","addr":"172.21.15.53:6801","nonce":748035024}]},"active_addr":"172.21.15.53:6801/748035024","active_change":"2023-12-08T20:53:56.563197+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":4240047601}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":3783921916}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":3046141705}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":1628459993}]}]} 2023-12-08T20:55:42.556 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-08T20:55:42.556 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-08T20:55:42.557 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:55:42.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.682+0000 7f6cb7b2d640 1 Processor -- start 2023-12-08T20:55:42.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.682+0000 7f6cb7b2d640 1 -- start start 2023-12-08T20:55:42.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.686+0000 7f6cb7b2d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6cb006ed30 0x7f6cb00c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:42.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.686+0000 7f6cb7b2d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cb0071140 0x7f6cb0157290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:42.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.686+0000 7f6cb7b2d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb0157e90 con 0x7f6cb006f110 2023-12-08T20:55:42.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.686+0000 7f6cb7b2d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb0158170 con 0x7f6cb006ed30 2023-12-08T20:55:42.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.686+0000 7f6cb7b2d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb015a920 con 0x7f6cb0071140 2023-12-08T20:55:42.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.686+0000 7f6cb58c9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6cb006ed30 0x7f6cb00c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:42.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.686+0000 7f6cb58c9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6cb006ed30 0x7f6cb00c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56366/0 (socket says 172.21.15.53:56366) 2023-12-08T20:55:42.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.686+0000 7f6cb58c9640 1 -- 172.21.15.53:0/4182661644 learned_addr learned my addr 172.21.15.53:0/4182661644 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.690+0000 7f6cb58c9640 1 -- 172.21.15.53:0/4182661644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cb0071140 msgr2=0x7f6cb0157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.690+0000 7f6cb58c9640 1 --2- 172.21.15.53:0/4182661644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cb0071140 0x7f6cb0157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.690+0000 7f6cb58c9640 1 -- 172.21.15.53:0/4182661644 >> v1:172.21.15.53:6789/0 conn(0x7f6cb006f110 legacy=0x7f6cb006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.690+0000 7f6cb58c9640 1 -- 172.21.15.53:0/4182661644 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb015ac00 con 0x7f6cb006ed30 2023-12-08T20:55:42.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.694+0000 7f6cb58c9640 1 --2- 172.21.15.53:0/4182661644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb006ed30 0x7f6cb00c58f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009e50 tx=0x7f6cac01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3db86c7f370a734 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:42.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.698+0000 7f6cb48c7640 1 -- 172.21.15.53:0/4182661644 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0af400 con 0x7f6cb006ed30 2023-12-08T20:55:42.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.698+0000 7f6cb48c7640 1 -- 172.21.15.53:0/4182661644 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac0ab050 con 0x7f6cb006ed30 2023-12-08T20:55:42.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.698+0000 7f6cb48c7640 1 -- 172.21.15.53:0/4182661644 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0af780 con 0x7f6cb006ed30 2023-12-08T20:55:42.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/4182661644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb006ed30 msgr2=0x7f6cb00c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:42.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 --2- 172.21.15.53:0/4182661644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb006ed30 0x7f6cb00c58f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009e50 tx=0x7f6cac01f1f0 comp rx=0 tx=0).stop 2023-12-08T20:55:42.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/4182661644 shutdown_connections 2023-12-08T20:55:42.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 --2- 172.21.15.53:0/4182661644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cb0071140 0x7f6cb0157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:42.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 --2- 172.21.15.53:0/4182661644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb006ed30 0x7f6cb00c58f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:42.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/4182661644 >> 172.21.15.53:0/4182661644 conn(0x7f6cb00caef0 msgr2=0x7f6cb00cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:42.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/4182661644 shutdown_connections 2023-12-08T20:55:42.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/4182661644 wait complete. 2023-12-08T20:55:42.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 Processor -- start 2023-12-08T20:55:42.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 -- start start 2023-12-08T20:55:42.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb006ed30 0x7f6cb00c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:42.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cb006f110 0x7f6cb0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:42.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cb0071140 0x7f6cb0155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:42.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01398b0 con 0x7f6cb006ed30 2023-12-08T20:55:42.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0158c30 con 0x7f6cb006f110 2023-12-08T20:55:42.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb7b2d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0158ef0 con 0x7f6cb0071140 2023-12-08T20:55:42.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb58c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb006ed30 0x7f6cb00c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:42.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb58c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb006ed30 0x7f6cb00c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56382/0 (socket says 172.21.15.53:56382) 2023-12-08T20:55:42.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.702+0000 7f6cb58c9640 1 -- 172.21.15.53:0/1525819713 learned_addr learned my addr 172.21.15.53:0/1525819713 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:42.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.706+0000 7f6cb50c8640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cb006f110 0x7f6cb0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:42.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.706+0000 7f6cb60ca640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cb0071140 0x7f6cb0155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.714+0000 7f6cb60ca640 1 -- 172.21.15.53:0/1525819713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cb006f110 msgr2=0x7f6cb0159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.714+0000 7f6cb60ca640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cb006f110 0x7f6cb0159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.714+0000 7f6cb60ca640 1 -- 172.21.15.53:0/1525819713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb006ed30 msgr2=0x7f6cb00c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.714+0000 7f6cb60ca640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb006ed30 0x7f6cb00c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.714+0000 7f6cb60ca640 1 -- 172.21.15.53:0/1525819713 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac009b30 con 0x7f6cb0071140 2023-12-08T20:55:42.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.722+0000 7f6cb60ca640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cb0071140 0x7f6cb0155100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800b410 tx=0x7f6ca800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:42.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.730+0000 7f6ca67fc640 1 -- 172.21.15.53:0/1525819713 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8011830 con 0x7f6cb0071140 2023-12-08T20:55:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.730+0000 7f6ca67fc640 1 -- 172.21.15.53:0/1525819713 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca80119b0 con 0x7f6cb0071140 2023-12-08T20:55:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.730+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/1525819713 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb01591d0 con 0x7f6cb0071140 2023-12-08T20:55:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.730+0000 7f6ca67fc640 1 -- 172.21.15.53:0/1525819713 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8011d60 con 0x7f6cb0071140 2023-12-08T20:55:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.730+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/1525819713 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb01392f0 con 0x7f6cb0071140 2023-12-08T20:55:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:42.734+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/1525819713 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb0159cc0 con 0x7f6cb0071140 2023-12-08T20:55:43.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.026+0000 7f6ca67fc640 1 -- 172.21.15.53:0/1525819713 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ca801a400 con 0x7f6cb0071140 2023-12-08T20:55:43.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.026+0000 7f6ca67fc640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6c940664c0 0x7f6c94068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:43.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.030+0000 7f6cb58c9640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6c940664c0 0x7f6c94068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:43.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.030+0000 7f6cb58c9640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6c940664c0 0x7f6c94068980 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6cac01f230 tx=0x7f6cac0aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:43.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.034+0000 7f6ca67fc640 1 -- 172.21.15.53:0/1525819713 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ca8055450 con 0x7f6cb0071140 2023-12-08T20:55:43.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.058+0000 7f6ca67fc640 1 -- 172.21.15.53:0/1525819713 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ca8051790 con 0x7f6cb0071140 2023-12-08T20:55:43.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.238+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/1525819713 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cb0159cc0 con 0x7f6cb0071140 2023-12-08T20:55:43.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.290+0000 7f6ca67fc640 1 -- 172.21.15.53:0/1525819713 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f6cb0159cc0 con 0x7f6cb0071140 2023-12-08T20:55:43.289 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:43.289 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:05.168215+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:55:43.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.294+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/1525819713 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6c940664c0 msgr2=0x7f6c94068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:43.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.294+0000 7f6cb7b2d640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6c940664c0 0x7f6c94068980 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6cac01f230 tx=0x7f6cac0aa000 comp rx=0 tx=0).stop 2023-12-08T20:55:43.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.294+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/1525819713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cb0071140 msgr2=0x7f6cb0155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:43.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.294+0000 7f6cb7b2d640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cb0071140 0x7f6cb0155100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800b410 tx=0x7f6ca800b8d0 comp rx=0 tx=0).stop 2023-12-08T20:55:43.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.294+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/1525819713 shutdown_connections 2023-12-08T20:55:43.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.294+0000 7f6cb7b2d640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6c940664c0 0x7f6c94068980 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:43.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.294+0000 7f6cb7b2d640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cb0071140 0x7f6cb0155100 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:43.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.294+0000 7f6cb7b2d640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cb006f110 0x7f6cb0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:43.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.294+0000 7f6cb7b2d640 1 --2- 172.21.15.53:0/1525819713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb006ed30 0x7f6cb00c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:43.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.294+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/1525819713 >> 172.21.15.53:0/1525819713 conn(0x7f6cb00caef0 msgr2=0x7f6cb006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:43.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.294+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/1525819713 shutdown_connections 2023-12-08T20:55:43.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.294+0000 7f6cb7b2d640 1 -- 172.21.15.53:0/1525819713 wait complete. 2023-12-08T20:55:43.315 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-08T20:55:43.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:55:43.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.442+0000 7f6b6ab98640 1 Processor -- start 2023-12-08T20:55:43.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.442+0000 7f6b6ab98640 1 -- start start 2023-12-08T20:55:43.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.446+0000 7f6b6ab98640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b64153910 0x7f6b640ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:43.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.446+0000 7f6b6ab98640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b640cb190 con 0x7f6b6415a180 2023-12-08T20:55:43.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.446+0000 7f6b6ab98640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b640cc2d0 con 0x7f6b640ceed0 2023-12-08T20:55:43.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.446+0000 7f6b6ab98640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b640ca120 con 0x7f6b64153910 2023-12-08T20:55:43.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.446+0000 7f6b63fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6b6415a180 0x7f6b640c3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53366/0 (socket says 172.21.15.53:53366) 2023-12-08T20:55:43.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.446+0000 7f6b63fff640 1 -- 172.21.15.53:0/3420416240 learned_addr learned my addr 172.21.15.53:0/3420416240 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:43.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.446+0000 7f6b68934640 1 --2- 172.21.15.53:0/3420416240 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b64153910 0x7f6b640ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:43.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.450+0000 7f6b637fe640 1 -- 172.21.15.53:0/3420416240 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978863739 0 0) 0x7f6b640cb190 con 0x7f6b6415a180 2023-12-08T20:55:43.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.450+0000 7f6b637fe640 1 -- 172.21.15.53:0/3420416240 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b54003530 con 0x7f6b6415a180 2023-12-08T20:55:43.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.454+0000 7f6b68934640 1 -- 172.21.15.53:0/3420416240 >> v1:172.21.15.146:6789/0 conn(0x7f6b640ceed0 legacy=0x7f6b64164080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:43.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.454+0000 7f6b68934640 1 -- 172.21.15.53:0/3420416240 >> v1:172.21.15.53:6789/0 conn(0x7f6b6415a180 legacy=0x7f6b640c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:43.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.454+0000 7f6b68934640 1 -- 172.21.15.53:0/3420416240 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b640c4530 con 0x7f6b64153910 2023-12-08T20:55:43.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.462+0000 7f6b68934640 1 --2- 172.21.15.53:0/3420416240 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b64153910 0x7f6b640ca2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b580097f0 tx=0x7f6b5801ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f323e299a6f6c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:43.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b637fe640 1 -- 172.21.15.53:0/3420416240 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b580a89b0 con 0x7f6b64153910 2023-12-08T20:55:43.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b637fe640 1 -- 172.21.15.53:0/3420416240 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b580a8b10 con 0x7f6b64153910 2023-12-08T20:55:43.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b637fe640 1 -- 172.21.15.53:0/3420416240 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b580a8ea0 con 0x7f6b64153910 2023-12-08T20:55:43.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3420416240 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b64153910 msgr2=0x7f6b640ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:43.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 --2- 172.21.15.53:0/3420416240 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b64153910 0x7f6b640ca2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b580097f0 tx=0x7f6b5801ecb0 comp rx=0 tx=0).stop 2023-12-08T20:55:43.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3420416240 shutdown_connections 2023-12-08T20:55:43.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 --2- 172.21.15.53:0/3420416240 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b64153910 0x7f6b640ca2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:43.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3420416240 >> 172.21.15.53:0/3420416240 conn(0x7f6b6408afc0 msgr2=0x7f6b6408b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:43.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3420416240 shutdown_connections 2023-12-08T20:55:43.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3420416240 wait complete. 2023-12-08T20:55:43.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 Processor -- start 2023-12-08T20:55:43.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 -- start start 2023-12-08T20:55:43.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b640ceed0 0x7f6b64152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:43.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b64153910 0x7f6b640b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:43.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6415a180 0x7f6b641501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:43.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6414ee40 con 0x7f6b6415a180 2023-12-08T20:55:43.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64153100 con 0x7f6b64153910 2023-12-08T20:55:43.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.470+0000 7f6b6ab98640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64151c30 con 0x7f6b640ceed0 2023-12-08T20:55:43.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.474+0000 7f6b69135640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6415a180 0x7f6b641501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:43.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.474+0000 7f6b69135640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6415a180 0x7f6b641501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56390/0 (socket says 172.21.15.53:56390) 2023-12-08T20:55:43.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.474+0000 7f6b69135640 1 -- 172.21.15.53:0/3768115590 learned_addr learned my addr 172.21.15.53:0/3768115590 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:43.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.474+0000 7f6b63fff640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b64153910 0x7f6b640b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:43.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.474+0000 7f6b68934640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b640ceed0 0x7f6b64152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:43.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.478+0000 7f6b69135640 1 -- 172.21.15.53:0/3768115590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b640ceed0 msgr2=0x7f6b64152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:43.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.478+0000 7f6b69135640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b640ceed0 0x7f6b64152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:43.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.478+0000 7f6b69135640 1 -- 172.21.15.53:0/3768115590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b64153910 msgr2=0x7f6b640b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:43.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.478+0000 7f6b69135640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b64153910 0x7f6b640b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:43.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.478+0000 7f6b69135640 1 -- 172.21.15.53:0/3768115590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b58009420 con 0x7f6b6415a180 2023-12-08T20:55:43.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.478+0000 7f6b69135640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6415a180 0x7f6b641501c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c770 tx=0x7f6b5c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:43.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.482+0000 7f6b617fa640 1 -- 172.21.15.53:0/3768115590 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c003b80 con 0x7f6b6415a180 2023-12-08T20:55:43.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.482+0000 7f6b617fa640 1 -- 172.21.15.53:0/3768115590 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c003ce0 con 0x7f6b6415a180 2023-12-08T20:55:43.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.482+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3768115590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b64151ed0 con 0x7f6b6415a180 2023-12-08T20:55:43.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.482+0000 7f6b617fa640 1 -- 172.21.15.53:0/3768115590 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00aa90 con 0x7f6b6415a180 2023-12-08T20:55:43.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.482+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3768115590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6414f6e0 con 0x7f6b6415a180 2023-12-08T20:55:43.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.486+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3768115590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b640675b0 con 0x7f6b6415a180 2023-12-08T20:55:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.506+0000 7f6b617fa640 1 -- 172.21.15.53:0/3768115590 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6b5c00abf0 con 0x7f6b6415a180 2023-12-08T20:55:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.506+0000 7f6b617fa640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6b480664a0 0x7f6b48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.506+0000 7f6b68934640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6b480664a0 0x7f6b48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.506+0000 7f6b68934640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6b480664a0 0x7f6b48068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6b580b2000 tx=0x7f6b580aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:43.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.850+0000 7f6b617fa640 1 -- 172.21.15.53:0/3768115590 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b5c055f20 con 0x7f6b6415a180 2023-12-08T20:55:43.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:43.850+0000 7f6b617fa640 1 -- 172.21.15.53:0/3768115590 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b5c051b60 con 0x7f6b6415a180 2023-12-08T20:55:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.066+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3768115590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b640ca8f0 con 0x7f6b6415a180 2023-12-08T20:55:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.230+0000 7f6b617fa640 1 -- 172.21.15.53:0/3768115590 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f6b5c055180 con 0x7f6b6415a180 2023-12-08T20:55:44.232 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:44.232 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:05.168215+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:55:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.234+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3768115590 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6b480664a0 msgr2=0x7f6b48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.234+0000 7f6b6ab98640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6b480664a0 0x7f6b48068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6b580b2000 tx=0x7f6b580aa070 comp rx=0 tx=0).stop 2023-12-08T20:55:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.234+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3768115590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6415a180 msgr2=0x7f6b641501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.234+0000 7f6b6ab98640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6415a180 0x7f6b641501c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c770 tx=0x7f6b5c00cc30 comp rx=0 tx=0).stop 2023-12-08T20:55:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.234+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3768115590 shutdown_connections 2023-12-08T20:55:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.234+0000 7f6b6ab98640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6b480664a0 0x7f6b48068960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.234+0000 7f6b6ab98640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6415a180 0x7f6b641501c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.234+0000 7f6b6ab98640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b64153910 0x7f6b640b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.234+0000 7f6b6ab98640 1 --2- 172.21.15.53:0/3768115590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b640ceed0 0x7f6b64152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.234+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3768115590 >> 172.21.15.53:0/3768115590 conn(0x7f6b6408afc0 msgr2=0x7f6b640c4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.234+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3768115590 shutdown_connections 2023-12-08T20:55:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.234+0000 7f6b6ab98640 1 -- 172.21.15.53:0/3768115590 wait complete. 2023-12-08T20:55:44.255 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-08T20:55:44.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-08T20:55:44.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-08T20:55:44.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-08T20:55:44.257 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-08T20:55:44.257 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-08T20:55:44.257 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-08T20:55:44.258 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-08T20:55:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f6883d76640 1 Processor -- start 2023-12-08T20:55:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f6883d76640 1 -- start start 2023-12-08T20:55:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f8aff1c5640 1 Processor -- start 2023-12-08T20:55:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f8aff1c5640 1 -- start start 2023-12-08T20:55:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fe02759e640 1 Processor -- start 2023-12-08T20:55:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fe02759e640 1 -- start start 2023-12-08T20:55:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fd236dbc640 1 Processor -- start 2023-12-08T20:55:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f8aff1c5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af00e71c0 0x7f8af0046270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f8aff1c5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8af00467b0 0x7f8af004ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f8aff1c5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af004c660 con 0x7f8af00dd290 2023-12-08T20:55:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f8aff1c5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af00454b0 con 0x7f8af00467b0 2023-12-08T20:55:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f8aff1c5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af0045790 con 0x7f8af00e71c0 2023-12-08T20:55:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f6883d76640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f687c0c7670 0x7f687c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f6883d76640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f687c0c7a50 0x7f687c071540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f6883d76640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c0c5800 con 0x7f687c15e570 2023-12-08T20:55:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f6883d76640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687c15e0e0 con 0x7f687c0c7a50 2023-12-08T20:55:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f6883d76640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687c15d7d0 con 0x7f687c0c7670 2023-12-08T20:55:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fe02759e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe028072510 0x7fe0280c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fe02759e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe02806ec30 0x7fe02806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fe02759e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0280c7440 0x7fe0280c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fe02759e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0280c6ac0 con 0x7fe02806ec30 2023-12-08T20:55:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fe02759e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe028157ea0 con 0x7fe028072510 2023-12-08T20:55:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fe02759e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0280c7dd0 con 0x7fe0280c7440 2023-12-08T20:55:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fd236dbc640 1 -- start start 2023-12-08T20:55:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fd236dbc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd228046530 0x7fd2280df930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fd236dbc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd228047830 con 0x7fd2280d5c90 2023-12-08T20:55:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fd236dbc640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd228046c20 con 0x7fd228047cc0 2023-12-08T20:55:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fd236dbc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd228034880 con 0x7fd228046530 2023-12-08T20:55:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f6882313640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f687c0c7a50 0x7f687c071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7fdfbf59e640 1 Processor -- start 2023-12-08T20:55:44.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.458+0000 7f710091a640 1 Processor -- start 2023-12-08T20:55:44.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7fdfbf59e640 1 -- start start 2023-12-08T20:55:44.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f6882313640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f687c0c7a50 0x7f687c071540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56400/0 (socket says 172.21.15.53:56400) 2023-12-08T20:55:44.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f6882313640 1 -- 172.21.15.53:0/1365425086 learned_addr learned my addr 172.21.15.53:0/1365425086 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f8afe1c3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8af00dd290 0x7f8af00e66c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53372/0 (socket says 172.21.15.53:53372) 2023-12-08T20:55:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f8afe1c3640 1 -- 172.21.15.53:0/1571457191 learned_addr learned my addr 172.21.15.53:0/1571457191 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f710091a640 1 -- start start 2023-12-08T20:55:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f710091a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f40dd290 0x7f70f40e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f710091a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70f40e71c0 0x7f70f40e6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f710091a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f404c660 con 0x7f70f4046270 2023-12-08T20:55:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f710091a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f40454b0 con 0x7f70f40e71c0 2023-12-08T20:55:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f710091a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4045790 con 0x7f70f40dd290 2023-12-08T20:55:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7fdfbf59e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdfc01533c0 0x7fdfc00c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7fdfbf59e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfc00c7980 0x7fdfc0159260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7fdfbf59e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc015a1f0 con 0x7fdfc00c58e0 2023-12-08T20:55:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7fdfbf59e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc00c2ac0 con 0x7fdfc01533c0 2023-12-08T20:55:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7fdfbf59e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc01537a0 con 0x7fdfc00c7980 2023-12-08T20:55:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f6881b12640 1 --2- 172.21.15.53:0/1365425086 >> v2:172.21.15.146:3300/0 conn(0x7f687c0c7670 0x7f687c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f0ca02e5640 1 Processor -- start 2023-12-08T20:55:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f0ca02e5640 1 -- start start 2023-12-08T20:55:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7fe026d9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0280c7440 0x7fe0280c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f0ca02e5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c900d7040 0x7f0c9004e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f0ca02e5640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c9004cd00 0x7f0c900dcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f0ca02e5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9004eb30 con 0x7f0c9004e6a0 2023-12-08T20:55:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f0ca02e5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c900e0ec0 con 0x7f0c900d7040 2023-12-08T20:55:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f0ca02e5640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c900e0240 con 0x7f0c9004cd00 2023-12-08T20:55:44.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7fe026d9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0280c7440 0x7fe0280c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:43934/0 (socket says 172.21.15.53:43934) 2023-12-08T20:55:44.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7fe026d9d640 1 -- 172.21.15.53:0/2100262210 learned_addr learned my addr 172.21.15.53:0/2100262210 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f6882313640 1 -- 172.21.15.53:0/1365425086 >> v2:172.21.15.146:3300/0 conn(0x7f687c0c7670 msgr2=0x7f687c0c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f6882313640 1 --2- 172.21.15.53:0/1365425086 >> v2:172.21.15.146:3300/0 conn(0x7f687c0c7670 0x7f687c0c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f6882313640 1 -- 172.21.15.53:0/1365425086 >> v1:172.21.15.146:6789/0 conn(0x7f687c15e570 legacy=0x7f687c1617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.462+0000 7f6882313640 1 -- 172.21.15.53:0/1365425086 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c0c7ee0 con 0x7f687c0c7a50 2023-12-08T20:55:44.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.466+0000 7f8afe9c4640 1 --2- 172.21.15.53:0/1571457191 >> v2:172.21.15.53:3300/0 conn(0x7f8af00467b0 0x7f8af004ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.466+0000 7fdfbe59c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdfc01533c0 0x7fdfc00c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.466+0000 7fd2355b9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd228046530 0x7fd2280df930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.470+0000 7fd2355b9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd228046530 0x7fd2280df930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56418/0 (socket says 172.21.15.53:56418) 2023-12-08T20:55:44.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.470+0000 7fd2355b9640 1 -- 172.21.15.53:0/878023483 learned_addr learned my addr 172.21.15.53:0/878023483 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.470+0000 7fdfbe59c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdfc01533c0 0x7fdfc00c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40104/0 (socket says 172.21.15.53:40104) 2023-12-08T20:55:44.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.470+0000 7fdfbe59c640 1 -- 172.21.15.53:0/966239143 learned_addr learned my addr 172.21.15.53:0/966239143 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.470+0000 7fe026d9d640 1 -- 172.21.15.53:0/2100262210 >> v2:172.21.15.146:3300/0 conn(0x7fe028072510 msgr2=0x7fe0280c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.470+0000 7fe026d9d640 1 --2- 172.21.15.53:0/2100262210 >> v2:172.21.15.146:3300/0 conn(0x7fe028072510 0x7fe0280c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.470+0000 7fe026d9d640 1 -- 172.21.15.53:0/2100262210 >> v2:172.21.15.53:3300/0 conn(0x7fe02806ec30 msgr2=0x7fe02806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.470+0000 7fe026d9d640 1 --2- 172.21.15.53:0/2100262210 >> v2:172.21.15.53:3300/0 conn(0x7fe02806ec30 0x7fe02806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.470+0000 7fe026d9d640 1 -- 172.21.15.53:0/2100262210 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe028156fd0 con 0x7fe0280c7440 2023-12-08T20:55:44.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.470+0000 7f0c9e882640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c9004cd00 0x7f0c900dcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.470+0000 7f0c9e081640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c900d7040 0x7f0c9004e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.470+0000 7f70fad9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f40dd290 0x7f70f40e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f0c9e882640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c9004cd00 0x7f0c900dcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40106/0 (socket says 172.21.15.53:40106) 2023-12-08T20:55:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f0c9e882640 1 -- 172.21.15.53:0/2011611928 learned_addr learned my addr 172.21.15.53:0/2011611928 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f8afe9c4640 1 -- 172.21.15.53:0/1571457191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af00e71c0 msgr2=0x7f8af0046270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f8afe9c4640 1 --2- 172.21.15.53:0/1571457191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af00e71c0 0x7f8af0046270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f8afe9c4640 1 -- 172.21.15.53:0/1571457191 >> v1:172.21.15.53:6789/0 conn(0x7f8af00dd290 legacy=0x7f8af00e66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f8afe9c4640 1 -- 172.21.15.53:0/1571457191 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af0045a70 con 0x7f8af00467b0 2023-12-08T20:55:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f70fad9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f40dd290 0x7f70f40e66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:43944/0 (socket says 172.21.15.53:43944) 2023-12-08T20:55:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f70fad9d640 1 -- 172.21.15.53:0/2959929922 learned_addr learned my addr 172.21.15.53:0/2959929922 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f69ef310640 1 Processor -- start 2023-12-08T20:55:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f69ef310640 1 -- start start 2023-12-08T20:55:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7fd2355b9640 1 -- 172.21.15.53:0/878023483 >> v1:172.21.15.146:6789/0 conn(0x7fd228047cc0 legacy=0x7fd228006ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7fd2355b9640 1 -- 172.21.15.53:0/878023483 >> v1:172.21.15.53:6789/0 conn(0x7fd2280d5c90 legacy=0x7fd22804c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7fd2355b9640 1 -- 172.21.15.53:0/878023483 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd228046f00 con 0x7fd228046530 2023-12-08T20:55:44.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f69ef310640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f69e80ca2f0 0x7f69e80c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f69ef310640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e80ceed0 0x7f69e80cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.474+0000 7f69ef310640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e80cb190 con 0x7f69e8153910 2023-12-08T20:55:44.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.478+0000 7f69ef310640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e80ca120 con 0x7f69e80ca2f0 2023-12-08T20:55:44.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.478+0000 7f69ef310640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80cc2d0 con 0x7f69e80ceed0 2023-12-08T20:55:44.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.478+0000 7fdfbe59c640 1 -- 172.21.15.53:0/966239143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfc00c7980 msgr2=0x7fdfc0159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.478+0000 7fdfbe59c640 1 --2- 172.21.15.53:0/966239143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfc00c7980 0x7fdfc0159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.478+0000 7fdfbe59c640 1 -- 172.21.15.53:0/966239143 >> v1:172.21.15.53:6789/0 conn(0x7fdfc00c58e0 legacy=0x7fdfc00c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.478+0000 7fdfbe59c640 1 -- 172.21.15.53:0/966239143 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc015d740 con 0x7fdfc01533c0 2023-12-08T20:55:44.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.478+0000 7fd2355b9640 1 --2- 172.21.15.53:0/878023483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd228046530 0x7fd2280df930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd220009870 tx=0x7fd22001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f1fb48438972fd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.478+0000 7f70fad9d640 1 -- 172.21.15.53:0/2959929922 >> v2:172.21.15.53:3300/0 conn(0x7f70f40e71c0 msgr2=0x7f70f40e6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.478+0000 7f70fad9d640 1 --2- 172.21.15.53:0/2959929922 >> v2:172.21.15.53:3300/0 conn(0x7f70f40e71c0 0x7f70f40e6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.478+0000 7f70fad9d640 1 -- 172.21.15.53:0/2959929922 >> v1:172.21.15.53:6789/0 conn(0x7f70f4046270 legacy=0x7f70f404ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.478+0000 7f70fad9d640 1 -- 172.21.15.53:0/2959929922 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f4045a70 con 0x7f70f40dd290 2023-12-08T20:55:44.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.482+0000 7f0c9e081640 1 -- 172.21.15.53:0/2011611928 >> v2:172.21.15.146:3300/0 conn(0x7f0c9004cd00 msgr2=0x7f0c900dcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.482+0000 7f0c9e081640 1 --2- 172.21.15.53:0/2011611928 >> v2:172.21.15.146:3300/0 conn(0x7f0c9004cd00 0x7f0c900dcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.482+0000 7f0c9e081640 1 -- 172.21.15.53:0/2011611928 >> v1:172.21.15.53:6789/0 conn(0x7f0c9004e6a0 legacy=0x7f0c9004d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.482+0000 7f0c9e081640 1 -- 172.21.15.53:0/2011611928 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900e0520 con 0x7f0c900d7040 2023-12-08T20:55:44.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.486+0000 7f8afe9c4640 1 --2- 172.21.15.53:0/1571457191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8af00467b0 0x7f8af004ba40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8af8050190 tx=0x7f8af80998b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e943b30e9235ef19 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.486+0000 7fdfbe59c640 1 --2- 172.21.15.53:0/966239143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc01533c0 0x7fdfc00c53a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009870 tx=0x7fdfb001c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e2b0b663f482652 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.490+0000 7f70fad9d640 1 --2- 172.21.15.53:0/2959929922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f40dd290 0x7f70f40e66c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009870 tx=0x7f70ec01ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=501279ae199c8f07 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.494+0000 7fd234db8640 1 -- 172.21.15.53:0/878023483 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200ac600 con 0x7fd228046530 2023-12-08T20:55:44.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.494+0000 7fd234db8640 1 -- 172.21.15.53:0/878023483 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2200a8050 con 0x7fd228046530 2023-12-08T20:55:44.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.494+0000 7fd234db8640 1 -- 172.21.15.53:0/878023483 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200ac980 con 0x7fd228046530 2023-12-08T20:55:44.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.494+0000 7fe026d9d640 1 --2- 172.21.15.53:0/2100262210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0280c7440 0x7fe0280c7890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe0281571c0 tx=0x7fe02001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d992a5beef3815e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.494+0000 7fd236dbc640 1 -- 172.21.15.53:0/878023483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd228046530 msgr2=0x7fd2280df930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.494+0000 7fd236dbc640 1 --2- 172.21.15.53:0/878023483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd228046530 0x7fd2280df930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd220009870 tx=0x7fd22001c490 comp rx=0 tx=0).stop 2023-12-08T20:55:44.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.494+0000 7fd236dbc640 1 -- 172.21.15.53:0/878023483 shutdown_connections 2023-12-08T20:55:44.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.494+0000 7fd236dbc640 1 --2- 172.21.15.53:0/878023483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd228046530 0x7fd2280df930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.494+0000 7fd236dbc640 1 -- 172.21.15.53:0/878023483 >> 172.21.15.53:0/878023483 conn(0x7fd228051270 msgr2=0x7fd228051680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.494+0000 7fd236dbc640 1 -- 172.21.15.53:0/878023483 shutdown_connections 2023-12-08T20:55:44.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.494+0000 7fd236dbc640 1 -- 172.21.15.53:0/878023483 wait complete. 2023-12-08T20:55:44.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.498+0000 7fd236dbc640 1 Processor -- start 2023-12-08T20:55:44.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.498+0000 7fd236dbc640 1 -- start start 2023-12-08T20:55:44.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.498+0000 7fd236dbc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd228046530 0x7fd2280dda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.498+0000 7fd236dbc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd228047cc0 0x7fd2280df690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.498+0000 7fd236dbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2280d5c90 0x7fd2280d6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.498+0000 7fd236dbc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280dd050 con 0x7fd2280d5c90 2023-12-08T20:55:44.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.498+0000 7fd236dbc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280dd860 con 0x7fd228047cc0 2023-12-08T20:55:44.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.498+0000 7fd236dbc640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280ddf80 con 0x7fd228046530 2023-12-08T20:55:44.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.498+0000 7f6882313640 1 --2- 172.21.15.53:0/1365425086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f687c0c7a50 0x7f687c071540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f687c0705e0 tx=0x7f687401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd9ea8e58077a43 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.498+0000 7f0c9e081640 1 --2- 172.21.15.53:0/2011611928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c900d7040 0x7f0c9004e160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0c90034cf0 tx=0x7f0c9401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40a0a358e23096b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.502+0000 7f69ed0ac640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f69e8153910 0x7f69e815a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.53:45150/0 (socket says 172.21.15.53:45150) 2023-12-08T20:55:44.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.502+0000 7f69ed0ac640 1 -- 172.21.15.53:0/3891615518 learned_addr learned my addr 172.21.15.53:0/3891615518 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:44.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.506+0000 7f69ec8ab640 1 --2- 172.21.15.53:0/3891615518 >> v2:172.21.15.53:3300/0 conn(0x7f69e80ca2f0 0x7f69e80c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.506+0000 7f8afd1c1640 1 -- 172.21.15.53:0/1571457191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af812c070 con 0x7f8af00467b0 2023-12-08T20:55:44.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.506+0000 7f8afd1c1640 1 -- 172.21.15.53:0/1571457191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af8128540 con 0x7f8af00467b0 2023-12-08T20:55:44.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.506+0000 7f8afd1c1640 1 -- 172.21.15.53:0/1571457191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8128970 con 0x7f8af00467b0 2023-12-08T20:55:44.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.506+0000 7f8aff1c5640 1 -- 172.21.15.53:0/1571457191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8af00467b0 msgr2=0x7f8af004ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.506+0000 7f8aff1c5640 1 --2- 172.21.15.53:0/1571457191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8af00467b0 0x7f8af004ba40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8af8050190 tx=0x7f8af80998b0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.506+0000 7f8aff1c5640 1 -- 172.21.15.53:0/1571457191 shutdown_connections 2023-12-08T20:55:44.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.506+0000 7f8aff1c5640 1 --2- 172.21.15.53:0/1571457191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8af00467b0 0x7f8af004ba40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.506+0000 7f8aff1c5640 1 --2- 172.21.15.53:0/1571457191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af00e71c0 0x7f8af0046270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.506+0000 7f8aff1c5640 1 -- 172.21.15.53:0/1571457191 >> 172.21.15.53:0/1571457191 conn(0x7f8af0050160 msgr2=0x7f8af0050570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.506+0000 7f8aff1c5640 1 -- 172.21.15.53:0/1571457191 shutdown_connections 2023-12-08T20:55:44.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.506+0000 7f8aff1c5640 1 -- 172.21.15.53:0/1571457191 wait complete. 2023-12-08T20:55:44.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f8aff1c5640 1 Processor -- start 2023-12-08T20:55:44.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f8aff1c5640 1 -- start start 2023-12-08T20:55:44.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f70f9d9b640 1 -- 172.21.15.53:0/2959929922 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0a89b0 con 0x7f70f40dd290 2023-12-08T20:55:44.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f70f9d9b640 1 -- 172.21.15.53:0/2959929922 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec0a8b10 con 0x7f70f40dd290 2023-12-08T20:55:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f70f9d9b640 1 -- 172.21.15.53:0/2959929922 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0a8ea0 con 0x7f70f40dd290 2023-12-08T20:55:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f8aff1c5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af00467b0 0x7f8af00e5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f8aff1c5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af00dd290 0x7f8af00e2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f8aff1c5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8af00e71c0 0x7f8af00e2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f8aff1c5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af017c1a0 con 0x7f8af00e71c0 2023-12-08T20:55:44.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f8aff1c5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af00d8840 con 0x7f8af00dd290 2023-12-08T20:55:44.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f8aff1c5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af00dd9c0 con 0x7f8af00467b0 2023-12-08T20:55:44.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7fe02559a640 1 -- 172.21.15.53:0/2100262210 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0200a56d0 con 0x7fe0280c7440 2023-12-08T20:55:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 -- 172.21.15.53:0/2959929922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f40dd290 msgr2=0x7f70f40e66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 --2- 172.21.15.53:0/2959929922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f40dd290 0x7f70f40e66c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009870 tx=0x7f70ec01ecf0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 -- 172.21.15.53:0/2959929922 shutdown_connections 2023-12-08T20:55:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 --2- 172.21.15.53:0/2959929922 >> v2:172.21.15.53:3300/0 conn(0x7f70f40e71c0 0x7f70f40e6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 --2- 172.21.15.53:0/2959929922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f40dd290 0x7f70f40e66c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 -- 172.21.15.53:0/2959929922 >> 172.21.15.53:0/2959929922 conn(0x7f70f4050160 msgr2=0x7f70f4050570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 -- 172.21.15.53:0/2959929922 shutdown_connections 2023-12-08T20:55:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 -- 172.21.15.53:0/2959929922 wait complete. 2023-12-08T20:55:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f6880b10640 1 -- 172.21.15.53:0/1365425086 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740a5820 con 0x7f687c0c7a50 2023-12-08T20:55:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f6880b10640 1 -- 172.21.15.53:0/1365425086 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68740a5980 con 0x7f687c0c7a50 2023-12-08T20:55:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f6880b10640 1 -- 172.21.15.53:0/1365425086 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740a5d10 con 0x7f687c0c7a50 2023-12-08T20:55:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 Processor -- start 2023-12-08T20:55:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 -- start start 2023-12-08T20:55:44.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f6883d76640 1 -- 172.21.15.53:0/1365425086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f687c0c7a50 msgr2=0x7f687c071540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f6883d76640 1 --2- 172.21.15.53:0/1365425086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f687c0c7a50 0x7f687c071540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f687c0705e0 tx=0x7f687401c980 comp rx=0 tx=0).stop 2023-12-08T20:55:44.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f6883d76640 1 -- 172.21.15.53:0/1365425086 shutdown_connections 2023-12-08T20:55:44.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f6883d76640 1 --2- 172.21.15.53:0/1365425086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f687c0c7a50 0x7f687c071540 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f6883d76640 1 --2- 172.21.15.53:0/1365425086 >> v2:172.21.15.146:3300/0 conn(0x7f687c0c7670 0x7f687c0c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f6883d76640 1 -- 172.21.15.53:0/1365425086 >> 172.21.15.53:0/1365425086 conn(0x7f687c06e780 msgr2=0x7f687c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70f4046270 0x7f70f404a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f40dd290 0x7f70f4006e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f40e71c0 0x7f70f417c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4049080 con 0x7f70f4046270 2023-12-08T20:55:44.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4049360 con 0x7f70f40dd290 2023-12-08T20:55:44.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f710091a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f416ed00 con 0x7f70f40e71c0 2023-12-08T20:55:44.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f6883d76640 1 -- 172.21.15.53:0/1365425086 shutdown_connections 2023-12-08T20:55:44.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.510+0000 7f6883d76640 1 -- 172.21.15.53:0/1365425086 wait complete. 2023-12-08T20:55:44.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7f69ec8ab640 1 -- 172.21.15.53:0/3891615518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e80ceed0 msgr2=0x7f69e80cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7f69ec8ab640 1 --2- 172.21.15.53:0/3891615518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e80ceed0 0x7f69e80cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7f69ec8ab640 1 -- 172.21.15.53:0/3891615518 >> v1:172.21.15.146:6789/0 conn(0x7f69e8153910 legacy=0x7f69e815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7f69ec8ab640 1 -- 172.21.15.53:0/3891615518 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e80ca730 con 0x7f69e80ca2f0 2023-12-08T20:55:44.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7f6883d76640 1 Processor -- start 2023-12-08T20:55:44.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7f6883d76640 1 -- start start 2023-12-08T20:55:44.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7f6883d76640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f687c0c7670 0x7f687c1465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7f6883d76640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0c7a50 0x7f687c0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7f6883d76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f687c15e570 0x7f687c0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7f6883d76640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c1487b0 con 0x7f687c15e570 2023-12-08T20:55:44.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7f6883d76640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c070ff0 con 0x7f687c0c7a50 2023-12-08T20:55:44.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7f6883d76640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0ca730 con 0x7f687c0c7670 2023-12-08T20:55:44.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7fd2365bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2280d5c90 0x7fd2280d6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7fe02559a640 1 -- 172.21.15.53:0/2100262210 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0200a5830 con 0x7fe0280c7440 2023-12-08T20:55:44.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.514+0000 7fe02559a640 1 -- 172.21.15.53:0/2100262210 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0200a5bc0 con 0x7fe0280c7440 2023-12-08T20:55:44.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fd2365bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2280d5c90 0x7fd2280d6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56452/0 (socket says 172.21.15.53:56452) 2023-12-08T20:55:44.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fd2365bb640 1 -- 172.21.15.53:0/2648681311 learned_addr learned my addr 172.21.15.53:0/2648681311 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 -- 172.21.15.53:0/2100262210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0280c7440 msgr2=0x7fe0280c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 --2- 172.21.15.53:0/2100262210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0280c7440 0x7fe0280c7890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe0281571c0 tx=0x7fe02001c940 comp rx=0 tx=0).stop 2023-12-08T20:55:44.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 -- 172.21.15.53:0/2100262210 shutdown_connections 2023-12-08T20:55:44.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 --2- 172.21.15.53:0/2100262210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0280c7440 0x7fe0280c7890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 --2- 172.21.15.53:0/2100262210 >> v2:172.21.15.53:3300/0 conn(0x7fe02806ec30 0x7fe02806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 --2- 172.21.15.53:0/2100262210 >> v2:172.21.15.146:3300/0 conn(0x7fe028072510 0x7fe0280c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 -- 172.21.15.53:0/2100262210 >> 172.21.15.53:0/2100262210 conn(0x7fe02806a5b0 msgr2=0x7fe02806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 -- 172.21.15.53:0/2100262210 shutdown_connections 2023-12-08T20:55:44.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 -- 172.21.15.53:0/2100262210 wait complete. 2023-12-08T20:55:44.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7f8afe9c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8af00e71c0 0x7f8af00e2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7f8afe9c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8af00e71c0 0x7f8af00e2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56464/0 (socket says 172.21.15.53:56464) 2023-12-08T20:55:44.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7f8afe9c4640 1 -- 172.21.15.53:0/3409398591 learned_addr learned my addr 172.21.15.53:0/3409398591 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fdfbd59a640 1 -- 172.21.15.53:0/966239143 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00aa5f0 con 0x7fdfc01533c0 2023-12-08T20:55:44.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fdfbd59a640 1 -- 172.21.15.53:0/966239143 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb00aa750 con 0x7fdfc01533c0 2023-12-08T20:55:44.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fdfbd59a640 1 -- 172.21.15.53:0/966239143 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00aaae0 con 0x7fdfc01533c0 2023-12-08T20:55:44.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 Processor -- start 2023-12-08T20:55:44.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 -- start start 2023-12-08T20:55:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fdfbf59e640 1 -- 172.21.15.53:0/966239143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc01533c0 msgr2=0x7fdfc00c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fdfbf59e640 1 --2- 172.21.15.53:0/966239143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc01533c0 0x7fdfc00c53a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009870 tx=0x7fdfb001c4f0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fdfbf59e640 1 -- 172.21.15.53:0/966239143 shutdown_connections 2023-12-08T20:55:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fdfbf59e640 1 --2- 172.21.15.53:0/966239143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfc00c7980 0x7fdfc0159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fdfbf59e640 1 --2- 172.21.15.53:0/966239143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc01533c0 0x7fdfc00c53a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fdfbf59e640 1 -- 172.21.15.53:0/966239143 >> 172.21.15.53:0/966239143 conn(0x7fdfc006a5b0 msgr2=0x7fdfc006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe02806ec30 0x7fe028150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe028072510 0x7fe0281583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0280c7440 0x7fe028158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe028150110 con 0x7fe0280c7440 2023-12-08T20:55:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02814eb10 con 0x7fe02806ec30 2023-12-08T20:55:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fe02759e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02814e410 con 0x7fe028072510 2023-12-08T20:55:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fdfbf59e640 1 -- 172.21.15.53:0/966239143 shutdown_connections 2023-12-08T20:55:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7f0c9d07f640 1 -- 172.21.15.53:0/2011611928 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940ac640 con 0x7f0c900d7040 2023-12-08T20:55:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7f0c9d07f640 1 -- 172.21.15.53:0/2011611928 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c940ac7a0 con 0x7f0c900d7040 2023-12-08T20:55:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7f0c9d07f640 1 -- 172.21.15.53:0/2011611928 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940acb30 con 0x7f0c900d7040 2023-12-08T20:55:44.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.518+0000 7fdfbf59e640 1 -- 172.21.15.53:0/966239143 wait complete. 2023-12-08T20:55:44.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7fd2355b9640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd228047cc0 0x7fd2280df690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7f0ca02e5640 1 -- 172.21.15.53:0/2011611928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c900d7040 msgr2=0x7f0c9004e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7f0ca02e5640 1 --2- 172.21.15.53:0/2011611928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c900d7040 0x7f0c9004e160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0c90034cf0 tx=0x7f0c9401c420 comp rx=0 tx=0).stop 2023-12-08T20:55:44.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7f0ca02e5640 1 -- 172.21.15.53:0/2011611928 shutdown_connections 2023-12-08T20:55:44.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7f0ca02e5640 1 --2- 172.21.15.53:0/2011611928 >> v2:172.21.15.146:3300/0 conn(0x7f0c9004cd00 0x7f0c900dcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7f0ca02e5640 1 --2- 172.21.15.53:0/2011611928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c900d7040 0x7f0c9004e160 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7f0ca02e5640 1 -- 172.21.15.53:0/2011611928 >> 172.21.15.53:0/2011611928 conn(0x7f0c9000e840 msgr2=0x7f0c90052380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7fdfbf59e640 1 Processor -- start 2023-12-08T20:55:44.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7f0ca02e5640 1 -- 172.21.15.53:0/2011611928 shutdown_connections 2023-12-08T20:55:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7fdfbf59e640 1 -- start start 2023-12-08T20:55:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7fdfbf59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc00c58e0 0x7fdfc014c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7fdfbf59e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfc00c7980 0x7fdfc01fa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7fdfbf59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfc01533c0 0x7fdfc01f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7fdfbf59e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0158780 con 0x7fdfc01533c0 2023-12-08T20:55:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7fdfbf59e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0150760 con 0x7fdfc00c58e0 2023-12-08T20:55:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7fdfbf59e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc01f6800 con 0x7fdfc00c7980 2023-12-08T20:55:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7f0ca02e5640 1 -- 172.21.15.53:0/2011611928 wait complete. 2023-12-08T20:55:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7f0ca02e5640 1 Processor -- start 2023-12-08T20:55:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7f0ca02e5640 1 -- start start 2023-12-08T20:55:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.522+0000 7fd235dba640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd228046530 0x7fd2280dda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.526+0000 7f0ca02e5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c9004cd00 0x7f0c900dbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.526+0000 7f0ca02e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c900d7040 0x7f0c900c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.526+0000 7f0ca02e5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c900d5740 0x7f0c900c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.526+0000 7f0ca02e5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c90050a80 con 0x7f0c900d7040 2023-12-08T20:55:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.526+0000 7f0ca02e5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900c3bc0 con 0x7f0c9004cd00 2023-12-08T20:55:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.526+0000 7f0ca02e5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900c5970 con 0x7f0c900d5740 2023-12-08T20:55:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.526+0000 7fd2365bb640 1 -- 172.21.15.53:0/2648681311 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd228046530 msgr2=0x7fd2280dda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.526+0000 7fd2365bb640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd228046530 0x7fd2280dda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.526+0000 7fd2365bb640 1 -- 172.21.15.53:0/2648681311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd228047cc0 msgr2=0x7fd2280df690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.526+0000 7fd2365bb640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd228047cc0 0x7fd2280df690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.526+0000 7fd2365bb640 1 -- 172.21.15.53:0/2648681311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200094d0 con 0x7fd2280d5c90 2023-12-08T20:55:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.526+0000 7f8afd9c2640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af00dd290 0x7f8af00e2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.530+0000 7f8afe9c4640 1 -- 172.21.15.53:0/3409398591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af00467b0 msgr2=0x7f8af00e5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.530+0000 7f8afe9c4640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af00467b0 0x7f8af00e5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.530+0000 7f8afe9c4640 1 -- 172.21.15.53:0/3409398591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af00dd290 msgr2=0x7f8af00e2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.530+0000 7f8afe9c4640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af00dd290 0x7f8af00e2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.530+0000 7f8afe9c4640 1 -- 172.21.15.53:0/3409398591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af00d8280 con 0x7f8af00e71c0 2023-12-08T20:55:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.530+0000 7f70fa59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f40dd290 0x7f70f4006e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.530+0000 7f70fa59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f40dd290 0x7f70f4006e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40120/0 (socket says 172.21.15.53:40120) 2023-12-08T20:55:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.530+0000 7f70fa59c640 1 -- 172.21.15.53:0/2358564793 learned_addr learned my addr 172.21.15.53:0/2358564793 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.534+0000 7f69ec8ab640 1 --2- 172.21.15.53:0/3891615518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e80ca2f0 0x7f69e80c3e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f69d80097c0 tx=0x7f69d801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb2aaa2f8f88445 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.534+0000 7f70fb59e640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f40e71c0 0x7f70f417c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.534+0000 7f8afe9c4640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8af00e71c0 0x7f8af00e2b90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8af802cf20 tx=0x7f8af8098140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.538+0000 7fd2365bb640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2280d5c90 0x7fd2280d6580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00c440 tx=0x7fd22c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.538+0000 7f70fad9d640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70f4046270 0x7f70f404a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.542+0000 7f70fa59c640 1 -- 172.21.15.53:0/2358564793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f40e71c0 msgr2=0x7f70f417c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.542+0000 7f70fa59c640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f40e71c0 0x7f70f417c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.542+0000 7f70fa59c640 1 -- 172.21.15.53:0/2358564793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70f4046270 msgr2=0x7f70f404a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.542+0000 7f70fa59c640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70f4046270 0x7f70f404a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.542+0000 7f70fa59c640 1 -- 172.21.15.53:0/2358564793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec0094d0 con 0x7f70f40dd290 2023-12-08T20:55:44.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.546+0000 7f6882313640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f687c15e570 0x7f687c0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.546+0000 7f6881b12640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f687c0c7670 0x7f687c1465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.546+0000 7f8aeeffd640 1 -- 172.21.15.53:0/3409398591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8137070 con 0x7f8af00e71c0 2023-12-08T20:55:44.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.546+0000 7f8aeeffd640 1 -- 172.21.15.53:0/3409398591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af812d040 con 0x7f8af00e71c0 2023-12-08T20:55:44.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.546+0000 7f8aff1c5640 1 -- 172.21.15.53:0/3409398591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af00d8560 con 0x7f8af00e71c0 2023-12-08T20:55:44.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.546+0000 7f8aeeffd640 1 -- 172.21.15.53:0/3409398591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af812c050 con 0x7f8af00e71c0 2023-12-08T20:55:44.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.546+0000 7f8aff1c5640 1 -- 172.21.15.53:0/3409398591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af00ddc10 con 0x7f8af00e71c0 2023-12-08T20:55:44.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.546+0000 7f6881b12640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f687c0c7670 0x7f687c1465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:43996/0 (socket says 172.21.15.53:43996) 2023-12-08T20:55:44.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.546+0000 7f6881b12640 1 -- 172.21.15.53:0/2614221546 learned_addr learned my addr 172.21.15.53:0/2614221546 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.546+0000 7f8aff1c5640 1 -- 172.21.15.53:0/3409398591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8af004c940 con 0x7f8af00e71c0 2023-12-08T20:55:44.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.550+0000 7fdfbe59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc00c58e0 0x7fdfc014c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.550+0000 7fdfbe59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc00c58e0 0x7fdfc014c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40140/0 (socket says 172.21.15.53:40140) 2023-12-08T20:55:44.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.550+0000 7fdfbe59c640 1 -- 172.21.15.53:0/3644605778 learned_addr learned my addr 172.21.15.53:0/3644605778 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.554+0000 7fe026d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0280c7440 0x7fe028158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.558+0000 7fdfbdd9b640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfc00c7980 0x7fdfc01fa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.558+0000 7f6882313640 1 -- 172.21.15.53:0/2614221546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f687c0c7670 msgr2=0x7f687c1465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.558+0000 7f6882313640 1 --2- 172.21.15.53:0/2614221546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f687c0c7670 0x7f687c1465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.558+0000 7f6882313640 1 -- 172.21.15.53:0/2614221546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0c7a50 msgr2=0x7f687c0c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.558+0000 7f6882313640 1 --2- 172.21.15.53:0/2614221546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0c7a50 0x7f687c0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.558+0000 7f6882313640 1 -- 172.21.15.53:0/2614221546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6874009b30 con 0x7f687c15e570 2023-12-08T20:55:44.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.558+0000 7f69dffff640 1 -- 172.21.15.53:0/3891615518 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d80a8910 con 0x7f69e80ca2f0 2023-12-08T20:55:44.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69dffff640 1 -- 172.21.15.53:0/3891615518 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d80a8a70 con 0x7f69e80ca2f0 2023-12-08T20:55:44.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69dffff640 1 -- 172.21.15.53:0/3891615518 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d80a8e40 con 0x7f69e80ca2f0 2023-12-08T20:55:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 -- 172.21.15.53:0/3891615518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e80ca2f0 msgr2=0x7f69e80c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 --2- 172.21.15.53:0/3891615518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e80ca2f0 0x7f69e80c3e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f69d80097c0 tx=0x7f69d801ec50 comp rx=0 tx=0).stop 2023-12-08T20:55:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 -- 172.21.15.53:0/3891615518 shutdown_connections 2023-12-08T20:55:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 --2- 172.21.15.53:0/3891615518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e80ceed0 0x7f69e80cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 --2- 172.21.15.53:0/3891615518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e80ca2f0 0x7f69e80c3e20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 -- 172.21.15.53:0/3891615518 >> 172.21.15.53:0/3891615518 conn(0x7f69e808afc0 msgr2=0x7f69e808b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 -- 172.21.15.53:0/3891615518 shutdown_connections 2023-12-08T20:55:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 -- 172.21.15.53:0/3891615518 wait complete. 2023-12-08T20:55:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 Processor -- start 2023-12-08T20:55:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 -- start start 2023-12-08T20:55:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e80ca2f0 0x7f69e81582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80ceed0 0x7f69e80c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e8153910 0x7f69e80c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8150b60 con 0x7f69e80ca2f0 2023-12-08T20:55:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e815b2d0 con 0x7f69e80ceed0 2023-12-08T20:55:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7f69ef310640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e815b850 con 0x7f69e8153910 2023-12-08T20:55:44.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7fe026d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0280c7440 0x7fe028158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56476/0 (socket says 172.21.15.53:56476) 2023-12-08T20:55:44.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.562+0000 7fe026d9d640 1 -- 172.21.15.53:0/3370355312 learned_addr learned my addr 172.21.15.53:0/3370355312 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7fdfbe59c640 1 -- 172.21.15.53:0/3644605778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfc00c7980 msgr2=0x7fdfc01fa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7fdfbe59c640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfc00c7980 0x7fdfc01fa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7fdfbe59c640 1 -- 172.21.15.53:0/3644605778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfc01533c0 msgr2=0x7fdfc01f6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7fdfbe59c640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfc01533c0 0x7fdfc01f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7fdfbe59c640 1 -- 172.21.15.53:0/3644605778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00094d0 con 0x7fdfc00c58e0 2023-12-08T20:55:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7f6882313640 1 --2- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f687c15e570 0x7f687c0c90d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f68740ab000 tx=0x7f6874019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7f70fa59c640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f40dd290 0x7f70f4006e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f70f000b550 tx=0x7f70f000ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7fd2267fc640 1 -- 172.21.15.53:0/2648681311 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c003600 con 0x7fd2280d5c90 2023-12-08T20:55:44.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7fd2267fc640 1 -- 172.21.15.53:0/2648681311 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c003780 con 0x7fd2280d5c90 2023-12-08T20:55:44.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7fd2267fc640 1 -- 172.21.15.53:0/2648681311 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c003b30 con 0x7fd2280d5c90 2023-12-08T20:55:44.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7fd236dbc640 1 -- 172.21.15.53:0/2648681311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2280dd2a0 con 0x7fd2280d5c90 2023-12-08T20:55:44.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7fd236dbc640 1 -- 172.21.15.53:0/2648681311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd228177ec0 con 0x7fd2280d5c90 2023-12-08T20:55:44.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.566+0000 7fd236dbc640 1 -- 172.21.15.53:0/2648681311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2280d6070 con 0x7fd2280d5c90 2023-12-08T20:55:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.570+0000 7fe02659c640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe02806ec30 0x7fe028150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.570+0000 7fe026d9d640 1 -- 172.21.15.53:0/3370355312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe028072510 msgr2=0x7fe0281583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.570+0000 7fe026d9d640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe028072510 0x7fe0281583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.570+0000 7fe026d9d640 1 -- 172.21.15.53:0/3370355312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe02806ec30 msgr2=0x7fe028150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.570+0000 7fe026d9d640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe02806ec30 0x7fe028150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.570+0000 7fe026d9d640 1 -- 172.21.15.53:0/3370355312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe020009b30 con 0x7fe0280c7440 2023-12-08T20:55:44.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.578+0000 7f0c9e882640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c900d5740 0x7f0c900c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.578+0000 7f69ed8ad640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e8153910 0x7f69e80c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.578+0000 7f0c9e882640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c900d5740 0x7f0c900c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:44020/0 (socket says 172.21.15.53:44020) 2023-12-08T20:55:44.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.578+0000 7f0c9e882640 1 -- 172.21.15.53:0/3170977242 learned_addr learned my addr 172.21.15.53:0/3170977242 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.578+0000 7f69ed8ad640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e8153910 0x7f69e80c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:44036/0 (socket says 172.21.15.53:44036) 2023-12-08T20:55:44.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.578+0000 7f69ed8ad640 1 -- 172.21.15.53:0/151967036 learned_addr learned my addr 172.21.15.53:0/151967036 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.586+0000 7fdfbe59c640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc00c58e0 0x7fdfc014c100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00ac040 tx=0x7fdfb001ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.586+0000 7fe026d9d640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0280c7440 0x7fe028158930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe02001aff0 tx=0x7fe0200196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.586+0000 7f69ed0ac640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e80ca2f0 0x7f69e81582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.586+0000 7f0c9e081640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c9004cd00 0x7f0c900dbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.586+0000 7f68727fc640 1 -- 172.21.15.53:0/2614221546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874009250 con 0x7f687c15e570 2023-12-08T20:55:44.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.586+0000 7f68727fc640 1 -- 172.21.15.53:0/2614221546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68740b8680 con 0x7f687c15e570 2023-12-08T20:55:44.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.586+0000 7f6883d76640 1 -- 172.21.15.53:0/2614221546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687c141d50 con 0x7f687c15e570 2023-12-08T20:55:44.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.586+0000 7f68727fc640 1 -- 172.21.15.53:0/2614221546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740b8a30 con 0x7f687c15e570 2023-12-08T20:55:44.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.586+0000 7f6883d76640 1 -- 172.21.15.53:0/2614221546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c148a00 con 0x7f687c15e570 2023-12-08T20:55:44.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.586+0000 7f6883d76640 1 -- 172.21.15.53:0/2614221546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f687c071a80 con 0x7f687c15e570 2023-12-08T20:55:44.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.590+0000 7f0c9d880640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c900d7040 0x7f0c900c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.590+0000 7f69ec8ab640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80ceed0 0x7f69e80c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.590+0000 7f0c9e882640 1 -- 172.21.15.53:0/3170977242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c9004cd00 msgr2=0x7f0c900dbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.590+0000 7f0c9e882640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c9004cd00 0x7f0c900dbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.594+0000 7f0c9e882640 1 -- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c900d7040 msgr2=0x7f0c900c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.594+0000 7f0c9e882640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c900d7040 0x7f0c900c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.594+0000 7f0c9e882640 1 -- 172.21.15.53:0/3170977242 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c94009420 con 0x7f0c900d5740 2023-12-08T20:55:44.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.602+0000 7f0c9e882640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c900d5740 0x7f0c900c8b40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c98074b00 tx=0x7f0c98068250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.602+0000 7fd2267fc640 1 -- 172.21.15.53:0/2648681311 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd22c003c90 con 0x7fd2280d5c90 2023-12-08T20:55:44.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.602+0000 7fd2267fc640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd2140664f0 0x7fd2140689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.606+0000 7fd235dba640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd2140664f0 0x7fd2140689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.606+0000 7fd235dba640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd2140664f0 0x7fd2140689b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd230064230 tx=0x7fd230068f10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.610+0000 7f69ed8ad640 1 -- 172.21.15.53:0/151967036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80ceed0 msgr2=0x7f69e80c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.610+0000 7f69ed8ad640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80ceed0 0x7f69e80c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.610+0000 7f69ed8ad640 1 -- 172.21.15.53:0/151967036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e80ca2f0 msgr2=0x7f69e81582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.610+0000 7f69ed8ad640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e80ca2f0 0x7f69e81582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.610+0000 7f69ed8ad640 1 -- 172.21.15.53:0/151967036 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d8009420 con 0x7f69e8153910 2023-12-08T20:55:44.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.610+0000 7fd2267fc640 1 -- 172.21.15.53:0/2648681311 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd22c055420 con 0x7fd2280d5c90 2023-12-08T20:55:44.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.614+0000 7fd2267fc640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] conn(0x7fd21406fab0 0x7fd214071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.614+0000 7fd2267fc640 1 -- 172.21.15.53:0/2648681311 --> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2140725c0 con 0x7fd21406fab0 2023-12-08T20:55:44.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.614+0000 7fd2267fc640 1 -- 172.21.15.53:0/2648681311 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd22c051060 con 0x7fd2280d5c90 2023-12-08T20:55:44.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.614+0000 7fd2355b9640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] conn(0x7fd21406fab0 0x7fd214071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.614+0000 7fd2355b9640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] conn(0x7fd21406fab0 0x7fd214071ef0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.614+0000 7fd2267fc640 1 -- 172.21.15.53:0/2648681311 <== osd.5 v2:172.21.15.146:6808/2662713833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd2140725c0 con 0x7fd21406fab0 2023-12-08T20:55:44.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7f70e37fe640 1 -- 172.21.15.53:0/2358564793 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0010870 con 0x7f70f40dd290 2023-12-08T20:55:44.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7f70e37fe640 1 -- 172.21.15.53:0/2358564793 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f00109f0 con 0x7f70f40dd290 2023-12-08T20:55:44.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7f70e37fe640 1 -- 172.21.15.53:0/2358564793 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0010da0 con 0x7f70f40dd290 2023-12-08T20:55:44.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7f710091a640 1 -- 172.21.15.53:0/2358564793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f416efe0 con 0x7f70f40dd290 2023-12-08T20:55:44.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7f710091a640 1 -- 172.21.15.53:0/2358564793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f4048b10 con 0x7f70f40dd290 2023-12-08T20:55:44.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7f710091a640 1 -- 172.21.15.53:0/2358564793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70f40494d0 con 0x7f70f40dd290 2023-12-08T20:55:44.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7f69ed8ad640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e8153910 0x7f69e80c78a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69e000b970 tx=0x7f69e000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7fdfaeffd640 1 -- 172.21.15.53:0/3644605778 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00b3800 con 0x7fdfc00c58e0 2023-12-08T20:55:44.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7fdfaeffd640 1 -- 172.21.15.53:0/3644605778 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb00b3980 con 0x7fdfc00c58e0 2023-12-08T20:55:44.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7fdfbf59e640 1 -- 172.21.15.53:0/3644605778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc014a790 con 0x7fdfc00c58e0 2023-12-08T20:55:44.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7fdfaeffd640 1 -- 172.21.15.53:0/3644605778 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00b3d30 con 0x7fdfc00c58e0 2023-12-08T20:55:44.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7fdfbf59e640 1 -- 172.21.15.53:0/3644605778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc0150c50 con 0x7fdfc00c58e0 2023-12-08T20:55:44.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.622+0000 7fdfbf59e640 1 -- 172.21.15.53:0/3644605778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdfc015d220 con 0x7fdfc00c58e0 2023-12-08T20:55:44.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.630+0000 7f68727fc640 1 -- 172.21.15.53:0/2614221546 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68740b8b90 con 0x7f687c15e570 2023-12-08T20:55:44.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.630+0000 7f68727fc640 1 --2- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f68600664c0 0x7f6860068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.630+0000 7f6881b12640 1 --2- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f68600664c0 0x7f6860068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.630+0000 7f6881b12640 1 --2- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f68600664c0 0x7f6860068980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f686c00ab90 tx=0x7f686c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.630+0000 7fd236dbc640 1 -- 172.21.15.53:0/2648681311 --> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd22804c890 con 0x7fd21406fab0 2023-12-08T20:55:44.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7fd2267fc640 1 -- 172.21.15.53:0/2648681311 <== osd.5 v2:172.21.15.146:6808/2662713833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd2200ac820 con 0x7fd21406fab0 2023-12-08T20:55:44.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7fd236dbc640 1 -- 172.21.15.53:0/2648681311 >> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] conn(0x7fd21406fab0 msgr2=0x7fd214071ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7fd236dbc640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] conn(0x7fd21406fab0 0x7fd214071ef0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7fd236dbc640 1 -- 172.21.15.53:0/2648681311 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd2140664f0 msgr2=0x7fd2140689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7fd236dbc640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd2140664f0 0x7fd2140689b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd230064230 tx=0x7fd230068f10 comp rx=0 tx=0).stop 2023-12-08T20:55:44.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7fd236dbc640 1 -- 172.21.15.53:0/2648681311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2280d5c90 msgr2=0x7fd2280d6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7fd236dbc640 1 --2- 172.21.15.53:0/2648681311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2280d5c90 0x7fd2280d6580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00c440 tx=0x7fd22c00c900 comp rx=0 tx=0).stop 2023-12-08T20:55:44.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7fd2365bb640 1 -- 172.21.15.53:0/2648681311 reap_dead start 2023-12-08T20:55:44.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7fd236dbc640 1 -- 172.21.15.53:0/2648681311 shutdown_connections 2023-12-08T20:55:44.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7fd236dbc640 1 -- 172.21.15.53:0/2648681311 >> 172.21.15.53:0/2648681311 conn(0x7fd228051270 msgr2=0x7fd2280d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7fd236dbc640 1 -- 172.21.15.53:0/2648681311 shutdown_connections 2023-12-08T20:55:44.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7fd236dbc640 1 -- 172.21.15.53:0/2648681311 wait complete. 2023-12-08T20:55:44.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7f68727fc640 1 -- 172.21.15.53:0/2614221546 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68740f0ec0 con 0x7f687c15e570 2023-12-08T20:55:44.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7f68727fc640 1 --2- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] conn(0x7f686006fa80 0x7f6860071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7f68727fc640 1 -- 172.21.15.53:0/2614221546 --> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6860072590 con 0x7f686006fa80 2023-12-08T20:55:44.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7f68727fc640 1 -- 172.21.15.53:0/2614221546 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68740ecb00 con 0x7f687c15e570 2023-12-08T20:55:44.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7f6881311640 1 --2- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] conn(0x7f686006fa80 0x7f6860071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7f6881311640 1 --2- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] conn(0x7f686006fa80 0x7f6860071ec0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.634+0000 7f68727fc640 1 -- 172.21.15.53:0/2614221546 <== osd.2 v2:172.21.15.53:6802/2948930321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6860072590 con 0x7f686006fa80 2023-12-08T20:55:44.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.638+0000 7f0c8effd640 1 -- 172.21.15.53:0/3170977242 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9808f070 con 0x7f0c900d5740 2023-12-08T20:55:44.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.638+0000 7f0c8effd640 1 -- 172.21.15.53:0/3170977242 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9806ce50 con 0x7f0c900d5740 2023-12-08T20:55:44.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.638+0000 7f0ca02e5640 1 -- 172.21.15.53:0/3170977242 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c900c7e20 con 0x7f0c900d5740 2023-12-08T20:55:44.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.638+0000 7f0c8effd640 1 -- 172.21.15.53:0/3170977242 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98072560 con 0x7f0c900d5740 2023-12-08T20:55:44.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.638+0000 7f0ca02e5640 1 -- 172.21.15.53:0/3170977242 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c900c5690 con 0x7f0c900d5740 2023-12-08T20:55:44.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.638+0000 7f0ca02e5640 1 -- 172.21.15.53:0/3170977242 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c900dd710 con 0x7f0c900d5740 2023-12-08T20:55:44.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.638+0000 7f69ddffb640 1 -- 172.21.15.53:0/151967036 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000cb40 con 0x7f69e8153910 2023-12-08T20:55:44.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.638+0000 7f69ddffb640 1 -- 172.21.15.53:0/151967036 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000ccc0 con 0x7f69e8153910 2023-12-08T20:55:44.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.638+0000 7f69ddffb640 1 -- 172.21.15.53:0/151967036 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0014680 con 0x7f69e8153910 2023-12-08T20:55:44.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.638+0000 7f69ef310640 1 -- 172.21.15.53:0/151967036 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e8150d70 con 0x7f69e8153910 2023-12-08T20:55:44.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.638+0000 7f69ef310640 1 -- 172.21.15.53:0/151967036 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e815b4e0 con 0x7f69e8153910 2023-12-08T20:55:44.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.638+0000 7f69ef310640 1 -- 172.21.15.53:0/151967036 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69e80cb9a0 con 0x7f69e8153910 2023-12-08T20:55:44.651 INFO:teuthology.orchestra.run.smithi053.stdout:64424509462 2023-12-08T20:55:44.651 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-08T20:55:44.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f8aeeffd640 1 -- 172.21.15.53:0/3409398591 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8af81317d0 con 0x7f8af00e71c0 2023-12-08T20:55:44.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f6883d76640 1 -- 172.21.15.53:0/2614221546 --> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f687c15dd70 con 0x7f686006fa80 2023-12-08T20:55:44.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f8aeeffd640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8adc066470 0x7f8adc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f8afe1c3640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8adc066470 0x7f8adc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f68727fc640 1 -- 172.21.15.53:0/2614221546 <== osd.2 v2:172.21.15.53:6802/2948930321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6878009280 con 0x7f686006fa80 2023-12-08T20:55:44.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f8afe1c3640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8adc066470 0x7f8adc068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8af4001600 tx=0x7f8af4007a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f6883d76640 1 -- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] conn(0x7f686006fa80 msgr2=0x7f6860071ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f6883d76640 1 --2- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] conn(0x7f686006fa80 0x7f6860071ec0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f6883d76640 1 -- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f68600664c0 msgr2=0x7f6860068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f6883d76640 1 --2- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f68600664c0 0x7f6860068980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f686c00ab90 tx=0x7f686c008040 comp rx=0 tx=0).stop 2023-12-08T20:55:44.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f6883d76640 1 -- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f687c15e570 msgr2=0x7f687c0c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f6883d76640 1 --2- 172.21.15.53:0/2614221546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f687c15e570 0x7f687c0c90d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f68740ab000 tx=0x7f6874019720 comp rx=0 tx=0).stop 2023-12-08T20:55:44.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f6882313640 1 -- 172.21.15.53:0/2614221546 reap_dead start 2023-12-08T20:55:44.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f6883d76640 1 -- 172.21.15.53:0/2614221546 shutdown_connections 2023-12-08T20:55:44.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.650+0000 7f6883d76640 1 -- 172.21.15.53:0/2614221546 >> 172.21.15.53:0/2614221546 conn(0x7f687c06e780 msgr2=0x7f687c0c4160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.654+0000 7f6883d76640 1 -- 172.21.15.53:0/2614221546 shutdown_connections 2023-12-08T20:55:44.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.654+0000 7f6883d76640 1 -- 172.21.15.53:0/2614221546 wait complete. 2023-12-08T20:55:44.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.658+0000 7f8aeeffd640 1 -- 172.21.15.53:0/3409398591 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8af816dab0 con 0x7f8af00e71c0 2023-12-08T20:55:44.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.658+0000 7f8aeeffd640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] conn(0x7f8adc06f9b0 0x7f8adc071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.658+0000 7f8aeeffd640 1 -- 172.21.15.53:0/3409398591 --> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8adc0724c0 con 0x7f8adc06f9b0 2023-12-08T20:55:44.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.658+0000 7f8aeeffd640 1 -- 172.21.15.53:0/3409398591 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8af81696f0 con 0x7f8af00e71c0 2023-12-08T20:55:44.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.658+0000 7f8afd9c2640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] conn(0x7f8adc06f9b0 0x7f8adc071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.658+0000 7f8afd9c2640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] conn(0x7f8adc06f9b0 0x7f8adc071df0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.658+0000 7f8aeeffd640 1 -- 172.21.15.53:0/3409398591 <== osd.1 v2:172.21.15.53:6826/3198496294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8adc0724c0 con 0x7f8adc06f9b0 2023-12-08T20:55:44.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.658+0000 7fe016ffd640 1 -- 172.21.15.53:0/3370355312 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0200b8670 con 0x7fe0280c7440 2023-12-08T20:55:44.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.658+0000 7fe016ffd640 1 -- 172.21.15.53:0/3370355312 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0200b87d0 con 0x7fe0280c7440 2023-12-08T20:55:44.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.658+0000 7fe02759e640 1 -- 172.21.15.53:0/3370355312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0281f71f0 con 0x7fe0280c7440 2023-12-08T20:55:44.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.658+0000 7fe016ffd640 1 -- 172.21.15.53:0/3370355312 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0200b8b80 con 0x7fe0280c7440 2023-12-08T20:55:44.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.658+0000 7fe02759e640 1 -- 172.21.15.53:0/3370355312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02814fa50 con 0x7fe0280c7440 2023-12-08T20:55:44.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.662+0000 7fe014ff9640 1 -- 172.21.15.53:0/3370355312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe000000fd0 con 0x7fe0280c7440 2023-12-08T20:55:44.670 INFO:teuthology.orchestra.run.smithi053.stdout:64424509461 2023-12-08T20:55:44.670 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-08T20:55:44.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8aff1c5640 1 -- 172.21.15.53:0/3409398591 --> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8af0005370 con 0x7f8adc06f9b0 2023-12-08T20:55:44.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8aeeffd640 1 -- 172.21.15.53:0/3409398591 <== osd.1 v2:172.21.15.53:6826/3198496294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8af0005370 con 0x7f8adc06f9b0 2023-12-08T20:55:44.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8aff1c5640 1 -- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] conn(0x7f8adc06f9b0 msgr2=0x7f8adc071df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8aff1c5640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] conn(0x7f8adc06f9b0 0x7f8adc071df0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8aff1c5640 1 -- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8adc066470 msgr2=0x7f8adc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8aff1c5640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8adc066470 0x7f8adc068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8af4001600 tx=0x7f8af4007a50 comp rx=0 tx=0).stop 2023-12-08T20:55:44.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8aff1c5640 1 -- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8af00e71c0 msgr2=0x7f8af00e2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8aff1c5640 1 --2- 172.21.15.53:0/3409398591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8af00e71c0 0x7f8af00e2b90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8af802cf20 tx=0x7f8af8098140 comp rx=0 tx=0).stop 2023-12-08T20:55:44.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8afe9c4640 1 -- 172.21.15.53:0/3409398591 reap_dead start 2023-12-08T20:55:44.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8aff1c5640 1 -- 172.21.15.53:0/3409398591 shutdown_connections 2023-12-08T20:55:44.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8aff1c5640 1 -- 172.21.15.53:0/3409398591 >> 172.21.15.53:0/3409398591 conn(0x7f8af0050160 msgr2=0x7f8af00db3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8aff1c5640 1 -- 172.21.15.53:0/3409398591 shutdown_connections 2023-12-08T20:55:44.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.678+0000 7f8aff1c5640 1 -- 172.21.15.53:0/3409398591 wait complete. 2023-12-08T20:55:44.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.690+0000 7fe016ffd640 1 -- 172.21.15.53:0/3370355312 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0200b8ce0 con 0x7fe0280c7440 2023-12-08T20:55:44.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.690+0000 7fe016ffd640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe0080664c0 0x7fe008068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.690+0000 7fe02659c640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe0080664c0 0x7fe008068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.690+0000 7fe02659c640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe0080664c0 0x7fe008068980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00a830 tx=0x7fe01c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.694+0000 7fe016ffd640 1 -- 172.21.15.53:0/3370355312 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe0200f1530 con 0x7fe0280c7440 2023-12-08T20:55:44.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.694+0000 7fe016ffd640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] conn(0x7fe00806fa80 0x7fe008071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.694+0000 7fe016ffd640 1 -- 172.21.15.53:0/3370355312 --> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe008072590 con 0x7fe00806fa80 2023-12-08T20:55:44.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.694+0000 7fe016ffd640 1 -- 172.21.15.53:0/3370355312 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0200ed170 con 0x7fe0280c7440 2023-12-08T20:55:44.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.694+0000 7fe025d9b640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] conn(0x7fe00806fa80 0x7fe008071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.696 INFO:teuthology.orchestra.run.smithi053.stdout:64424509463 2023-12-08T20:55:44.696 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-08T20:55:44.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.694+0000 7fe025d9b640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] conn(0x7fe00806fa80 0x7fe008071ec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.698+0000 7fe016ffd640 1 -- 172.21.15.53:0/3370355312 <== osd.4 v2:172.21.15.146:6800/2537824411 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe008072590 con 0x7fe00806fa80 2023-12-08T20:55:44.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.698+0000 7f0c8effd640 1 -- 172.21.15.53:0/3170977242 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0c980726c0 con 0x7f0c900d5740 2023-12-08T20:55:44.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.698+0000 7f0c8effd640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0c7c0664f0 0x7f0c7c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.698+0000 7f0c9e081640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0c7c0664f0 0x7f0c7c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.702+0000 7f0c9e081640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0c7c0664f0 0x7f0c7c0689b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c940ae000 tx=0x7f0c94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.702+0000 7fdfaeffd640 1 -- 172.21.15.53:0/3644605778 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdfb00b2380 con 0x7fdfc00c58e0 2023-12-08T20:55:44.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.702+0000 7fdfaeffd640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdfa0066470 0x7fdfa0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.702+0000 7fdfbdd9b640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdfa0066470 0x7fdfa0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.702+0000 7fdfbdd9b640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdfa0066470 0x7fdfa0068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdfc015a540 tx=0x7fdfb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.706+0000 7f0c8effd640 1 -- 172.21.15.53:0/3170977242 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0c980cf090 con 0x7f0c900d5740 2023-12-08T20:55:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.706+0000 7f0c8effd640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] conn(0x7f0c7c06fa30 0x7f0c7c071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.710+0000 7f0c8effd640 1 -- 172.21.15.53:0/3170977242 --> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c7c072540 con 0x7f0c7c06fa30 2023-12-08T20:55:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.710+0000 7f0c9d880640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] conn(0x7f0c7c06fa30 0x7f0c7c071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.710+0000 7f0c9d880640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] conn(0x7f0c7c06fa30 0x7f0c7c071e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.710+0000 7f0c8effd640 1 -- 172.21.15.53:0/3170977242 <== osd.0 v2:172.21.15.53:6811/1090159332 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0c7c072540 con 0x7f0c7c06fa30 2023-12-08T20:55:44.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.714+0000 7fe014ff9640 1 -- 172.21.15.53:0/3370355312 --> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe000002cc0 con 0x7fe00806fa80 2023-12-08T20:55:44.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.714+0000 7fe016ffd640 1 -- 172.21.15.53:0/3370355312 <== osd.4 v2:172.21.15.146:6800/2537824411 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe000002cc0 con 0x7fe00806fa80 2023-12-08T20:55:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.714+0000 7fe014ff9640 1 -- 172.21.15.53:0/3370355312 >> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] conn(0x7fe00806fa80 msgr2=0x7fe008071ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.714+0000 7fe014ff9640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] conn(0x7fe00806fa80 0x7fe008071ec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.714+0000 7fe014ff9640 1 -- 172.21.15.53:0/3370355312 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe0080664c0 msgr2=0x7fe008068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.714+0000 7fe014ff9640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe0080664c0 0x7fe008068980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00a830 tx=0x7fe01c008040 comp rx=0 tx=0).stop 2023-12-08T20:55:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.714+0000 7fe014ff9640 1 -- 172.21.15.53:0/3370355312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0280c7440 msgr2=0x7fe028158930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.714+0000 7fe014ff9640 1 --2- 172.21.15.53:0/3370355312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0280c7440 0x7fe028158930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe02001aff0 tx=0x7fe0200196e0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.714+0000 7fe026d9d640 1 -- 172.21.15.53:0/3370355312 reap_dead start 2023-12-08T20:55:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.714+0000 7fe014ff9640 1 -- 172.21.15.53:0/3370355312 shutdown_connections 2023-12-08T20:55:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.714+0000 7fe014ff9640 1 -- 172.21.15.53:0/3370355312 >> 172.21.15.53:0/3370355312 conn(0x7fe02806a5b0 msgr2=0x7fe0280c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.718+0000 7fe014ff9640 1 -- 172.21.15.53:0/3370355312 shutdown_connections 2023-12-08T20:55:44.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.718+0000 7fe014ff9640 1 -- 172.21.15.53:0/3370355312 wait complete. 2023-12-08T20:55:44.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.726+0000 7f0c8effd640 1 -- 172.21.15.53:0/3170977242 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c980cb3d0 con 0x7f0c900d5740 2023-12-08T20:55:44.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.730+0000 7fdfaeffd640 1 -- 172.21.15.53:0/3644605778 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdfb00a7070 con 0x7fdfc00c58e0 2023-12-08T20:55:44.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.730+0000 7fdfaeffd640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] conn(0x7fdfa006f930 0x7fdfa0071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.730+0000 7fdfaeffd640 1 -- 172.21.15.53:0/3644605778 --> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfa0072440 con 0x7fdfa006f930 2023-12-08T20:55:44.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.730+0000 7fdfbed9d640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] conn(0x7fdfa006f930 0x7fdfa0071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.730+0000 7fdfbed9d640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] conn(0x7fdfa006f930 0x7fdfa0071d70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.730+0000 7fdfaeffd640 1 -- 172.21.15.53:0/3644605778 <== osd.3 v2:172.21.15.53:6810/3377657133 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fdfa0072440 con 0x7fdfa006f930 2023-12-08T20:55:44.735 INFO:teuthology.orchestra.run.smithi053.stdout:60129542164 2023-12-08T20:55:44.735 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-08T20:55:44.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.738+0000 7fdfaeffd640 1 -- 172.21.15.53:0/3644605778 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfb00eb830 con 0x7fdfc00c58e0 2023-12-08T20:55:44.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.738+0000 7f0ca02e5640 1 -- 172.21.15.53:0/3170977242 --> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c900057c0 con 0x7f0c7c06fa30 2023-12-08T20:55:44.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.738+0000 7f0c8effd640 1 -- 172.21.15.53:0/3170977242 <== osd.0 v2:172.21.15.53:6811/1090159332 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c900057c0 con 0x7f0c7c06fa30 2023-12-08T20:55:44.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.742+0000 7f0ca02e5640 1 -- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] conn(0x7f0c7c06fa30 msgr2=0x7f0c7c071e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.742+0000 7f0ca02e5640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] conn(0x7f0c7c06fa30 0x7f0c7c071e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.742+0000 7f0ca02e5640 1 -- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0c7c0664f0 msgr2=0x7f0c7c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.742+0000 7f0ca02e5640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0c7c0664f0 0x7f0c7c0689b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c940ae000 tx=0x7f0c94008040 comp rx=0 tx=0).stop 2023-12-08T20:55:44.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.742+0000 7f0ca02e5640 1 -- 172.21.15.53:0/3170977242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c900d5740 msgr2=0x7f0c900c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.742+0000 7f0ca02e5640 1 --2- 172.21.15.53:0/3170977242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c900d5740 0x7f0c900c8b40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c98074b00 tx=0x7f0c98068250 comp rx=0 tx=0).stop 2023-12-08T20:55:44.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.742+0000 7f0c9e882640 1 -- 172.21.15.53:0/3170977242 reap_dead start 2023-12-08T20:55:44.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.742+0000 7f0ca02e5640 1 -- 172.21.15.53:0/3170977242 shutdown_connections 2023-12-08T20:55:44.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.742+0000 7f0ca02e5640 1 -- 172.21.15.53:0/3170977242 >> 172.21.15.53:0/3170977242 conn(0x7f0c9000e840 msgr2=0x7f0c900c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.742+0000 7f0ca02e5640 1 -- 172.21.15.53:0/3170977242 shutdown_connections 2023-12-08T20:55:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.742+0000 7f0ca02e5640 1 -- 172.21.15.53:0/3170977242 wait complete. 2023-12-08T20:55:44.763 INFO:teuthology.orchestra.run.smithi053.stdout:64424509462 2023-12-08T20:55:44.764 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-08T20:55:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfbf59e640 1 -- 172.21.15.53:0/3644605778 --> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdfc015cf40 con 0x7fdfa006f930 2023-12-08T20:55:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfaeffd640 1 -- 172.21.15.53:0/3644605778 <== osd.3 v2:172.21.15.53:6810/3377657133 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdfb800a720 con 0x7fdfa006f930 2023-12-08T20:55:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfbf59e640 1 -- 172.21.15.53:0/3644605778 >> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] conn(0x7fdfa006f930 msgr2=0x7fdfa0071d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfbf59e640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] conn(0x7fdfa006f930 0x7fdfa0071d70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfbf59e640 1 -- 172.21.15.53:0/3644605778 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdfa0066470 msgr2=0x7fdfa0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfbf59e640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdfa0066470 0x7fdfa0068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdfc015a540 tx=0x7fdfb4008040 comp rx=0 tx=0).stop 2023-12-08T20:55:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfbf59e640 1 -- 172.21.15.53:0/3644605778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc00c58e0 msgr2=0x7fdfc014c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfbf59e640 1 --2- 172.21.15.53:0/3644605778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc00c58e0 0x7fdfc014c100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00ac040 tx=0x7fdfb001ad30 comp rx=0 tx=0).stop 2023-12-08T20:55:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfbed9d640 1 -- 172.21.15.53:0/3644605778 reap_dead start 2023-12-08T20:55:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfbf59e640 1 -- 172.21.15.53:0/3644605778 shutdown_connections 2023-12-08T20:55:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfbf59e640 1 -- 172.21.15.53:0/3644605778 >> 172.21.15.53:0/3644605778 conn(0x7fdfc006a5b0 msgr2=0x7fdfc006ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfbf59e640 1 -- 172.21.15.53:0/3644605778 shutdown_connections 2023-12-08T20:55:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.762+0000 7fdfbf59e640 1 -- 172.21.15.53:0/3644605778 wait complete. 2023-12-08T20:55:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:64424509462 2023-12-08T20:55:44.788 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-08T20:55:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.790+0000 7f69ddffb640 1 -- 172.21.15.53:0/151967036 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69e0007370 con 0x7f69e8153910 2023-12-08T20:55:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.790+0000 7f69ddffb640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f69cc0664c0 0x7f69cc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.790+0000 7f69ed0ac640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f69cc0664c0 0x7f69cc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.790+0000 7f69ed0ac640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f69cc0664c0 0x7f69cc068980 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69e4007fd0 tx=0x7f69e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.794+0000 7fc024e81640 1 Processor -- start 2023-12-08T20:55:44.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.794+0000 7fc024e81640 1 -- start start 2023-12-08T20:55:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.794+0000 7f70e37fe640 1 -- 172.21.15.53:0/2358564793 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70f000f3c0 con 0x7f70f40dd290 2023-12-08T20:55:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.794+0000 7f70e37fe640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f70e80664c0 0x7f70e8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.794+0000 7f70fad9d640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f70e80664c0 0x7f70e8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.798+0000 7fc024e81640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc020157b40 0x7fc0200c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.798+0000 7fc024e81640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc020157f20 0x7fc02006be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.798+0000 7fc024e81640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0200cceb0 0x7fc0200c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.798+0000 7fc024e81640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02015da00 con 0x7fc020157f20 2023-12-08T20:55:44.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.798+0000 7fc024e81640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02006c370 con 0x7fc0200cceb0 2023-12-08T20:55:44.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.798+0000 7fc024e81640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02015e260 con 0x7fc020157b40 2023-12-08T20:55:44.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.798+0000 7f70fad9d640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f70e80664c0 0x7f70e8068980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0b2000 tx=0x7f70ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.798+0000 7fc01dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc020157f20 0x7fc02006be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.798+0000 7fc01dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc020157f20 0x7fc02006be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56512/0 (socket says 172.21.15.53:56512) 2023-12-08T20:55:44.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.798+0000 7fc01dd9b640 1 -- 172.21.15.53:0/726523123 learned_addr learned my addr 172.21.15.53:0/726523123 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7f69ddffb640 1 -- 172.21.15.53:0/151967036 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f69e000ce30 con 0x7f69e8153910 2023-12-08T20:55:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7f69ddffb640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] conn(0x7f69cc06fa00 0x7f69cc071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7f69ddffb640 1 -- 172.21.15.53:0/151967036 --> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69cc072510 con 0x7f69cc06fa00 2023-12-08T20:55:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7fc01dd9b640 1 -- 172.21.15.53:0/726523123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc020157b40 msgr2=0x7fc0200c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7fc01dd9b640 1 --2- 172.21.15.53:0/726523123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc020157b40 0x7fc0200c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7fc01dd9b640 1 -- 172.21.15.53:0/726523123 >> v2:172.21.15.146:3300/0 conn(0x7fc0200cceb0 msgr2=0x7fc0200c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7fc01dd9b640 1 --2- 172.21.15.53:0/726523123 >> v2:172.21.15.146:3300/0 conn(0x7fc0200cceb0 0x7fc0200c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7fc01dd9b640 1 -- 172.21.15.53:0/726523123 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0200cd410 con 0x7fc020157f20 2023-12-08T20:55:44.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7f69ec8ab640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] conn(0x7f69cc06fa00 0x7f69cc071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7f69ec8ab640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] conn(0x7f69cc06fa00 0x7f69cc071e40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7f70e37fe640 1 -- 172.21.15.53:0/2358564793 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f70f0055590 con 0x7f70f40dd290 2023-12-08T20:55:44.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7f70e37fe640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] conn(0x7f70e806fa00 0x7f70e8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7f70e37fe640 1 -- 172.21.15.53:0/2358564793 --> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70e8072510 con 0x7f70e806fa00 2023-12-08T20:55:44.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7f69ddffb640 1 -- 172.21.15.53:0/151967036 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69e0051a20 con 0x7f69e8153910 2023-12-08T20:55:44.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7f69ddffb640 1 -- 172.21.15.53:0/151967036 <== osd.7 v2:172.21.15.146:6816/924786666 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f69cc072510 con 0x7f69cc06fa00 2023-12-08T20:55:44.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.802+0000 7f70fb59e640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] conn(0x7f70e806fa00 0x7f70e8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.806+0000 7f70fb59e640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] conn(0x7f70e806fa00 0x7f70e8071e40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.806+0000 7f70e37fe640 1 -- 172.21.15.53:0/2358564793 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70f0055360 con 0x7f70f40dd290 2023-12-08T20:55:44.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.806+0000 7f70e37fe640 1 -- 172.21.15.53:0/2358564793 <== osd.6 v2:172.21.15.146:6824/3215046611 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f70e8072510 con 0x7f70e806fa00 2023-12-08T20:55:44.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.806+0000 7fc01dd9b640 1 --2- 172.21.15.53:0/726523123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc020157f20 0x7fc02006be30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc0200cdfb0 tx=0x7fc01001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8296455a24ef6b82 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.814+0000 7fc01d59a640 1 -- 172.21.15.53:0/726523123 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100a89b0 con 0x7fc020157f20 2023-12-08T20:55:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.814+0000 7fc01d59a640 1 -- 172.21.15.53:0/726523123 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0100a8b10 con 0x7fc020157f20 2023-12-08T20:55:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.814+0000 7fc01d59a640 1 -- 172.21.15.53:0/726523123 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100a8ea0 con 0x7fc020157f20 2023-12-08T20:55:44.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.814+0000 7fc024e81640 1 -- 172.21.15.53:0/726523123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc020157f20 msgr2=0x7fc02006be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.814+0000 7fc024e81640 1 --2- 172.21.15.53:0/726523123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc020157f20 0x7fc02006be30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc0200cdfb0 tx=0x7fc01001ecf0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.814+0000 7fc024e81640 1 -- 172.21.15.53:0/726523123 shutdown_connections 2023-12-08T20:55:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.814+0000 7fc024e81640 1 --2- 172.21.15.53:0/726523123 >> v2:172.21.15.146:3300/0 conn(0x7fc0200cceb0 0x7fc0200c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.814+0000 7fc024e81640 1 --2- 172.21.15.53:0/726523123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc020157f20 0x7fc02006be30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.814+0000 7fc024e81640 1 --2- 172.21.15.53:0/726523123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc020157b40 0x7fc0200c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.814+0000 7fc024e81640 1 -- 172.21.15.53:0/726523123 >> 172.21.15.53:0/726523123 conn(0x7fc020060fd0 msgr2=0x7fc0200613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.814+0000 7fc024e81640 1 -- 172.21.15.53:0/726523123 shutdown_connections 2023-12-08T20:55:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.814+0000 7fc024e81640 1 -- 172.21.15.53:0/726523123 wait complete. 2023-12-08T20:55:44.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.818+0000 7fc024e81640 1 Processor -- start 2023-12-08T20:55:44.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.818+0000 7fc024e81640 1 -- start start 2023-12-08T20:55:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.818+0000 7fc024e81640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0200cceb0 0x7fc0200b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.818+0000 7fc024e81640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc020157b40 0x7fc0200c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.818+0000 7fc024e81640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc020161ad0 0x7fc0201f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.818+0000 7fc024e81640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0201e9200 con 0x7fc020161ad0 2023-12-08T20:55:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.818+0000 7fc024e81640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0201e9470 con 0x7fc0200cceb0 2023-12-08T20:55:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.818+0000 7fc024e81640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0201e9750 con 0x7fc020157b40 2023-12-08T20:55:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.818+0000 7fc01ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc020161ad0 0x7fc0201f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.818+0000 7fc01e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0200cceb0 0x7fc0200b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.822+0000 7fc01dd9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc020157b40 0x7fc0200c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.822+0000 7fc01ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc020161ad0 0x7fc0201f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56526/0 (socket says 172.21.15.53:56526) 2023-12-08T20:55:44.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.822+0000 7fc01ed9d640 1 -- 172.21.15.53:0/4038350597 learned_addr learned my addr 172.21.15.53:0/4038350597 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.826+0000 7fc01ed9d640 1 -- 172.21.15.53:0/4038350597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc020157b40 msgr2=0x7fc0200c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.826+0000 7fc01ed9d640 1 --2- 172.21.15.53:0/4038350597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc020157b40 0x7fc0200c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.826+0000 7fc01ed9d640 1 -- 172.21.15.53:0/4038350597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0200cceb0 msgr2=0x7fc0200b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.826+0000 7fc01ed9d640 1 --2- 172.21.15.53:0/4038350597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0200cceb0 0x7fc0200b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.826+0000 7fc01ed9d640 1 -- 172.21.15.53:0/4038350597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0100094d0 con 0x7fc020161ad0 2023-12-08T20:55:44.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.830+0000 7fc01ed9d640 1 --2- 172.21.15.53:0/4038350597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc020161ad0 0x7fc0201f3a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc01800b9e0 tx=0x7fc01800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ef310640 1 -- 172.21.15.53:0/151967036 --> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f69e80cb6c0 con 0x7f69cc06fa00 2023-12-08T20:55:44.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ddffb640 1 -- 172.21.15.53:0/151967036 <== osd.7 v2:172.21.15.146:6816/924786666 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f69d80a8be0 con 0x7f69cc06fa00 2023-12-08T20:55:44.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f9f407c0640 1 Processor -- start 2023-12-08T20:55:44.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f9f407c0640 1 -- start start 2023-12-08T20:55:44.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f710091a640 1 -- 172.21.15.53:0/2358564793 --> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f70f416ee70 con 0x7f70e806fa00 2023-12-08T20:55:44.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ef310640 1 -- 172.21.15.53:0/151967036 >> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] conn(0x7f69cc06fa00 msgr2=0x7f69cc071e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ef310640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] conn(0x7f69cc06fa00 0x7f69cc071e40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ef310640 1 -- 172.21.15.53:0/151967036 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f69cc0664c0 msgr2=0x7f69cc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ef310640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f69cc0664c0 0x7f69cc068980 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69e4007fd0 tx=0x7f69e4009040 comp rx=0 tx=0).stop 2023-12-08T20:55:44.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ef310640 1 -- 172.21.15.53:0/151967036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e8153910 msgr2=0x7f69e80c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ef310640 1 --2- 172.21.15.53:0/151967036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e8153910 0x7f69e80c78a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69e000b970 tx=0x7f69e000be30 comp rx=0 tx=0).stop 2023-12-08T20:55:44.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ed8ad640 1 -- 172.21.15.53:0/151967036 reap_dead start 2023-12-08T20:55:44.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ef310640 1 -- 172.21.15.53:0/151967036 shutdown_connections 2023-12-08T20:55:44.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ef310640 1 -- 172.21.15.53:0/151967036 >> 172.21.15.53:0/151967036 conn(0x7f69e808afc0 msgr2=0x7f69e80b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ef310640 1 -- 172.21.15.53:0/151967036 shutdown_connections 2023-12-08T20:55:44.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f69ef310640 1 -- 172.21.15.53:0/151967036 wait complete. 2023-12-08T20:55:44.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f9f407c0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f3806e7a0 0x7f9f38072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f9f407c0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9f38070e90 0x7f9f38166b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f9f407c0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f381666d0 con 0x7f9f380c0570 2023-12-08T20:55:44.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f9f407c0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f381608d0 con 0x7f9f38070e90 2023-12-08T20:55:44.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f9f407c0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381670a0 con 0x7f9f3806e7a0 2023-12-08T20:55:44.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f70e37fe640 1 -- 172.21.15.53:0/2358564793 <== osd.6 v2:172.21.15.146:6824/3215046611 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f70f416ee70 con 0x7f70e806fa00 2023-12-08T20:55:44.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f710091a640 1 -- 172.21.15.53:0/2358564793 >> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] conn(0x7f70e806fa00 msgr2=0x7f70e8071e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f710091a640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] conn(0x7f70e806fa00 0x7f70e8071e40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f710091a640 1 -- 172.21.15.53:0/2358564793 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f70e80664c0 msgr2=0x7f70e8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f710091a640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f70e80664c0 0x7f70e8068980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0b2000 tx=0x7f70ec008040 comp rx=0 tx=0).stop 2023-12-08T20:55:44.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f710091a640 1 -- 172.21.15.53:0/2358564793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f40dd290 msgr2=0x7f70f4006e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f710091a640 1 --2- 172.21.15.53:0/2358564793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f40dd290 0x7f70f4006e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f70f000b550 tx=0x7f70f000ba10 comp rx=0 tx=0).stop 2023-12-08T20:55:44.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f70fb59e640 1 -- 172.21.15.53:0/2358564793 reap_dead start 2023-12-08T20:55:44.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f710091a640 1 -- 172.21.15.53:0/2358564793 shutdown_connections 2023-12-08T20:55:44.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f710091a640 1 -- 172.21.15.53:0/2358564793 >> 172.21.15.53:0/2358564793 conn(0x7f70f4050160 msgr2=0x7f70f404f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f710091a640 1 -- 172.21.15.53:0/2358564793 shutdown_connections 2023-12-08T20:55:44.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.834+0000 7f710091a640 1 -- 172.21.15.53:0/2358564793 wait complete. 2023-12-08T20:55:44.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.838+0000 7f9f3dd5b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9f38070e90 0x7f9f38166b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.838+0000 7f9f3dd5b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9f38070e90 0x7f9f38166b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40186/0 (socket says 172.21.15.53:40186) 2023-12-08T20:55:44.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.838+0000 7f9f3dd5b640 1 -- 172.21.15.53:0/2384717519 learned_addr learned my addr 172.21.15.53:0/2384717519 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.838+0000 7fc016ffd640 1 -- 172.21.15.53:0/4038350597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800cb20 con 0x7fc020161ad0 2023-12-08T20:55:44.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.838+0000 7fc016ffd640 1 -- 172.21.15.53:0/4038350597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01800cc80 con 0x7fc020161ad0 2023-12-08T20:55:44.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.838+0000 7fc016ffd640 1 -- 172.21.15.53:0/4038350597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018014680 con 0x7fc020161ad0 2023-12-08T20:55:44.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.838+0000 7fc024e81640 1 -- 172.21.15.53:0/4038350597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0201e9a30 con 0x7fc020161ad0 2023-12-08T20:55:44.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.838+0000 7fc024e81640 1 -- 172.21.15.53:0/4038350597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0200afec0 con 0x7fc020161ad0 2023-12-08T20:55:44.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.842+0000 7fc024e81640 1 -- 172.21.15.53:0/4038350597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0201e95b0 con 0x7fc020161ad0 2023-12-08T20:55:44.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.842+0000 7f9f3e55c640 1 --2- 172.21.15.53:0/2384717519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f3806e7a0 0x7f9f38072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.846+0000 7f9f3dd5b640 1 -- 172.21.15.53:0/2384717519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f3806e7a0 msgr2=0x7f9f38072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.846+0000 7f9f3dd5b640 1 --2- 172.21.15.53:0/2384717519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f3806e7a0 0x7f9f38072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.846+0000 7f9f3dd5b640 1 -- 172.21.15.53:0/2384717519 >> v1:172.21.15.53:6789/0 conn(0x7f9f380c0570 legacy=0x7f9f3806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.846+0000 7f9f3dd5b640 1 -- 172.21.15.53:0/2384717519 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f381660e0 con 0x7f9f38070e90 2023-12-08T20:55:44.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.854+0000 7f9f3dd5b640 1 --2- 172.21.15.53:0/2384717519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f38070e90 0x7f9f38166b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009870 tx=0x7f9f3401ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=930fe3df24355dda server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.858 INFO:teuthology.orchestra.run.smithi053.stdout:60129542166 2023-12-08T20:55:44.858 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-08T20:55:44.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.862+0000 7f9f3d55a640 1 -- 172.21.15.53:0/2384717519 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f340a8a30 con 0x7f9f38070e90 2023-12-08T20:55:44.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.862+0000 7f9f3d55a640 1 -- 172.21.15.53:0/2384717519 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f340a8b90 con 0x7f9f38070e90 2023-12-08T20:55:44.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.862+0000 7f9f3d55a640 1 -- 172.21.15.53:0/2384717519 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f340b0440 con 0x7f9f38070e90 2023-12-08T20:55:44.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.862+0000 7f9f407c0640 1 -- 172.21.15.53:0/2384717519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f38070e90 msgr2=0x7f9f38166b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.862+0000 7f9f407c0640 1 --2- 172.21.15.53:0/2384717519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f38070e90 0x7f9f38166b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009870 tx=0x7f9f3401ed30 comp rx=0 tx=0).stop 2023-12-08T20:55:44.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.862+0000 7f9f407c0640 1 -- 172.21.15.53:0/2384717519 shutdown_connections 2023-12-08T20:55:44.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.862+0000 7f9f407c0640 1 --2- 172.21.15.53:0/2384717519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f38070e90 0x7f9f38166b60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.862+0000 7f9f407c0640 1 --2- 172.21.15.53:0/2384717519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f3806e7a0 0x7f9f38072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.862+0000 7f9f407c0640 1 -- 172.21.15.53:0/2384717519 >> 172.21.15.53:0/2384717519 conn(0x7f9f380caef0 msgr2=0x7f9f380cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.862+0000 7f9f407c0640 1 -- 172.21.15.53:0/2384717519 shutdown_connections 2023-12-08T20:55:44.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.862+0000 7f9f407c0640 1 -- 172.21.15.53:0/2384717519 wait complete. 2023-12-08T20:55:44.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f4f6f1fc640 1 Processor -- start 2023-12-08T20:55:44.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f4f6f1fc640 1 -- start start 2023-12-08T20:55:44.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f9f407c0640 1 Processor -- start 2023-12-08T20:55:44.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f4f6f1fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f60050cb0 0x7f4f600d5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f4f6f1fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4f600dad30 0x7f4f600db180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f4f6f1fc640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6004b990 con 0x7f4f6004c2e0 2023-12-08T20:55:44.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f4f6f1fc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6004bf50 con 0x7f4f600dad30 2023-12-08T20:55:44.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f4f6f1fc640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600d5540 con 0x7f4f60050cb0 2023-12-08T20:55:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f9f407c0640 1 -- start start 2023-12-08T20:55:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f9f407c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3806e7a0 0x7f9f381625e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f9f407c0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f38070e90 0x7f9f380ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f9f407c0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f380c0570 0x7f9f38159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f9f407c0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381583d0 con 0x7f9f3806e7a0 2023-12-08T20:55:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f9f407c0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38162b20 con 0x7f9f38070e90 2023-12-08T20:55:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f9f407c0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38168660 con 0x7f9f380c0570 2023-12-08T20:55:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:60129542165 2023-12-08T20:55:44.870 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-08T20:55:44.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f4f6cf98640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f60050cb0 0x7f4f600d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f9f3dd5b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f38070e90 0x7f9f380ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.866+0000 7f9f3ed5d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f380c0570 0x7f9f38159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.870+0000 7f4f6cf98640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f60050cb0 0x7f4f600d5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:44066/0 (socket says 172.21.15.53:44066) 2023-12-08T20:55:44.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.870+0000 7f4f6cf98640 1 -- 172.21.15.53:0/2777422910 learned_addr learned my addr 172.21.15.53:0/2777422910 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.870+0000 7f9f3dd5b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f38070e90 0x7f9f380ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40188/0 (socket says 172.21.15.53:40188) 2023-12-08T20:55:44.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.870+0000 7f9f3dd5b640 1 -- 172.21.15.53:0/2193266509 learned_addr learned my addr 172.21.15.53:0/2193266509 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.874+0000 7f4f6cf98640 1 -- 172.21.15.53:0/2777422910 >> v2:172.21.15.53:3300/0 conn(0x7f4f600dad30 msgr2=0x7f4f600db180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.874+0000 7f4f6cf98640 1 --2- 172.21.15.53:0/2777422910 >> v2:172.21.15.53:3300/0 conn(0x7f4f600dad30 0x7f4f600db180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.874+0000 7f4f6cf98640 1 -- 172.21.15.53:0/2777422910 >> v1:172.21.15.146:6789/0 conn(0x7f4f6004c2e0 legacy=0x7f4f600347a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.874+0000 7f4f6cf98640 1 -- 172.21.15.53:0/2777422910 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6004bc70 con 0x7f4f60050cb0 2023-12-08T20:55:44.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.878+0000 7f9f3dd5b640 1 -- 172.21.15.53:0/2193266509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f380c0570 msgr2=0x7f9f38159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.878+0000 7f9f3dd5b640 1 --2- 172.21.15.53:0/2193266509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f380c0570 0x7f9f38159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.878+0000 7f9f3dd5b640 1 -- 172.21.15.53:0/2193266509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3806e7a0 msgr2=0x7f9f381625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.878+0000 7f9f3dd5b640 1 --2- 172.21.15.53:0/2193266509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3806e7a0 0x7f9f381625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.878+0000 7f9f3dd5b640 1 -- 172.21.15.53:0/2193266509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f340094d0 con 0x7f9f38070e90 2023-12-08T20:55:44.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.890+0000 7f4f6cf98640 1 --2- 172.21.15.53:0/2777422910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f60050cb0 0x7f4f600d5000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009870 tx=0x7f4f5c01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=309b628110533172 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.890+0000 7f9f3dd5b640 1 --2- 172.21.15.53:0/2193266509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f38070e90 0x7f9f380ca0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f3401b940 tx=0x7f9f3401bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.902+0000 7f9f2effd640 1 -- 172.21.15.53:0/2193266509 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f340be070 con 0x7f9f38070e90 2023-12-08T20:55:44.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.902+0000 7f9f407c0640 1 -- 172.21.15.53:0/2193266509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f38168940 con 0x7f9f38070e90 2023-12-08T20:55:44.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.902+0000 7f9f407c0640 1 -- 172.21.15.53:0/2193266509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f38168f00 con 0x7f9f38070e90 2023-12-08T20:55:44.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.902+0000 7f9f2effd640 1 -- 172.21.15.53:0/2193266509 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f340b1ae0 con 0x7f9f38070e90 2023-12-08T20:55:44.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.902+0000 7f9f2effd640 1 -- 172.21.15.53:0/2193266509 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f340b1e70 con 0x7f9f38070e90 2023-12-08T20:55:44.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.902+0000 7f9f407c0640 1 -- 172.21.15.53:0/2193266509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f20005260 con 0x7f9f38070e90 2023-12-08T20:55:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.902+0000 7f4f677fe640 1 -- 172.21.15.53:0/2777422910 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0a8a30 con 0x7f4f60050cb0 2023-12-08T20:55:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.902+0000 7f4f677fe640 1 -- 172.21.15.53:0/2777422910 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c0a8b90 con 0x7f4f60050cb0 2023-12-08T20:55:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.902+0000 7f4f677fe640 1 -- 172.21.15.53:0/2777422910 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0a8a30 con 0x7f4f60050cb0 2023-12-08T20:55:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.906+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2777422910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f60050cb0 msgr2=0x7f4f600d5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.906+0000 7f4f6f1fc640 1 --2- 172.21.15.53:0/2777422910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f60050cb0 0x7f4f600d5000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009870 tx=0x7f4f5c01ed30 comp rx=0 tx=0).stop 2023-12-08T20:55:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.906+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2777422910 shutdown_connections 2023-12-08T20:55:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.906+0000 7f4f6f1fc640 1 --2- 172.21.15.53:0/2777422910 >> v2:172.21.15.53:3300/0 conn(0x7f4f600dad30 0x7f4f600db180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.906+0000 7f4f6f1fc640 1 --2- 172.21.15.53:0/2777422910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f60050cb0 0x7f4f600d5000 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009870 tx=0x7f4f5c01ed30 comp rx=0 tx=0).stop 2023-12-08T20:55:44.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.906+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2777422910 >> 172.21.15.53:0/2777422910 conn(0x7f4f60050190 msgr2=0x7f4f600505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.918+0000 7f576f366640 1 Processor -- start 2023-12-08T20:55:44.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.918+0000 7f576f366640 1 -- start start 2023-12-08T20:55:44.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2777422910 shutdown_connections 2023-12-08T20:55:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f576f366640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 0x7f576806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f576f366640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f576806abf0 0x7f576806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f576f366640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576815d3e0 con 0x7f576815d870 2023-12-08T20:55:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f576f366640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57680c1260 con 0x7f576806abf0 2023-12-08T20:55:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f576f366640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576806dc00 con 0x7f576806a810 2023-12-08T20:55:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2777422910 wait complete. 2023-12-08T20:55:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f4f6f1fc640 1 Processor -- start 2023-12-08T20:55:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f576d102640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 0x7f576806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f576d102640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 0x7f576806b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:44072/0 (socket says 172.21.15.53:44072) 2023-12-08T20:55:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f576d102640 1 -- 172.21.15.53:0/1264666552 learned_addr learned my addr 172.21.15.53:0/1264666552 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f4f6f1fc640 1 -- start start 2023-12-08T20:55:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f4f6f1fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f6004c2e0 0x7f4f600deb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f4f6f1fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f600dad30 0x7f4f6004f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f4f6f1fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f600d9f00 0x7f4f60175340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f4f6f1fc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600d7220 con 0x7f4f6004c2e0 2023-12-08T20:55:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f4f6f1fc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60179120 con 0x7f4f600d9f00 2023-12-08T20:55:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.922+0000 7f4f6f1fc640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60174c10 con 0x7f4f600dad30 2023-12-08T20:55:44.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.926+0000 7f6f5166c640 1 Processor -- start 2023-12-08T20:55:44.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.926+0000 7f6f5166c640 1 -- start start 2023-12-08T20:55:44.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.926+0000 7f57029e5640 1 Processor -- start 2023-12-08T20:55:44.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.926+0000 7f57029e5640 1 -- start start 2023-12-08T20:55:44.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.926+0000 7f6f5166c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6f4c150840 0x7f6f4c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.926+0000 7f6f5166c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4c15a350 con 0x7f6f4c0c1110 2023-12-08T20:55:44.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.926+0000 7f6f5166c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4c0c2330 con 0x7f6f4c0b1c80 2023-12-08T20:55:44.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.926+0000 7f6f5166c640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4c15a860 con 0x7f6f4c150840 2023-12-08T20:55:44.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.926+0000 7f57029e5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56fc0c1110 0x7f56fc0c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.926+0000 7f57029e5640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f56fc0b1c80 0x7f56fc150130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.926+0000 7f57029e5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56fc0c94b0 0x7f56fc150670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.930+0000 7f57029e5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc15a860 con 0x7f56fc0c94b0 2023-12-08T20:55:44.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.930+0000 7f57029e5640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc15a350 con 0x7f56fc0b1c80 2023-12-08T20:55:44.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.930+0000 7f57029e5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0c2330 con 0x7f56fc0c1110 2023-12-08T20:55:44.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.930+0000 7f576d102640 1 -- 172.21.15.53:0/1264666552 >> v2:172.21.15.146:3300/0 conn(0x7f576806abf0 msgr2=0x7f576806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.930+0000 7f576d102640 1 --2- 172.21.15.53:0/1264666552 >> v2:172.21.15.146:3300/0 conn(0x7f576806abf0 0x7f576806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.930+0000 7f576d102640 1 -- 172.21.15.53:0/1264666552 >> v1:172.21.15.53:6789/0 conn(0x7f576815d870 legacy=0x7f5768153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.930+0000 7f576d102640 1 -- 172.21.15.53:0/1264666552 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680c2ba0 con 0x7f576806a810 2023-12-08T20:55:44.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.934+0000 7f56fbfff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56fc0c1110 0x7f56fc0c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.934+0000 7f4f67fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f600dad30 0x7f4f6004f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.934+0000 7f4f67fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f600dad30 0x7f4f6004f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:44088/0 (socket says 172.21.15.53:44088) 2023-12-08T20:55:44.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.934+0000 7f4f67fff640 1 -- 172.21.15.53:0/2585446329 learned_addr learned my addr 172.21.15.53:0/2585446329 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.938+0000 7f56fbfff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56fc0c1110 0x7f56fc0c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:44096/0 (socket says 172.21.15.53:44096) 2023-12-08T20:55:44.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.938+0000 7f56fbfff640 1 -- 172.21.15.53:0/3621412454 learned_addr learned my addr 172.21.15.53:0/3621412454 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.938+0000 7f576d102640 1 --2- 172.21.15.53:0/1264666552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 0x7f576806b120 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5764009870 tx=0x7f576401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5896887aa3ad53 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.950+0000 7f4f67fff640 1 -- 172.21.15.53:0/2585446329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f600d9f00 msgr2=0x7f4f60175340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.950+0000 7f4f67fff640 1 --2- 172.21.15.53:0/2585446329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f600d9f00 0x7f4f60175340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.950+0000 7f4f67fff640 1 -- 172.21.15.53:0/2585446329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f6004c2e0 msgr2=0x7f4f600deb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.950+0000 7f4f67fff640 1 --2- 172.21.15.53:0/2585446329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f6004c2e0 0x7f4f600deb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.950+0000 7f4f67fff640 1 -- 172.21.15.53:0/2585446329 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0094d0 con 0x7f4f600dad30 2023-12-08T20:55:44.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.962+0000 7f56fbfff640 1 -- 172.21.15.53:0/3621412454 >> v2:172.21.15.146:3300/0 conn(0x7f56fc0b1c80 msgr2=0x7f56fc150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.962+0000 7f56fbfff640 1 --2- 172.21.15.53:0/3621412454 >> v2:172.21.15.146:3300/0 conn(0x7f56fc0b1c80 0x7f56fc150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.962+0000 7f56fbfff640 1 -- 172.21.15.53:0/3621412454 >> v2:172.21.15.53:3300/0 conn(0x7f56fc0c94b0 msgr2=0x7f56fc150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:44.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.962+0000 7f56fbfff640 1 --2- 172.21.15.53:0/3621412454 >> v2:172.21.15.53:3300/0 conn(0x7f56fc0c94b0 0x7f56fc150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.962+0000 7f56fbfff640 1 -- 172.21.15.53:0/3621412454 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc15a580 con 0x7f56fc0c1110 2023-12-08T20:55:44.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f575ffff640 1 -- 172.21.15.53:0/1264666552 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640a89b0 con 0x7f576806a810 2023-12-08T20:55:44.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f575ffff640 1 -- 172.21.15.53:0/1264666552 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57640a8b10 con 0x7f576806a810 2023-12-08T20:55:44.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f575ffff640 1 -- 172.21.15.53:0/1264666552 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640a8ea0 con 0x7f576806a810 2023-12-08T20:55:44.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f576f366640 1 -- 172.21.15.53:0/1264666552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 msgr2=0x7f576806b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f576f366640 1 --2- 172.21.15.53:0/1264666552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 0x7f576806b120 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5764009870 tx=0x7f576401ecf0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f576f366640 1 -- 172.21.15.53:0/1264666552 shutdown_connections 2023-12-08T20:55:44.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f576f366640 1 --2- 172.21.15.53:0/1264666552 >> v2:172.21.15.146:3300/0 conn(0x7f576806abf0 0x7f576806d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f576f366640 1 --2- 172.21.15.53:0/1264666552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 0x7f576806b120 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f576f366640 1 -- 172.21.15.53:0/1264666552 >> 172.21.15.53:0/1264666552 conn(0x7f57680c8990 msgr2=0x7f57680c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f576f366640 1 -- 172.21.15.53:0/1264666552 shutdown_connections 2023-12-08T20:55:44.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f576f366640 1 -- 172.21.15.53:0/1264666552 wait complete. 2023-12-08T20:55:44.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f576f366640 1 Processor -- start 2023-12-08T20:55:44.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.970+0000 7f576f366640 1 -- start start 2023-12-08T20:55:44.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f576f366640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 0x7f576814f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f576f366640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576806abf0 0x7f57681efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f576f366640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f576815d870 0x7f57681f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f576f366640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576806d930 con 0x7f576806abf0 2023-12-08T20:55:44.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f576f366640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57681ef4d0 con 0x7f576815d870 2023-12-08T20:55:44.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f576f366640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576814e840 con 0x7f576806a810 2023-12-08T20:55:44.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f3cfa2e0640 1 Processor -- start 2023-12-08T20:55:44.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f3cfa2e0640 1 -- start start 2023-12-08T20:55:44.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f3cfa2e0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3cf41518f0 0x7f3cf406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f3cfa2e0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cf40c94b0 0x7f3cf406aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f3cfa2e0640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf40c6c00 con 0x7f3cf40c7090 2023-12-08T20:55:44.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f3cfa2e0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf40c3920 con 0x7f3cf41518f0 2023-12-08T20:55:44.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f3cfa2e0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40c41b0 con 0x7f3cf40c94b0 2023-12-08T20:55:44.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.974+0000 7f56fbfff640 1 --2- 172.21.15.53:0/3621412454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56fc0c1110 0x7f56fc0c14f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0c24a0 tx=0x7f56ec01eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c4059a2f87b30e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f56faffd640 1 -- 172.21.15.53:0/3621412454 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0a7c10 con 0x7f56fc0c1110 2023-12-08T20:55:44.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f56faffd640 1 -- 172.21.15.53:0/3621412454 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec0a7d70 con 0x7f56fc0c1110 2023-12-08T20:55:44.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f56faffd640 1 -- 172.21.15.53:0/3621412454 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0af660 con 0x7f56fc0c1110 2023-12-08T20:55:44.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 -- 172.21.15.53:0/3621412454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56fc0c1110 msgr2=0x7f56fc0c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:44.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 --2- 172.21.15.53:0/3621412454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56fc0c1110 0x7f56fc0c14f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0c24a0 tx=0x7f56ec01eb80 comp rx=0 tx=0).stop 2023-12-08T20:55:44.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 -- 172.21.15.53:0/3621412454 shutdown_connections 2023-12-08T20:55:44.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 --2- 172.21.15.53:0/3621412454 >> v2:172.21.15.53:3300/0 conn(0x7f56fc0c94b0 0x7f56fc150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 --2- 172.21.15.53:0/3621412454 >> v2:172.21.15.146:3300/0 conn(0x7f56fc0b1c80 0x7f56fc150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 --2- 172.21.15.53:0/3621412454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56fc0c1110 0x7f56fc0c14f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:44.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 -- 172.21.15.53:0/3621412454 >> 172.21.15.53:0/3621412454 conn(0x7f56fc0c8990 msgr2=0x7f56fc0c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:44.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 -- 172.21.15.53:0/3621412454 shutdown_connections 2023-12-08T20:55:44.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 -- 172.21.15.53:0/3621412454 wait complete. 2023-12-08T20:55:44.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f4f67fff640 1 --2- 172.21.15.53:0/2585446329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f600dad30 0x7f4f6004f370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f68050190 tx=0x7f4f680680e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:44.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 Processor -- start 2023-12-08T20:55:44.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 -- start start 2023-12-08T20:55:44.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56fc0b1c80 0x7f56fc1ee480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.990+0000 7f57029e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0c1110 0x7f56fc1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.994+0000 7f57029e5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56fc0c94b0 0x7f56fc158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:44.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.994+0000 7f57029e5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc1ee9c0 con 0x7f56fc0c1110 2023-12-08T20:55:44.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.994+0000 7f57029e5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc13e210 con 0x7f56fc0b1c80 2023-12-08T20:55:44.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.994+0000 7f57029e5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0ca530 con 0x7f56fc0c94b0 2023-12-08T20:55:44.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.994+0000 7f576d102640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 0x7f576814f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:44.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.998+0000 7fb3e7573640 1 Processor -- start 2023-12-08T20:55:44.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.998+0000 7fb3e7573640 1 -- start start 2023-12-08T20:55:44.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.998+0000 7fb3e7573640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3e0151350 0x7fb3e0151730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.998+0000 7fb3e7573640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3e00c7d20 0x7fb3e00c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.998+0000 7fb3e7573640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3e00cceb0 0x7fb3e00cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.998+0000 7fb3e7573640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e00b0380 con 0x7fb3e00c7d20 2023-12-08T20:55:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.998+0000 7fb3e7573640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e00b0c50 con 0x7fb3e0151350 2023-12-08T20:55:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:44.998+0000 7fb3e7573640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e00ca830 con 0x7fb3e00cceb0 2023-12-08T20:55:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.002+0000 7f576d102640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 0x7f576814f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:44102/0 (socket says 172.21.15.53:44102) 2023-12-08T20:55:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.002+0000 7f576d102640 1 -- 172.21.15.53:0/1873611237 learned_addr learned my addr 172.21.15.53:0/1873611237 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:45.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.006+0000 7f4f657fa640 1 -- 172.21.15.53:0/2585446329 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68072560 con 0x7f4f600dad30 2023-12-08T20:55:45.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.006+0000 7f4f657fa640 1 -- 172.21.15.53:0/2585446329 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f680726c0 con 0x7f4f600dad30 2023-12-08T20:55:45.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.006+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2585446329 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f601785a0 con 0x7f4f600dad30 2023-12-08T20:55:45.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.006+0000 7f4f657fa640 1 -- 172.21.15.53:0/2585446329 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68072a70 con 0x7f4f600dad30 2023-12-08T20:55:45.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.006+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2585446329 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f60178b60 con 0x7f4f600dad30 2023-12-08T20:55:45.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.006+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2585446329 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f600053a0 con 0x7f4f600dad30 2023-12-08T20:55:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.014+0000 7f576d102640 1 -- 172.21.15.53:0/1873611237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f576815d870 msgr2=0x7f57681f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.014+0000 7f576d102640 1 --2- 172.21.15.53:0/1873611237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f576815d870 0x7f57681f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.014+0000 7f576d102640 1 -- 172.21.15.53:0/1873611237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576806abf0 msgr2=0x7f57681efc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.014+0000 7f576d102640 1 --2- 172.21.15.53:0/1873611237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576806abf0 0x7f57681efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.014+0000 7f576d102640 1 -- 172.21.15.53:0/1873611237 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640094d0 con 0x7f576806a810 2023-12-08T20:55:45.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.158+0000 7fc016ffd640 1 -- 172.21.15.53:0/4038350597 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc01801d3b0 con 0x7fc020161ad0 2023-12-08T20:55:45.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.158+0000 7fc016ffd640 1 --2- 172.21.15.53:0/4038350597 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc0000664c0 0x7fc000068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.158+0000 7fc01e59c640 1 --2- 172.21.15.53:0/4038350597 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc0000664c0 0x7fc000068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.158+0000 7fc01e59c640 1 --2- 172.21.15.53:0/4038350597 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc0000664c0 0x7fc000068980 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0080098f0 tx=0x7fc008006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.194+0000 7fc016ffd640 1 -- 172.21.15.53:0/4038350597 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc01800ce30 con 0x7fc020161ad0 2023-12-08T20:55:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.194+0000 7fc016ffd640 1 -- 172.21.15.53:0/4038350597 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc018051560 con 0x7fc020161ad0 2023-12-08T20:55:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.202+0000 7f6f4affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6f4c0c1110 0x7f6f4c0c14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53434/0 (socket says 172.21.15.53:53434) 2023-12-08T20:55:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.202+0000 7f6f4affd640 1 -- 172.21.15.53:0/986948162 learned_addr learned my addr 172.21.15.53:0/986948162 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:45.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.226+0000 7f3cf3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3cf41518f0 0x7f3cf406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.230+0000 7f56fb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0c1110 0x7f56fc1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.230+0000 7f3cf3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3cf41518f0 0x7f3cf406a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56582/0 (socket says 172.21.15.53:56582) 2023-12-08T20:55:45.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.230+0000 7f3cf3fff640 1 -- 172.21.15.53:0/99933333 learned_addr learned my addr 172.21.15.53:0/99933333 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:45.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.234+0000 7f56fb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0c1110 0x7f56fc1587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56598/0 (socket says 172.21.15.53:56598) 2023-12-08T20:55:45.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.234+0000 7f56fb7fe640 1 -- 172.21.15.53:0/82704063 learned_addr learned my addr 172.21.15.53:0/82704063 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:45.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.238+0000 7f3cf3fff640 1 -- 172.21.15.53:0/99933333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cf40c94b0 msgr2=0x7f3cf406aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:45.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.238+0000 7f3cf3fff640 1 --2- 172.21.15.53:0/99933333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cf40c94b0 0x7f3cf406aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.238+0000 7f3cf3fff640 1 -- 172.21.15.53:0/99933333 >> v1:172.21.15.146:6789/0 conn(0x7f3cf40c7090 legacy=0x7f3cf40c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:45.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.238+0000 7f3cf3fff640 1 -- 172.21.15.53:0/99933333 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf4151cd0 con 0x7f3cf41518f0 2023-12-08T20:55:45.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.242+0000 7f9f2effd640 1 -- 172.21.15.53:0/2193266509 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f340b7070 con 0x7f9f38070e90 2023-12-08T20:55:45.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.242+0000 7f9f2effd640 1 --2- 172.21.15.53:0/2193266509 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9f1c066470 0x7f9f1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.242+0000 7f9f3e55c640 1 --2- 172.21.15.53:0/2193266509 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9f1c066470 0x7f9f1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.242+0000 7fb3e4b0e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3e00c7d20 0x7fb3e00c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.242+0000 7f9f3e55c640 1 --2- 172.21.15.53:0/2193266509 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9f1c066470 0x7f9f1c068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9f28006aa0 tx=0x7f9f28006a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.246+0000 7fb3e4b0e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3e00c7d20 0x7fb3e00c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56600/0 (socket says 172.21.15.53:56600) 2023-12-08T20:55:45.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.246+0000 7fb3e4b0e640 1 -- 172.21.15.53:0/439814107 learned_addr learned my addr 172.21.15.53:0/439814107 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:45.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.246+0000 7f9f2effd640 1 -- 172.21.15.53:0/2193266509 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f340f31f0 con 0x7f9f38070e90 2023-12-08T20:55:45.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.254+0000 7f56fb7fe640 1 -- 172.21.15.53:0/82704063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56fc0c94b0 msgr2=0x7f56fc158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.254+0000 7f56fb7fe640 1 --2- 172.21.15.53:0/82704063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56fc0c94b0 0x7f56fc158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.254+0000 7f56fb7fe640 1 -- 172.21.15.53:0/82704063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56fc0b1c80 msgr2=0x7f56fc1ee480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.254+0000 7f56fb7fe640 1 --2- 172.21.15.53:0/82704063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56fc0b1c80 0x7f56fc1ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.254+0000 7f56fb7fe640 1 -- 172.21.15.53:0/82704063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec00b770 con 0x7f56fc0c1110 2023-12-08T20:55:45.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.258+0000 7f6f49ffb640 1 -- 172.21.15.53:0/986948162 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745128424 0 0) 0x7f6f4c15a350 con 0x7f6f4c0c1110 2023-12-08T20:55:45.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.258+0000 7f6f49ffb640 1 -- 172.21.15.53:0/986948162 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f34003530 con 0x7f6f4c0c1110 2023-12-08T20:55:45.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.262+0000 7fb3e4b0e640 1 -- 172.21.15.53:0/439814107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3e00cceb0 msgr2=0x7fb3e00cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:45.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.262+0000 7fb3e4b0e640 1 --2- 172.21.15.53:0/439814107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3e00cceb0 0x7fb3e00cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.262+0000 7fb3e4b0e640 1 -- 172.21.15.53:0/439814107 >> v2:172.21.15.146:3300/0 conn(0x7fb3e0151350 msgr2=0x7fb3e0151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:45.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.262+0000 7fb3e4b0e640 1 --2- 172.21.15.53:0/439814107 >> v2:172.21.15.146:3300/0 conn(0x7fb3e0151350 0x7fb3e0151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.262+0000 7fb3e4b0e640 1 -- 172.21.15.53:0/439814107 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e00c26c0 con 0x7fb3e00c7d20 2023-12-08T20:55:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.270+0000 7f56fb7fe640 1 --2- 172.21.15.53:0/82704063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0c1110 0x7f56fc1587c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f56f000b480 tx=0x7f56f000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.274+0000 7f9f2effd640 1 -- 172.21.15.53:0/2193266509 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f340eee30 con 0x7f9f38070e90 2023-12-08T20:55:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.278+0000 7f6f4b7fe640 1 --2- 172.21.15.53:0/986948162 >> v2:172.21.15.146:3300/0 conn(0x7f6f4c150840 0x7f6f4c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.286+0000 7f6f4b7fe640 1 -- 172.21.15.53:0/986948162 >> v1:172.21.15.146:6789/0 conn(0x7f6f4c0b1c80 legacy=0x7f6f4c150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:45.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.286+0000 7f6f4b7fe640 1 -- 172.21.15.53:0/986948162 >> v1:172.21.15.53:6789/0 conn(0x7f6f4c0c1110 legacy=0x7f6f4c0c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.286+0000 7f6f4b7fe640 1 -- 172.21.15.53:0/986948162 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c0c1c00 con 0x7f6f4c150840 2023-12-08T20:55:45.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.294+0000 7fb3e4b0e640 1 --2- 172.21.15.53:0/439814107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3e00c7d20 0x7fb3e00c97e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0072780 tx=0x7fb3dc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3ebe7d239daa7b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.294+0000 7f3cf3fff640 1 --2- 172.21.15.53:0/99933333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf41518f0 0x7f3cf406a5b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009870 tx=0x7f3ce401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6d1812bedd2cf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.298+0000 7f6f4b7fe640 1 --2- 172.21.15.53:0/986948162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c150840 0x7f6f4c06e340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009d90 tx=0x7f6f4401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbf051954d3aea47 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.302+0000 7f6f49ffb640 1 -- 172.21.15.53:0/986948162 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f440a59a0 con 0x7f6f4c150840 2023-12-08T20:55:45.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.302+0000 7f6f49ffb640 1 -- 172.21.15.53:0/986948162 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f440a5b00 con 0x7f6f4c150840 2023-12-08T20:55:45.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.302+0000 7f6f49ffb640 1 -- 172.21.15.53:0/986948162 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f440a5e90 con 0x7f6f4c150840 2023-12-08T20:55:45.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.306+0000 7f6f5166c640 1 -- 172.21.15.53:0/986948162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c150840 msgr2=0x7f6f4c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.306+0000 7f6f5166c640 1 --2- 172.21.15.53:0/986948162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c150840 0x7f6f4c06e340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009d90 tx=0x7f6f4401c8e0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.306+0000 7f6f5166c640 1 -- 172.21.15.53:0/986948162 shutdown_connections 2023-12-08T20:55:45.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.306+0000 7f6f5166c640 1 --2- 172.21.15.53:0/986948162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c150840 0x7f6f4c06e340 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.306+0000 7f6f5166c640 1 -- 172.21.15.53:0/986948162 >> 172.21.15.53:0/986948162 conn(0x7f6f4c0c8990 msgr2=0x7f6f4c0c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:45.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.306+0000 7f6f5166c640 1 -- 172.21.15.53:0/986948162 shutdown_connections 2023-12-08T20:55:45.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.306+0000 7f6f5166c640 1 -- 172.21.15.53:0/986948162 wait complete. 2023-12-08T20:55:45.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.306+0000 7fb3d7fff640 1 -- 172.21.15.53:0/439814107 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0ab650 con 0x7fb3e00c7d20 2023-12-08T20:55:45.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.306+0000 7fb3d7fff640 1 -- 172.21.15.53:0/439814107 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc0ab7b0 con 0x7fb3e00c7d20 2023-12-08T20:55:45.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.306+0000 7fb3d7fff640 1 -- 172.21.15.53:0/439814107 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0abb40 con 0x7fb3e00c7d20 2023-12-08T20:55:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7fb3e7573640 1 -- 172.21.15.53:0/439814107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3e00c7d20 msgr2=0x7fb3e00c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7fb3e7573640 1 --2- 172.21.15.53:0/439814107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3e00c7d20 0x7fb3e00c97e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0072780 tx=0x7fb3dc01c470 comp rx=0 tx=0).stop 2023-12-08T20:55:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7fb3e7573640 1 -- 172.21.15.53:0/439814107 shutdown_connections 2023-12-08T20:55:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7fb3e7573640 1 --2- 172.21.15.53:0/439814107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3e00cceb0 0x7fb3e00cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7fb3e7573640 1 --2- 172.21.15.53:0/439814107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3e00c7d20 0x7fb3e00c97e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7fb3e7573640 1 --2- 172.21.15.53:0/439814107 >> v2:172.21.15.146:3300/0 conn(0x7fb3e0151350 0x7fb3e0151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7fb3e7573640 1 -- 172.21.15.53:0/439814107 >> 172.21.15.53:0/439814107 conn(0x7fb3e0060fd0 msgr2=0x7fb3e00613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7fb3e7573640 1 -- 172.21.15.53:0/439814107 shutdown_connections 2023-12-08T20:55:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7fb3e7573640 1 -- 172.21.15.53:0/439814107 wait complete. 2023-12-08T20:55:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7f6f5166c640 1 Processor -- start 2023-12-08T20:55:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7f6f5166c640 1 -- start start 2023-12-08T20:55:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7f6f5166c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f4c0b1c80 0x7f6f4c148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7f6f5166c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c0c1110 0x7f6f4c143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7fb3e7573640 1 Processor -- start 2023-12-08T20:55:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7f6f5166c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c150840 0x7f6f4c1f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7f6f5166c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c13f860 con 0x7f6f4c0b1c80 2023-12-08T20:55:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7f6f5166c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c140310 con 0x7f6f4c150840 2023-12-08T20:55:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7f6f5166c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c13fd90 con 0x7f6f4c0c1110 2023-12-08T20:55:45.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.310+0000 7fb3e7573640 1 -- start start 2023-12-08T20:55:45.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.314+0000 7fb3e7573640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3e00c7d20 0x7fb3e006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.314+0000 7fb3e7573640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3e00cceb0 0x7fb3e00b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.314+0000 7fb3e7573640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3e0151350 0x7fb3e00c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.314+0000 7fb3e7573640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e015b980 con 0x7fb3e0151350 2023-12-08T20:55:45.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.314+0000 7fb3e7573640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e00c7180 con 0x7fb3e00cceb0 2023-12-08T20:55:45.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.314+0000 7fb3e7573640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e006bff0 con 0x7fb3e00c7d20 2023-12-08T20:55:45.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.322+0000 7f576d102640 1 --2- 172.21.15.53:0/1873611237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 0x7f576814f6e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f57640b3040 tx=0x7f576401ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.322+0000 7f6f4b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c150840 0x7f6f4c1f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.322+0000 7fb3e4b0e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3e00cceb0 0x7fb3e00b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.322+0000 7f6f4b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c150840 0x7f6f4c1f0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40280/0 (socket says 172.21.15.53:40280) 2023-12-08T20:55:45.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.322+0000 7f6f4b7fe640 1 -- 172.21.15.53:0/3591072781 learned_addr learned my addr 172.21.15.53:0/3591072781 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:45.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.322+0000 7fb3e4b0e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3e00cceb0 0x7fb3e00b1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40284/0 (socket says 172.21.15.53:40284) 2023-12-08T20:55:45.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.322+0000 7fb3e4b0e640 1 -- 172.21.15.53:0/931187186 learned_addr learned my addr 172.21.15.53:0/931187186 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.330+0000 7f6f4b7fe640 1 -- 172.21.15.53:0/3591072781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c0c1110 msgr2=0x7f6f4c143a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.330+0000 7f6f4b7fe640 1 --2- 172.21.15.53:0/3591072781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c0c1110 0x7f6f4c143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.330+0000 7f6f4b7fe640 1 -- 172.21.15.53:0/3591072781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f4c0b1c80 msgr2=0x7f6f4c148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.330+0000 7f6f4b7fe640 1 --2- 172.21.15.53:0/3591072781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f4c0b1c80 0x7f6f4c148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.330+0000 7f6f4b7fe640 1 -- 172.21.15.53:0/3591072781 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44009a70 con 0x7f6f4c150840 2023-12-08T20:55:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.338+0000 7fb3e4b0e640 1 -- 172.21.15.53:0/931187186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3e00c7d20 msgr2=0x7fb3e006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.338+0000 7fb3e4b0e640 1 --2- 172.21.15.53:0/931187186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3e00c7d20 0x7fb3e006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.338+0000 7fb3e4b0e640 1 -- 172.21.15.53:0/931187186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3e0151350 msgr2=0x7fb3e00c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.338+0000 7fb3e4b0e640 1 --2- 172.21.15.53:0/931187186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3e0151350 0x7fb3e00c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.338+0000 7fb3e4b0e640 1 -- 172.21.15.53:0/931187186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0094d0 con 0x7fb3e00cceb0 2023-12-08T20:55:45.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.342+0000 7f4f657fa640 1 -- 172.21.15.53:0/2585446329 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4f68090070 con 0x7f4f600dad30 2023-12-08T20:55:45.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.342+0000 7f4f657fa640 1 --2- 172.21.15.53:0/2585446329 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4f4c0664f0 0x7f4f4c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.342+0000 7f4f6cf98640 1 --2- 172.21.15.53:0/2585446329 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4f4c0664f0 0x7f4f4c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.342+0000 7f4f6cf98640 1 --2- 172.21.15.53:0/2585446329 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4f4c0664f0 0x7f4f4c0689b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0b2000 tx=0x7f4f5c004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.342+0000 7fb3e4b0e640 1 --2- 172.21.15.53:0/931187186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3e00cceb0 0x7fb3e00b1190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc01cd10 tx=0x7fb3dc01acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.346+0000 7f6f4b7fe640 1 --2- 172.21.15.53:0/3591072781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c150840 0x7f6f4c1f0b70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009d90 tx=0x7f6f44019680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.350+0000 7f56f8ff9640 1 -- 172.21.15.53:0/82704063 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0010870 con 0x7f56fc0c1110 2023-12-08T20:55:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.350+0000 7f56f8ff9640 1 -- 172.21.15.53:0/82704063 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f00109f0 con 0x7f56fc0c1110 2023-12-08T20:55:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.350+0000 7f56f8ff9640 1 -- 172.21.15.53:0/82704063 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0010da0 con 0x7f56fc0c1110 2023-12-08T20:55:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.350+0000 7f57029e5640 1 -- 172.21.15.53:0/82704063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56fc0ca7d0 con 0x7f56fc0c1110 2023-12-08T20:55:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.350+0000 7f57029e5640 1 -- 172.21.15.53:0/82704063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56fc157730 con 0x7f56fc0c1110 2023-12-08T20:55:45.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.354+0000 7f57029e5640 1 -- 172.21.15.53:0/82704063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56fc074190 con 0x7f56fc0c1110 2023-12-08T20:55:45.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.354+0000 7f4f657fa640 1 -- 172.21.15.53:0/2585446329 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f6809b350 con 0x7f4f600dad30 2023-12-08T20:55:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.362+0000 7fb3d5ffb640 1 -- 172.21.15.53:0/931187186 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0b48c0 con 0x7fb3e00cceb0 2023-12-08T20:55:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.362+0000 7fb3d5ffb640 1 -- 172.21.15.53:0/931187186 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc0b4a20 con 0x7fb3e00cceb0 2023-12-08T20:55:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.362+0000 7fb3d5ffb640 1 -- 172.21.15.53:0/931187186 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0b4dd0 con 0x7fb3e00cceb0 2023-12-08T20:55:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.362+0000 7fb3e7573640 1 -- 172.21.15.53:0/931187186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e006c270 con 0x7fb3e00cceb0 2023-12-08T20:55:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.362+0000 7fb3e7573640 1 -- 172.21.15.53:0/931187186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e006d420 con 0x7fb3e00cceb0 2023-12-08T20:55:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.362+0000 7f6f337fe640 1 -- 172.21.15.53:0/3591072781 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f440add90 con 0x7f6f4c150840 2023-12-08T20:55:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.362+0000 7f6f337fe640 1 -- 172.21.15.53:0/3591072781 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f44009450 con 0x7f6f4c150840 2023-12-08T20:55:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.362+0000 7f6f337fe640 1 -- 172.21.15.53:0/3591072781 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f440b9690 con 0x7f6f4c150840 2023-12-08T20:55:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.362+0000 7fb3e7573640 1 -- 172.21.15.53:0/931187186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e006d260 con 0x7fb3e00cceb0 2023-12-08T20:55:45.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.362+0000 7f6f5166c640 1 -- 172.21.15.53:0/3591072781 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4c13f5a0 con 0x7f6f4c150840 2023-12-08T20:55:45.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.362+0000 7f6f5166c640 1 -- 172.21.15.53:0/3591072781 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4c140030 con 0x7f6f4c150840 2023-12-08T20:55:45.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.362+0000 7f6f5166c640 1 -- 172.21.15.53:0/3591072781 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4c074190 con 0x7f6f4c150840 2023-12-08T20:55:45.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.370+0000 7fc024e81640 1 -- 172.21.15.53:0/4038350597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc0201e95b0 con 0x7fc020161ad0 2023-12-08T20:55:45.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.378+0000 7f4f657fa640 1 -- 172.21.15.53:0/2585446329 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4f680cb830 con 0x7f4f600dad30 2023-12-08T20:55:45.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.406+0000 7f575dffb640 1 -- 172.21.15.53:0/1873611237 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640b0e40 con 0x7f576806a810 2023-12-08T20:55:45.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.406+0000 7f575dffb640 1 -- 172.21.15.53:0/1873611237 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57640bb470 con 0x7f576806a810 2023-12-08T20:55:45.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.406+0000 7f576f366640 1 -- 172.21.15.53:0/1873611237 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576814eb20 con 0x7f576806a810 2023-12-08T20:55:45.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.406+0000 7f575dffb640 1 -- 172.21.15.53:0/1873611237 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640bb820 con 0x7f576806a810 2023-12-08T20:55:45.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.406+0000 7f576f366640 1 -- 172.21.15.53:0/1873611237 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57681ef770 con 0x7f576806a810 2023-12-08T20:55:45.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.410+0000 7f576f366640 1 -- 172.21.15.53:0/1873611237 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57680714e0 con 0x7f576806a810 2023-12-08T20:55:45.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.482+0000 7f9f407c0640 1 -- 172.21.15.53:0/2193266509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9f200057e0 con 0x7f9f38070e90 2023-12-08T20:55:45.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.538+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2585446329 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4f60006650 con 0x7f4f600dad30 2023-12-08T20:55:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.622+0000 7f3cf2ffd640 1 -- 172.21.15.53:0/99933333 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40a7070 con 0x7f3cf41518f0 2023-12-08T20:55:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.622+0000 7f3cf2ffd640 1 -- 172.21.15.53:0/99933333 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce40ab430 con 0x7f3cf41518f0 2023-12-08T20:55:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.622+0000 7f3cf2ffd640 1 -- 172.21.15.53:0/99933333 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40ab7c0 con 0x7f3cf41518f0 2023-12-08T20:55:45.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/99933333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf41518f0 msgr2=0x7f3cf406a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 --2- 172.21.15.53:0/99933333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf41518f0 0x7f3cf406a5b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009870 tx=0x7f3ce401c470 comp rx=0 tx=0).stop 2023-12-08T20:55:45.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/99933333 shutdown_connections 2023-12-08T20:55:45.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 --2- 172.21.15.53:0/99933333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cf40c94b0 0x7f3cf406aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 --2- 172.21.15.53:0/99933333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf41518f0 0x7f3cf406a5b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/99933333 >> 172.21.15.53:0/99933333 conn(0x7f3cf40c8990 msgr2=0x7f3cf40c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:45.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/99933333 shutdown_connections 2023-12-08T20:55:45.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/99933333 wait complete. 2023-12-08T20:55:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 Processor -- start 2023-12-08T20:55:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 -- start start 2023-12-08T20:55:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cf40c7090 0x7f3cf406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf40c94b0 0x7f3cf40c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cf41f6310 0x7f3cf40c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf41f6870 con 0x7f3cf40c94b0 2023-12-08T20:55:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40c26d0 con 0x7f3cf41f6310 2023-12-08T20:55:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.626+0000 7f3cfa2e0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40cbb00 con 0x7f3cf40c7090 2023-12-08T20:55:45.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.646+0000 7f56f8ff9640 1 -- 172.21.15.53:0/82704063 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56f0023480 con 0x7f56fc0c1110 2023-12-08T20:55:45.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.646+0000 7f56f8ff9640 1 --2- 172.21.15.53:0/82704063 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f56e80664c0 0x7f56e8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.646+0000 7f56fbfff640 1 --2- 172.21.15.53:0/82704063 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f56e80664c0 0x7f56e8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.646+0000 7f56fbfff640 1 --2- 172.21.15.53:0/82704063 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f56e80664c0 0x7f56e8068980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0b1000 tx=0x7f56ec004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.666+0000 7f6f337fe640 1 -- 172.21.15.53:0/3591072781 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6f440b97f0 con 0x7f6f4c150840 2023-12-08T20:55:45.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.670+0000 7f6f337fe640 1 --2- 172.21.15.53:0/3591072781 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6f380664c0 0x7f6f38068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.670+0000 7f6f4affd640 1 --2- 172.21.15.53:0/3591072781 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6f380664c0 0x7f6f38068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.670+0000 7f6f4affd640 1 --2- 172.21.15.53:0/3591072781 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6f380664c0 0x7f6f38068980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c007fd0 tx=0x7f6f3c007940 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.670+0000 7f56f8ff9640 1 -- 172.21.15.53:0/82704063 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f56f0055b60 con 0x7f56fc0c1110 2023-12-08T20:55:45.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.674+0000 7f6f337fe640 1 -- 172.21.15.53:0/3591072781 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f440f16c0 con 0x7f6f4c150840 2023-12-08T20:55:45.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.674+0000 7f56f8ff9640 1 -- 172.21.15.53:0/82704063 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56f00517a0 con 0x7f56fc0c1110 2023-12-08T20:55:45.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.698+0000 7f6f337fe640 1 -- 172.21.15.53:0/3591072781 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f440ed300 con 0x7f6f4c150840 2023-12-08T20:55:45.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f657fa640 1 -- 172.21.15.53:0/2585446329 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f680cee50 con 0x7f4f600dad30 2023-12-08T20:55:45.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f3cf37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf40c94b0 0x7f3cf40c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.710 INFO:teuthology.orchestra.run.smithi053.stdout:64424509461 2023-12-08T20:55:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f3cf37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf40c94b0 0x7f3cf40c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56618/0 (socket says 172.21.15.53:56618) 2023-12-08T20:55:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f3cf37fe640 1 -- 172.21.15.53:0/3749198529 learned_addr learned my addr 172.21.15.53:0/3749198529 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2585446329 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4f4c0664f0 msgr2=0x7f4f4c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f6f1fc640 1 --2- 172.21.15.53:0/2585446329 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4f4c0664f0 0x7f4f4c0689b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0b2000 tx=0x7f4f5c004740 comp rx=0 tx=0).stop 2023-12-08T20:55:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2585446329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f600dad30 msgr2=0x7f4f6004f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f6f1fc640 1 --2- 172.21.15.53:0/2585446329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f600dad30 0x7f4f6004f370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f68050190 tx=0x7f4f680680e0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2585446329 shutdown_connections 2023-12-08T20:55:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f6f1fc640 1 --2- 172.21.15.53:0/2585446329 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4f4c0664f0 0x7f4f4c0689b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f6f1fc640 1 --2- 172.21.15.53:0/2585446329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f600d9f00 0x7f4f60175340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f6f1fc640 1 --2- 172.21.15.53:0/2585446329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f600dad30 0x7f4f6004f370 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f6f1fc640 1 --2- 172.21.15.53:0/2585446329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f6004c2e0 0x7f4f600deb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2585446329 >> 172.21.15.53:0/2585446329 conn(0x7f4f60050190 msgr2=0x7f4f600467e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2585446329 shutdown_connections 2023-12-08T20:55:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.710+0000 7f4f6f1fc640 1 -- 172.21.15.53:0/2585446329 wait complete. 2023-12-08T20:55:45.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.714+0000 7f3cf3fff640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cf40c7090 0x7f3cf406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.718+0000 7f3cf3fff640 1 -- 172.21.15.53:0/3749198529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cf41f6310 msgr2=0x7f3cf40c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.718+0000 7f3cf3fff640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cf41f6310 0x7f3cf40c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.718+0000 7f3cf3fff640 1 -- 172.21.15.53:0/3749198529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf40c94b0 msgr2=0x7f3cf40c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.718+0000 7f3cf3fff640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf40c94b0 0x7f3cf40c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.718+0000 7f3cf3fff640 1 -- 172.21.15.53:0/3749198529 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40094d0 con 0x7f3cf40c7090 2023-12-08T20:55:45.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509461 for osd.1 2023-12-08T20:55:45.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.754+0000 7f3cf3fff640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cf40c7090 0x7f3cf406fba0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40ac000 tx=0x7f3ce4019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.754+0000 7f575dffb640 1 -- 172.21.15.53:0/1873611237 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57640b7070 con 0x7f576806a810 2023-12-08T20:55:45.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.754+0000 7f575dffb640 1 --2- 172.21.15.53:0/1873611237 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f574c0664c0 0x7f574c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.754+0000 7f576c901640 1 --2- 172.21.15.53:0/1873611237 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f574c0664c0 0x7f574c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.758+0000 7f576c901640 1 --2- 172.21.15.53:0/1873611237 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f574c0664c0 0x7f574c068980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f57680c6290 tx=0x7f5758006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.774+0000 7f575dffb640 1 -- 172.21.15.53:0/1873611237 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57640f45f0 con 0x7f576806a810 2023-12-08T20:55:45.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.806+0000 7fc016ffd640 1 -- 172.21.15.53:0/4038350597 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0201e95b0 con 0x7fc020161ad0 2023-12-08T20:55:45.807 INFO:teuthology.orchestra.run.smithi053.stdout:64424509460 2023-12-08T20:55:45.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.810+0000 7fc024e81640 1 -- 172.21.15.53:0/4038350597 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc0000664c0 msgr2=0x7fc000068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.810+0000 7fc024e81640 1 --2- 172.21.15.53:0/4038350597 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc0000664c0 0x7fc000068980 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0080098f0 tx=0x7fc008006f90 comp rx=0 tx=0).stop 2023-12-08T20:55:45.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.810+0000 7fc024e81640 1 -- 172.21.15.53:0/4038350597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc020161ad0 msgr2=0x7fc0201f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.810+0000 7fc024e81640 1 --2- 172.21.15.53:0/4038350597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc020161ad0 0x7fc0201f3a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc01800b9e0 tx=0x7fc01800bea0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.810+0000 7fc024e81640 1 -- 172.21.15.53:0/4038350597 shutdown_connections 2023-12-08T20:55:45.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.810+0000 7fc024e81640 1 --2- 172.21.15.53:0/4038350597 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc0000664c0 0x7fc000068980 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.810+0000 7fc024e81640 1 --2- 172.21.15.53:0/4038350597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc020161ad0 0x7fc0201f3a70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.810+0000 7fc024e81640 1 --2- 172.21.15.53:0/4038350597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc020157b40 0x7fc0200c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.810+0000 7fc024e81640 1 --2- 172.21.15.53:0/4038350597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0200cceb0 0x7fc0200b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.810+0000 7fc024e81640 1 -- 172.21.15.53:0/4038350597 >> 172.21.15.53:0/4038350597 conn(0x7fc020060fd0 msgr2=0x7fc020073900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:45.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.810+0000 7fc024e81640 1 -- 172.21.15.53:0/4038350597 shutdown_connections 2023-12-08T20:55:45.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.810+0000 7fc024e81640 1 -- 172.21.15.53:0/4038350597 wait complete. 2023-12-08T20:55:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.822+0000 7f575dffb640 1 -- 172.21.15.53:0/1873611237 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57640f0230 con 0x7f576806a810 2023-12-08T20:55:45.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509460 for osd.5 2023-12-08T20:55:45.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.854+0000 7f57029e5640 1 -- 172.21.15.53:0/82704063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f56fc0b1850 con 0x7f56fc0c1110 2023-12-08T20:55:45.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.858+0000 7f56f8ff9640 1 -- 172.21.15.53:0/82704063 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56f001e090 con 0x7f56fc0c1110 2023-12-08T20:55:45.858 INFO:teuthology.orchestra.run.smithi053.stdout:64424509460 2023-12-08T20:55:45.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.862+0000 7f57029e5640 1 -- 172.21.15.53:0/82704063 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f56e80664c0 msgr2=0x7f56e8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.862+0000 7f57029e5640 1 --2- 172.21.15.53:0/82704063 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f56e80664c0 0x7f56e8068980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0b1000 tx=0x7f56ec004740 comp rx=0 tx=0).stop 2023-12-08T20:55:45.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.862+0000 7f57029e5640 1 -- 172.21.15.53:0/82704063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0c1110 msgr2=0x7f56fc1587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:45.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.862+0000 7f57029e5640 1 --2- 172.21.15.53:0/82704063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0c1110 0x7f56fc1587c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f56f000b480 tx=0x7f56f000b940 comp rx=0 tx=0).stop 2023-12-08T20:55:45.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.862+0000 7f57029e5640 1 -- 172.21.15.53:0/82704063 shutdown_connections 2023-12-08T20:55:45.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.862+0000 7f57029e5640 1 --2- 172.21.15.53:0/82704063 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f56e80664c0 0x7f56e8068980 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.862+0000 7f57029e5640 1 --2- 172.21.15.53:0/82704063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56fc0c94b0 0x7f56fc158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.862+0000 7f57029e5640 1 --2- 172.21.15.53:0/82704063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0c1110 0x7f56fc1587c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.862+0000 7f57029e5640 1 --2- 172.21.15.53:0/82704063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56fc0b1c80 0x7f56fc1ee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:45.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.862+0000 7f57029e5640 1 -- 172.21.15.53:0/82704063 >> 172.21.15.53:0/82704063 conn(0x7f56fc0c8990 msgr2=0x7f56fc14e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:45.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.862+0000 7f57029e5640 1 -- 172.21.15.53:0/82704063 shutdown_connections 2023-12-08T20:55:45.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.862+0000 7f57029e5640 1 -- 172.21.15.53:0/82704063 wait complete. 2023-12-08T20:55:45.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509460 for osd.3 2023-12-08T20:55:45.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.882+0000 7f6f5166c640 1 -- 172.21.15.53:0/3591072781 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6f4c0c2330 con 0x7f6f4c150840 2023-12-08T20:55:45.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.930+0000 7f3cf0ff9640 1 -- 172.21.15.53:0/3749198529 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40b4830 con 0x7f3cf40c7090 2023-12-08T20:55:45.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.930+0000 7f3cf0ff9640 1 -- 172.21.15.53:0/3749198529 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce40b49b0 con 0x7f3cf40c7090 2023-12-08T20:55:45.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.930+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/3749198529 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf40c2970 con 0x7f3cf40c7090 2023-12-08T20:55:45.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.930+0000 7f3cf0ff9640 1 -- 172.21.15.53:0/3749198529 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40b4d60 con 0x7f3cf40c7090 2023-12-08T20:55:45.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.930+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/3749198529 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf40c1200 con 0x7f3cf40c7090 2023-12-08T20:55:45.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.934+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/3749198529 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf406c650 con 0x7f3cf40c7090 2023-12-08T20:55:45.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.962+0000 7f3cf0ff9640 1 -- 172.21.15.53:0/3749198529 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ce40aa490 con 0x7f3cf40c7090 2023-12-08T20:55:45.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.962+0000 7f3cf0ff9640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ce00664c0 0x7f3ce0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:45.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.962+0000 7f3cf37fe640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ce00664c0 0x7f3ce0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:45.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.966+0000 7f3cf37fe640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ce00664c0 0x7f3ce0068980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8006fd0 tx=0x7f3ce8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:45.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:45.994+0000 7f576f366640 1 -- 172.21.15.53:0/1873611237 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f57680714e0 con 0x7f576806a810 2023-12-08T20:55:46.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.014+0000 7fb3d5ffb640 1 -- 172.21.15.53:0/931187186 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3dc0c9480 con 0x7fb3e00cceb0 2023-12-08T20:55:46.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.018+0000 7fb3d5ffb640 1 --2- 172.21.15.53:0/931187186 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb3c4066470 0x7fb3c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:46.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.018+0000 7fb3e530f640 1 --2- 172.21.15.53:0/931187186 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb3c4066470 0x7fb3c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.018+0000 7fb3e530f640 1 --2- 172.21.15.53:0/931187186 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb3c4066470 0x7fb3c4068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009730 tx=0x7fb3d0006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:46.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.030+0000 7fb3d5ffb640 1 -- 172.21.15.53:0/931187186 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb3dc0efef0 con 0x7fb3e00cceb0 2023-12-08T20:55:46.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.070+0000 7fb3d5ffb640 1 -- 172.21.15.53:0/931187186 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3dc0ec230 con 0x7fb3e00cceb0 2023-12-08T20:55:46.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.070+0000 7f9f2effd640 1 -- 172.21.15.53:0/2193266509 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f340b5020 con 0x7f9f38070e90 2023-12-08T20:55:46.072 INFO:teuthology.orchestra.run.smithi053.stdout:64424509459 2023-12-08T20:55:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.074+0000 7f9f407c0640 1 -- 172.21.15.53:0/2193266509 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9f1c066470 msgr2=0x7f9f1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.074+0000 7f9f407c0640 1 --2- 172.21.15.53:0/2193266509 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9f1c066470 0x7f9f1c068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9f28006aa0 tx=0x7f9f28006a30 comp rx=0 tx=0).stop 2023-12-08T20:55:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.074+0000 7f9f407c0640 1 -- 172.21.15.53:0/2193266509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f38070e90 msgr2=0x7f9f380ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.074+0000 7f9f407c0640 1 --2- 172.21.15.53:0/2193266509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f38070e90 0x7f9f380ca0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f3401b940 tx=0x7f9f3401bad0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.074+0000 7f9f407c0640 1 -- 172.21.15.53:0/2193266509 shutdown_connections 2023-12-08T20:55:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.074+0000 7f9f407c0640 1 --2- 172.21.15.53:0/2193266509 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9f1c066470 0x7f9f1c068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.074+0000 7f9f407c0640 1 --2- 172.21.15.53:0/2193266509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f380c0570 0x7f9f38159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.074+0000 7f9f407c0640 1 --2- 172.21.15.53:0/2193266509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f38070e90 0x7f9f380ca0d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.074+0000 7f9f407c0640 1 --2- 172.21.15.53:0/2193266509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3806e7a0 0x7f9f381625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.074+0000 7f9f407c0640 1 -- 172.21.15.53:0/2193266509 >> 172.21.15.53:0/2193266509 conn(0x7f9f380caef0 msgr2=0x7f9f3806eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:46.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.074+0000 7f9f407c0640 1 -- 172.21.15.53:0/2193266509 shutdown_connections 2023-12-08T20:55:46.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.078+0000 7f9f407c0640 1 -- 172.21.15.53:0/2193266509 wait complete. 2023-12-08T20:55:46.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509459 for osd.2 2023-12-08T20:55:46.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.154+0000 7f6f337fe640 1 -- 172.21.15.53:0/3591072781 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f4c0c2330 con 0x7f6f4c150840 2023-12-08T20:55:46.155 INFO:teuthology.orchestra.run.smithi053.stdout:60129542163 2023-12-08T20:55:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.158+0000 7f6f5166c640 1 -- 172.21.15.53:0/3591072781 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6f380664c0 msgr2=0x7f6f38068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.158+0000 7f6f5166c640 1 --2- 172.21.15.53:0/3591072781 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6f380664c0 0x7f6f38068980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c007fd0 tx=0x7f6f3c007940 comp rx=0 tx=0).stop 2023-12-08T20:55:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.158+0000 7f6f5166c640 1 -- 172.21.15.53:0/3591072781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c150840 msgr2=0x7f6f4c1f0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.158+0000 7f6f5166c640 1 --2- 172.21.15.53:0/3591072781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c150840 0x7f6f4c1f0b70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009d90 tx=0x7f6f44019680 comp rx=0 tx=0).stop 2023-12-08T20:55:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.158+0000 7f6f5166c640 1 -- 172.21.15.53:0/3591072781 shutdown_connections 2023-12-08T20:55:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.158+0000 7f6f5166c640 1 --2- 172.21.15.53:0/3591072781 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6f380664c0 0x7f6f38068980 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.158+0000 7f6f5166c640 1 --2- 172.21.15.53:0/3591072781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c150840 0x7f6f4c1f0b70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.158+0000 7f6f5166c640 1 --2- 172.21.15.53:0/3591072781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c0c1110 0x7f6f4c143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.158+0000 7f6f5166c640 1 --2- 172.21.15.53:0/3591072781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f4c0b1c80 0x7f6f4c148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.158+0000 7f6f5166c640 1 -- 172.21.15.53:0/3591072781 >> 172.21.15.53:0/3591072781 conn(0x7f6f4c0c8990 msgr2=0x7f6f4c0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:46.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.158+0000 7f6f5166c640 1 -- 172.21.15.53:0/3591072781 shutdown_connections 2023-12-08T20:55:46.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.158+0000 7f6f5166c640 1 -- 172.21.15.53:0/3591072781 wait complete. 2023-12-08T20:55:46.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542164 got 60129542163 for osd.4 2023-12-08T20:55:46.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.226+0000 7f3cf0ff9640 1 -- 172.21.15.53:0/3749198529 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ce40a92f0 con 0x7f3cf40c7090 2023-12-08T20:55:46.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.238+0000 7f3cf0ff9640 1 -- 172.21.15.53:0/3749198529 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ce40eacc0 con 0x7f3cf40c7090 2023-12-08T20:55:46.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.238+0000 7fb3e7573640 1 -- 172.21.15.53:0/931187186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb3e0074190 con 0x7fb3e00cceb0 2023-12-08T20:55:46.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.250+0000 7fb3d5ffb640 1 -- 172.21.15.53:0/931187186 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb3dc0c4020 con 0x7fb3e00cceb0 2023-12-08T20:55:46.252 INFO:teuthology.orchestra.run.smithi053.stdout:60129542164 2023-12-08T20:55:46.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f575dffb640 1 -- 172.21.15.53:0/1873611237 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57640b5020 con 0x7f576806a810 2023-12-08T20:55:46.254 INFO:teuthology.orchestra.run.smithi053.stdout:64424509460 2023-12-08T20:55:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7fb3e7573640 1 -- 172.21.15.53:0/931187186 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb3c4066470 msgr2=0x7fb3c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7fb3e7573640 1 --2- 172.21.15.53:0/931187186 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb3c4066470 0x7fb3c4068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009730 tx=0x7fb3d0006ca0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7fb3e7573640 1 -- 172.21.15.53:0/931187186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3e00cceb0 msgr2=0x7fb3e00b1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7fb3e7573640 1 --2- 172.21.15.53:0/931187186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3e00cceb0 0x7fb3e00b1190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc01cd10 tx=0x7fb3dc01acb0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7fb3e7573640 1 -- 172.21.15.53:0/931187186 shutdown_connections 2023-12-08T20:55:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7fb3e7573640 1 --2- 172.21.15.53:0/931187186 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb3c4066470 0x7fb3c4068930 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7fb3e7573640 1 --2- 172.21.15.53:0/931187186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3e0151350 0x7fb3e00c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7fb3e7573640 1 --2- 172.21.15.53:0/931187186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3e00cceb0 0x7fb3e00b1190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7fb3e7573640 1 --2- 172.21.15.53:0/931187186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3e00c7d20 0x7fb3e006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7fb3e7573640 1 -- 172.21.15.53:0/931187186 >> 172.21.15.53:0/931187186 conn(0x7fb3e0060fd0 msgr2=0x7fb3e00613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:46.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7fb3e7573640 1 -- 172.21.15.53:0/931187186 shutdown_connections 2023-12-08T20:55:46.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7fb3e7573640 1 -- 172.21.15.53:0/931187186 wait complete. 2023-12-08T20:55:46.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f576f366640 1 -- 172.21.15.53:0/1873611237 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f574c0664c0 msgr2=0x7f574c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f576f366640 1 --2- 172.21.15.53:0/1873611237 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f574c0664c0 0x7f574c068980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f57680c6290 tx=0x7f5758006ca0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f576f366640 1 -- 172.21.15.53:0/1873611237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 msgr2=0x7f576814f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f576f366640 1 --2- 172.21.15.53:0/1873611237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 0x7f576814f6e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f57640b3040 tx=0x7f576401ba90 comp rx=0 tx=0).stop 2023-12-08T20:55:46.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f576f366640 1 -- 172.21.15.53:0/1873611237 shutdown_connections 2023-12-08T20:55:46.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f576f366640 1 --2- 172.21.15.53:0/1873611237 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f574c0664c0 0x7f574c068980 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f576f366640 1 --2- 172.21.15.53:0/1873611237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f576815d870 0x7f57681f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f576f366640 1 --2- 172.21.15.53:0/1873611237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576806abf0 0x7f57681efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f576f366640 1 --2- 172.21.15.53:0/1873611237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576806a810 0x7f576814f6e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f576f366640 1 -- 172.21.15.53:0/1873611237 >> 172.21.15.53:0/1873611237 conn(0x7f57680c8990 msgr2=0x7f57680cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f576f366640 1 -- 172.21.15.53:0/1873611237 shutdown_connections 2023-12-08T20:55:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.254+0000 7f576f366640 1 -- 172.21.15.53:0/1873611237 wait complete. 2023-12-08T20:55:46.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542165 got 60129542164 for osd.7 2023-12-08T20:55:46.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509460 for osd.0 2023-12-08T20:55:46.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.398+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/3749198529 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3cf4074190 con 0x7f3cf40c7090 2023-12-08T20:55:46.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.402+0000 7f3cf0ff9640 1 -- 172.21.15.53:0/3749198529 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ce40ee2e0 con 0x7f3cf40c7090 2023-12-08T20:55:46.403 INFO:teuthology.orchestra.run.smithi053.stdout:60129542166 2023-12-08T20:55:46.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.406+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/3749198529 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ce00664c0 msgr2=0x7f3ce0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.406+0000 7f3cfa2e0640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ce00664c0 0x7f3ce0068980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8006fd0 tx=0x7f3ce8008040 comp rx=0 tx=0).stop 2023-12-08T20:55:46.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.406+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/3749198529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cf40c7090 msgr2=0x7f3cf406fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.406+0000 7f3cfa2e0640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cf40c7090 0x7f3cf406fba0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40ac000 tx=0x7f3ce4019210 comp rx=0 tx=0).stop 2023-12-08T20:55:46.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.406+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/3749198529 shutdown_connections 2023-12-08T20:55:46.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.406+0000 7f3cfa2e0640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ce00664c0 0x7f3ce0068980 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.406+0000 7f3cfa2e0640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cf41f6310 0x7f3cf40c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.406+0000 7f3cfa2e0640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf40c94b0 0x7f3cf40c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.406+0000 7f3cfa2e0640 1 --2- 172.21.15.53:0/3749198529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cf40c7090 0x7f3cf406fba0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.406+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/3749198529 >> 172.21.15.53:0/3749198529 conn(0x7f3cf40c8990 msgr2=0x7f3cf4143b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:46.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.406+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/3749198529 shutdown_connections 2023-12-08T20:55:46.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.406+0000 7f3cfa2e0640 1 -- 172.21.15.53:0/3749198529 wait complete. 2023-12-08T20:55:46.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542166 got 60129542166 for osd.6 2023-12-08T20:55:46.421 DEBUG:teuthology.parallel:result is None 2023-12-08T20:55:46.730 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-08T20:55:46.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-08T20:55:46.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.874+0000 7f6d9a4cf640 1 Processor -- start 2023-12-08T20:55:46.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.874+0000 7f6d9a4cf640 1 -- start start 2023-12-08T20:55:46.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.874+0000 7f6d9a4cf640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d94151770 0x7f6d940ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:46.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.874+0000 7f6d9a4cf640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d940c8e60 0x7f6d940b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:46.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.874+0000 7f6d9a4cf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d940c9fd0 con 0x7f6d9415b400 2023-12-08T20:55:46.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.874+0000 7f6d9a4cf640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d940b0920 con 0x7f6d940c8e60 2023-12-08T20:55:46.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.874+0000 7f6d9a4cf640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940cd9b0 con 0x7f6d94151770 2023-12-08T20:55:46.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.874+0000 7f6d8b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6d9415b400 0x7f6d940cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53446/0 (socket says 172.21.15.53:53446) 2023-12-08T20:55:46.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.874+0000 7f6d8b7fe640 1 -- 172.21.15.53:0/277132541 learned_addr learned my addr 172.21.15.53:0/277132541 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:46.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.874+0000 7f6d93fff640 1 --2- 172.21.15.53:0/277132541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d94151770 0x7f6d940ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:46.877 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-08T20:55:46.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.878+0000 7f6d937fe640 1 -- 172.21.15.53:0/277132541 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259403031 0 0) 0x7f6d940c9fd0 con 0x7f6d9415b400 2023-12-08T20:55:46.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.878+0000 7f6d937fe640 1 -- 172.21.15.53:0/277132541 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d80003530 con 0x7f6d9415b400 2023-12-08T20:55:46.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.878+0000 7f6d98a6c640 1 --2- 172.21.15.53:0/277132541 >> v2:172.21.15.146:3300/0 conn(0x7f6d940c8e60 0x7f6d940b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:46.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.882+0000 7f6d93fff640 1 -- 172.21.15.53:0/277132541 >> v2:172.21.15.146:3300/0 conn(0x7f6d940c8e60 msgr2=0x7f6d940b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:46.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.882+0000 7f6d93fff640 1 --2- 172.21.15.53:0/277132541 >> v2:172.21.15.146:3300/0 conn(0x7f6d940c8e60 0x7f6d940b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.882+0000 7f6d93fff640 1 -- 172.21.15.53:0/277132541 >> v1:172.21.15.53:6789/0 conn(0x7f6d9415b400 legacy=0x7f6d940cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.882+0000 7f6d93fff640 1 -- 172.21.15.53:0/277132541 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9415b920 con 0x7f6d94151770 2023-12-08T20:55:46.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.886+0000 7f6d93fff640 1 --2- 172.21.15.53:0/277132541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d94151770 0x7f6d940ca460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d840097c0 tx=0x7f6d8401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56a690a9c82e2e9f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:46.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.894+0000 7f6d937fe640 1 -- 172.21.15.53:0/277132541 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d840ab650 con 0x7f6d94151770 2023-12-08T20:55:46.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.894+0000 7f6d937fe640 1 -- 172.21.15.53:0/277132541 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d840ab7b0 con 0x7f6d94151770 2023-12-08T20:55:46.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.894+0000 7f6d937fe640 1 -- 172.21.15.53:0/277132541 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d840abb40 con 0x7f6d94151770 2023-12-08T20:55:46.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/277132541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d94151770 msgr2=0x7f6d940ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 --2- 172.21.15.53:0/277132541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d94151770 0x7f6d940ca460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d840097c0 tx=0x7f6d8401c450 comp rx=0 tx=0).stop 2023-12-08T20:55:46.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/277132541 shutdown_connections 2023-12-08T20:55:46.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 --2- 172.21.15.53:0/277132541 >> v2:172.21.15.146:3300/0 conn(0x7f6d940c8e60 0x7f6d940b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 --2- 172.21.15.53:0/277132541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d94151770 0x7f6d940ca460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/277132541 >> 172.21.15.53:0/277132541 conn(0x7f6d94070c20 msgr2=0x7f6d94071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:46.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/277132541 shutdown_connections 2023-12-08T20:55:46.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/277132541 wait complete. 2023-12-08T20:55:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 Processor -- start 2023-12-08T20:55:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 -- start start 2023-12-08T20:55:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d940c8e60 0x7f6d94156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d94151770 0x7f6d9414db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d9415b400 0x7f6d94153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d941560d0 con 0x7f6d9415b400 2023-12-08T20:55:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94159770 con 0x7f6d94151770 2023-12-08T20:55:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d9a4cf640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94155450 con 0x7f6d940c8e60 2023-12-08T20:55:46.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d98a6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d9415b400 0x7f6d94153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:46.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d98a6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d9415b400 0x7f6d94153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56622/0 (socket says 172.21.15.53:56622) 2023-12-08T20:55:46.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.898+0000 7f6d98a6c640 1 -- 172.21.15.53:0/1286242684 learned_addr learned my addr 172.21.15.53:0/1286242684 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:46.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.902+0000 7f6d8b7fe640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d94151770 0x7f6d9414db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:46.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.902+0000 7f6d93fff640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d940c8e60 0x7f6d94156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:46.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.906+0000 7f6d98a6c640 1 -- 172.21.15.53:0/1286242684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d940c8e60 msgr2=0x7f6d94156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.906+0000 7f6d98a6c640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d940c8e60 0x7f6d94156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.906+0000 7f6d98a6c640 1 -- 172.21.15.53:0/1286242684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d94151770 msgr2=0x7f6d9414db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.906+0000 7f6d98a6c640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d94151770 0x7f6d9414db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.906+0000 7f6d98a6c640 1 -- 172.21.15.53:0/1286242684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d84009420 con 0x7f6d9415b400 2023-12-08T20:55:46.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.906+0000 7f6d98a6c640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d9415b400 0x7f6d94153c10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00efc0 tx=0x7f6d8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:46.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.910+0000 7f6d917fa640 1 -- 172.21.15.53:0/1286242684 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c009b20 con 0x7f6d9415b400 2023-12-08T20:55:46.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.910+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/1286242684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d94155730 con 0x7f6d9415b400 2023-12-08T20:55:46.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.910+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/1286242684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d94155cf0 con 0x7f6d9415b400 2023-12-08T20:55:46.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.910+0000 7f6d917fa640 1 -- 172.21.15.53:0/1286242684 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c00f040 con 0x7f6d9415b400 2023-12-08T20:55:46.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.910+0000 7f6d917fa640 1 -- 172.21.15.53:0/1286242684 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c014680 con 0x7f6d9415b400 2023-12-08T20:55:46.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.914+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/1286242684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d78005260 con 0x7f6d9415b400 2023-12-08T20:55:46.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.954+0000 7f281580d640 1 Processor -- start 2023-12-08T20:55:46.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.954+0000 7f281580d640 1 -- start start 2023-12-08T20:55:46.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.954+0000 7f281580d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2810153960 0x7f281006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:46.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.954+0000 7f281580d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f281006edd0 0x7f281006aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:46.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.954+0000 7f281580d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2810159610 con 0x7f28100c2de0 2023-12-08T20:55:46.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.954+0000 7f281580d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2810153d40 con 0x7f281006edd0 2023-12-08T20:55:46.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.954+0000 7f281580d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28101598d0 con 0x7f2810153960 2023-12-08T20:55:46.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.954+0000 7f280effd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2810153960 0x7f281006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:46.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.958+0000 7f280effd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2810153960 0x7f281006a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:44210/0 (socket says 172.21.15.53:44210) 2023-12-08T20:55:46.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.958+0000 7f280effd640 1 -- 172.21.15.53:0/845700987 learned_addr learned my addr 172.21.15.53:0/845700987 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:46.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.962+0000 7f280effd640 1 -- 172.21.15.53:0/845700987 >> v2:172.21.15.53:3300/0 conn(0x7f281006edd0 msgr2=0x7f281006aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:46.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.962+0000 7f280effd640 1 --2- 172.21.15.53:0/845700987 >> v2:172.21.15.53:3300/0 conn(0x7f281006edd0 0x7f281006aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.962+0000 7f280effd640 1 -- 172.21.15.53:0/845700987 >> v1:172.21.15.53:6789/0 conn(0x7f28100c2de0 legacy=0x7f281015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:46.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.962+0000 7f280effd640 1 -- 172.21.15.53:0/845700987 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2810159bb0 con 0x7f2810153960 2023-12-08T20:55:46.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.970+0000 7f280effd640 1 --2- 172.21.15.53:0/845700987 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2810153960 0x7f281006a5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2800009870 tx=0x7f280001ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77566fb6ba28b28e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.978+0000 7f280dffb640 1 -- 172.21.15.53:0/845700987 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000a89b0 con 0x7f2810153960 2023-12-08T20:55:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.978+0000 7f280dffb640 1 -- 172.21.15.53:0/845700987 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28000a8b10 con 0x7f2810153960 2023-12-08T20:55:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.978+0000 7f280dffb640 1 -- 172.21.15.53:0/845700987 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000a8ea0 con 0x7f2810153960 2023-12-08T20:55:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.978+0000 7f281580d640 1 -- 172.21.15.53:0/845700987 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2810153960 msgr2=0x7f281006a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.978+0000 7f281580d640 1 --2- 172.21.15.53:0/845700987 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2810153960 0x7f281006a5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2800009870 tx=0x7f280001ecf0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.978+0000 7f281580d640 1 -- 172.21.15.53:0/845700987 shutdown_connections 2023-12-08T20:55:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.978+0000 7f281580d640 1 --2- 172.21.15.53:0/845700987 >> v2:172.21.15.53:3300/0 conn(0x7f281006edd0 0x7f281006aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.978+0000 7f281580d640 1 --2- 172.21.15.53:0/845700987 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2810153960 0x7f281006a5b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.978+0000 7f281580d640 1 -- 172.21.15.53:0/845700987 >> 172.21.15.53:0/845700987 conn(0x7f28100c8a00 msgr2=0x7f28100c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:46.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.978+0000 7f281580d640 1 -- 172.21.15.53:0/845700987 shutdown_connections 2023-12-08T20:55:46.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.978+0000 7f281580d640 1 -- 172.21.15.53:0/845700987 wait complete. 2023-12-08T20:55:46.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.982+0000 7f281580d640 1 Processor -- start 2023-12-08T20:55:46.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.982+0000 7f281580d640 1 -- start start 2023-12-08T20:55:46.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.982+0000 7f281580d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281006edd0 0x7f28101563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:46.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.982+0000 7f281580d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100c2de0 0x7f28101f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:46.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.982+0000 7f281580d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2810153960 0x7f28101f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:46.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.982+0000 7f281580d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28101e4900 con 0x7f28100c2de0 2023-12-08T20:55:46.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.982+0000 7f281580d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281014c910 con 0x7f281006edd0 2023-12-08T20:55:46.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.982+0000 7f281580d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28101e5350 con 0x7f2810153960 2023-12-08T20:55:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.982+0000 7f280effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281006edd0 0x7f28101563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.982+0000 7f280f7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2810153960 0x7f28101f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:46.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.986+0000 7f280effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281006edd0 0x7f28101563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40310/0 (socket says 172.21.15.53:40310) 2023-12-08T20:55:46.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.986+0000 7f280effd640 1 -- 172.21.15.53:0/3270580375 learned_addr learned my addr 172.21.15.53:0/3270580375 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:46.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.994+0000 7f280effd640 1 -- 172.21.15.53:0/3270580375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2810153960 msgr2=0x7f28101f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.994+0000 7f280effd640 1 --2- 172.21.15.53:0/3270580375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2810153960 0x7f28101f29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.994+0000 7f280effd640 1 -- 172.21.15.53:0/3270580375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100c2de0 msgr2=0x7f28101f24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:46.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.994+0000 7f280effd640 1 --2- 172.21.15.53:0/3270580375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100c2de0 0x7f28101f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:46.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:46.994+0000 7f280effd640 1 -- 172.21.15.53:0/3270580375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000094d0 con 0x7f281006edd0 2023-12-08T20:55:47.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.002+0000 7f280effd640 1 --2- 172.21.15.53:0/3270580375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281006edd0 0x7f28101563b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f280001d3a0 tx=0x7f280001ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.010+0000 7f2807fff640 1 -- 172.21.15.53:0/3270580375 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000b0e40 con 0x7f281006edd0 2023-12-08T20:55:47.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.010+0000 7f2807fff640 1 -- 172.21.15.53:0/3270580375 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28000b9440 con 0x7f281006edd0 2023-12-08T20:55:47.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.010+0000 7f2807fff640 1 -- 172.21.15.53:0/3270580375 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000b97f0 con 0x7f281006edd0 2023-12-08T20:55:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.010+0000 7f281580d640 1 -- 172.21.15.53:0/3270580375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281014bb90 con 0x7f281006edd0 2023-12-08T20:55:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.010+0000 7f281580d640 1 -- 172.21.15.53:0/3270580375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281014be30 con 0x7f281006edd0 2023-12-08T20:55:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.010+0000 7f281580d640 1 -- 172.21.15.53:0/3270580375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2810074190 con 0x7f281006edd0 2023-12-08T20:55:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.014+0000 7f2d24247640 1 Processor -- start 2023-12-08T20:55:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.014+0000 7f2d24247640 1 -- start start 2023-12-08T20:55:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.018+0000 7f2d24247640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d1c153760 0x7f2d1c061a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.018+0000 7f2d24247640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d1c0ca680 0x7f2d1c06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.018+0000 7f2d24247640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1c0c9870 con 0x7f2d1c153b40 2023-12-08T20:55:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.018+0000 7f2d24247640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1c0cb6a0 con 0x7f2d1c153760 2023-12-08T20:55:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.018+0000 7f2d24247640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1c0cabe0 con 0x7f2d1c0ca680 2023-12-08T20:55:47.098 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-08T20:55:47.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-08T20:55:47.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.222+0000 7f59a587e640 1 Processor -- start 2023-12-08T20:55:47.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.222+0000 7f59a587e640 1 -- start start 2023-12-08T20:55:47.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.222+0000 7f6d917fa640 1 -- 172.21.15.53:0/1286242684 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6d8c0147e0 con 0x7f6d9415b400 2023-12-08T20:55:47.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.222+0000 7f59a587e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f59a00c8680 0x7f59a01568a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.222+0000 7f59a587e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 0x7f59a00c5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.222+0000 7f59a587e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a0156410 con 0x7f59a006b7c0 2023-12-08T20:55:47.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.222+0000 7f59a587e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a0156100 con 0x7f59a00c8680 2023-12-08T20:55:47.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.222+0000 7f59a587e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00c7420 con 0x7f59a00c8a60 2023-12-08T20:55:47.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.222+0000 7f6d917fa640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6d74066470 0x7f6d74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.222+0000 7f6d93fff640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6d74066470 0x7f6d74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.222+0000 7f599e7fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 0x7f59a00c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.222+0000 7f6d93fff640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6d74066470 0x7f6d74068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6d840af000 tx=0x7f6d840a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.226+0000 7f599e7fc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 0x7f59a00c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:44230/0 (socket says 172.21.15.53:44230) 2023-12-08T20:55:47.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.226+0000 7f599e7fc640 1 -- 172.21.15.53:0/1649091517 learned_addr learned my addr 172.21.15.53:0/1649091517 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:47.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.230+0000 7f599e7fc640 1 -- 172.21.15.53:0/1649091517 >> v2:172.21.15.146:3300/0 conn(0x7f59a00c8680 msgr2=0x7f59a01568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:47.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.230+0000 7f599e7fc640 1 --2- 172.21.15.53:0/1649091517 >> v2:172.21.15.146:3300/0 conn(0x7f59a00c8680 0x7f59a01568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.230+0000 7f599e7fc640 1 -- 172.21.15.53:0/1649091517 >> v1:172.21.15.53:6789/0 conn(0x7f59a006b7c0 legacy=0x7f59a014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:47.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.230+0000 7f599e7fc640 1 -- 172.21.15.53:0/1649091517 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00c7700 con 0x7f59a00c8a60 2023-12-08T20:55:47.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.234+0000 7f599e7fc640 1 --2- 172.21.15.53:0/1649091517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 0x7f59a00c5020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5994009870 tx=0x7f5994020f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3c6ce5533113168 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.242+0000 7f6d917fa640 1 -- 172.21.15.53:0/1286242684 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6d8c0569b0 con 0x7f6d9415b400 2023-12-08T20:55:47.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.242+0000 7f6d917fa640 1 -- 172.21.15.53:0/1286242684 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d8c0525f0 con 0x7f6d9415b400 2023-12-08T20:55:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.242+0000 7f599dffb640 1 -- 172.21.15.53:0/1649091517 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59940aabc0 con 0x7f59a00c8a60 2023-12-08T20:55:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.242+0000 7f599dffb640 1 -- 172.21.15.53:0/1649091517 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59940aad20 con 0x7f59a00c8a60 2023-12-08T20:55:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.242+0000 7f599dffb640 1 -- 172.21.15.53:0/1649091517 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59940b2660 con 0x7f59a00c8a60 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 -- 172.21.15.53:0/1649091517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 msgr2=0x7f59a00c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 --2- 172.21.15.53:0/1649091517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 0x7f59a00c5020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5994009870 tx=0x7f5994020f00 comp rx=0 tx=0).stop 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 -- 172.21.15.53:0/1649091517 shutdown_connections 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 --2- 172.21.15.53:0/1649091517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 0x7f59a00c5020 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 --2- 172.21.15.53:0/1649091517 >> v2:172.21.15.146:3300/0 conn(0x7f59a00c8680 0x7f59a01568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 -- 172.21.15.53:0/1649091517 >> 172.21.15.53:0/1649091517 conn(0x7f59a00cb950 msgr2=0x7f59a00cbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 -- 172.21.15.53:0/1649091517 shutdown_connections 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 -- 172.21.15.53:0/1649091517 wait complete. 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 Processor -- start 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 -- start start 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a006b7c0 0x7f59a01ee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59a00c8680 0x7f59a00c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 0x7f59a014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a01f27b0 con 0x7f59a00c8680 2023-12-08T20:55:47.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a014ec60 con 0x7f59a006b7c0 2023-12-08T20:55:47.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.246+0000 7f59a587e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a014ef40 con 0x7f59a00c8a60 2023-12-08T20:55:47.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.250+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 0x7f59a014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.250+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 0x7f59a014f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:44244/0 (socket says 172.21.15.53:44244) 2023-12-08T20:55:47.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.250+0000 7f599f7fe640 1 -- 172.21.15.53:0/3169316280 learned_addr learned my addr 172.21.15.53:0/3169316280 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:47.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.258+0000 7f599f7fe640 1 -- 172.21.15.53:0/3169316280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a006b7c0 msgr2=0x7f59a01ee9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.258+0000 7f599f7fe640 1 --2- 172.21.15.53:0/3169316280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a006b7c0 0x7f59a01ee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.258+0000 7f599f7fe640 1 -- 172.21.15.53:0/3169316280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59a00c8680 msgr2=0x7f59a00c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.258+0000 7f599f7fe640 1 --2- 172.21.15.53:0/3169316280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59a00c8680 0x7f59a00c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.258+0000 7f599f7fe640 1 -- 172.21.15.53:0/3169316280 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59940094d0 con 0x7f59a00c8a60 2023-12-08T20:55:47.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.266+0000 7f599f7fe640 1 --2- 172.21.15.53:0/3169316280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 0x7f59a014f220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f599800c410 tx=0x7f599800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.270+0000 7f2d21fe3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d1c153760 0x7f2d1c061a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.270+0000 7f2d21fe3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d1c153760 0x7f2d1c061a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56648/0 (socket says 172.21.15.53:56648) 2023-12-08T20:55:47.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.270+0000 7f2d21fe3640 1 -- 172.21.15.53:0/1096659835 learned_addr learned my addr 172.21.15.53:0/1096659835 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:47.274 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-08T20:55:47.274 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-08T20:55:47.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.274+0000 7f5987fff640 1 -- 172.21.15.53:0/3169316280 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998003600 con 0x7f59a00c8a60 2023-12-08T20:55:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.274+0000 7f5987fff640 1 -- 172.21.15.53:0/3169316280 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5998003760 con 0x7f59a00c8a60 2023-12-08T20:55:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.274+0000 7f59a587e640 1 -- 172.21.15.53:0/3169316280 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a01f2160 con 0x7f59a00c8a60 2023-12-08T20:55:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.274+0000 7f5987fff640 1 -- 172.21.15.53:0/3169316280 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998003b10 con 0x7f59a00c8a60 2023-12-08T20:55:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.274+0000 7f59a587e640 1 -- 172.21.15.53:0/3169316280 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a01dff70 con 0x7f59a00c8a60 2023-12-08T20:55:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.274+0000 7f59a587e640 1 -- 172.21.15.53:0/3169316280 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a01f1fc0 con 0x7f59a00c8a60 2023-12-08T20:55:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.274+0000 7f2d21fe3640 1 -- 172.21.15.53:0/1096659835 >> v2:172.21.15.146:3300/0 conn(0x7f2d1c0ca680 msgr2=0x7f2d1c06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:47.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.274+0000 7f2d21fe3640 1 --2- 172.21.15.53:0/1096659835 >> v2:172.21.15.146:3300/0 conn(0x7f2d1c0ca680 0x7f2d1c06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.278+0000 7f2d21fe3640 1 -- 172.21.15.53:0/1096659835 >> v1:172.21.15.146:6789/0 conn(0x7f2d1c153b40 legacy=0x7f2d1c0cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:47.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.278+0000 7f2d21fe3640 1 -- 172.21.15.53:0/1096659835 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c15d670 con 0x7f2d1c153760 2023-12-08T20:55:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.278+0000 7f2d21fe3640 1 --2- 172.21.15.53:0/1096659835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c153760 0x7f2d1c061a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009870 tx=0x7f2d1801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb5412c8ac15dc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.286+0000 7f2d20fe1640 1 -- 172.21.15.53:0/1096659835 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d180a89b0 con 0x7f2d1c153760 2023-12-08T20:55:47.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.286+0000 7f2d20fe1640 1 -- 172.21.15.53:0/1096659835 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d180a8b10 con 0x7f2d1c153760 2023-12-08T20:55:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.286+0000 7f2d20fe1640 1 -- 172.21.15.53:0/1096659835 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d180a8ea0 con 0x7f2d1c153760 2023-12-08T20:55:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.286+0000 7f2d24247640 1 -- 172.21.15.53:0/1096659835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c153760 msgr2=0x7f2d1c061a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.286+0000 7f2d24247640 1 --2- 172.21.15.53:0/1096659835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c153760 0x7f2d1c061a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009870 tx=0x7f2d1801ecb0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.286+0000 7f2d24247640 1 -- 172.21.15.53:0/1096659835 shutdown_connections 2023-12-08T20:55:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.286+0000 7f2d24247640 1 --2- 172.21.15.53:0/1096659835 >> v2:172.21.15.146:3300/0 conn(0x7f2d1c0ca680 0x7f2d1c06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.286+0000 7f2d24247640 1 --2- 172.21.15.53:0/1096659835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c153760 0x7f2d1c061a00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.286+0000 7f2d24247640 1 -- 172.21.15.53:0/1096659835 >> 172.21.15.53:0/1096659835 conn(0x7f2d1c08b5c0 msgr2=0x7f2d1c060fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.286+0000 7f2d24247640 1 -- 172.21.15.53:0/1096659835 shutdown_connections 2023-12-08T20:55:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.286+0000 7f2d24247640 1 -- 172.21.15.53:0/1096659835 wait complete. 2023-12-08T20:55:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.290+0000 7f2d24247640 1 Processor -- start 2023-12-08T20:55:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.290+0000 7f2d24247640 1 -- start start 2023-12-08T20:55:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.290+0000 7f2d24247640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c0ca680 0x7f2d1c15b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.290+0000 7f2d24247640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d1c153760 0x7f2d1c15b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.290+0000 7f2d24247640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d1c15c710 0x7f2d1c1503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.290+0000 7f2d24247640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c14ffb0 con 0x7f2d1c0ca680 2023-12-08T20:55:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.290+0000 7f2d24247640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c15bc90 con 0x7f2d1c153760 2023-12-08T20:55:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.290+0000 7f2d24247640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c15a790 con 0x7f2d1c15c710 2023-12-08T20:55:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.290+0000 7f2d21fe3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c0ca680 0x7f2d1c15b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.290+0000 7f2d21fe3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c0ca680 0x7f2d1c15b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56664/0 (socket says 172.21.15.53:56664) 2023-12-08T20:55:47.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.290+0000 7f2d21fe3640 1 -- 172.21.15.53:0/1351727462 learned_addr learned my addr 172.21.15.53:0/1351727462 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.294+0000 7f2d21fe3640 1 -- 172.21.15.53:0/1351727462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d1c15c710 msgr2=0x7f2d1c1503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.294+0000 7f2d21fe3640 1 --2- 172.21.15.53:0/1351727462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d1c15c710 0x7f2d1c1503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.294+0000 7f2d21fe3640 1 -- 172.21.15.53:0/1351727462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d1c153760 msgr2=0x7f2d1c15b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.294+0000 7f2d21fe3640 1 --2- 172.21.15.53:0/1351727462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d1c153760 0x7f2d1c15b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.294+0000 7f2d21fe3640 1 -- 172.21.15.53:0/1351727462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180094d0 con 0x7f2d1c0ca680 2023-12-08T20:55:47.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.298+0000 7f2d21fe3640 1 --2- 172.21.15.53:0/1351727462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c0ca680 0x7f2d1c15b120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2d180b3040 tx=0x7f2d1801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.302+0000 7f2d127fc640 1 -- 172.21.15.53:0/1351727462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d180b0e40 con 0x7f2d1c0ca680 2023-12-08T20:55:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.302+0000 7f2d127fc640 1 -- 172.21.15.53:0/1351727462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d180bb470 con 0x7f2d1c0ca680 2023-12-08T20:55:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.302+0000 7f2d127fc640 1 -- 172.21.15.53:0/1351727462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d180bb820 con 0x7f2d1c0ca680 2023-12-08T20:55:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.306+0000 7f2d24247640 1 -- 172.21.15.53:0/1351727462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c1ef080 con 0x7f2d1c0ca680 2023-12-08T20:55:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.306+0000 7f2d24247640 1 -- 172.21.15.53:0/1351727462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c14fbd0 con 0x7f2d1c0ca680 2023-12-08T20:55:47.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.306+0000 7f2cfffff640 1 -- 172.21.15.53:0/1351727462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf8005260 con 0x7f2d1c0ca680 2023-12-08T20:55:47.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.326+0000 7ff1ed57c640 1 Processor -- start 2023-12-08T20:55:47.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.330+0000 7ff1ed57c640 1 -- start start 2023-12-08T20:55:47.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.330+0000 7ff1ed57c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1e806abf0 0x7ff1e806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.330+0000 7ff1ed57c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e815d3e0 con 0x7ff1e806a810 2023-12-08T20:55:47.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.330+0000 7ff1ed57c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e80c2ba0 con 0x7ff1e815d870 2023-12-08T20:55:47.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.330+0000 7ff1ed57c640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e80c1260 con 0x7ff1e806abf0 2023-12-08T20:55:47.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.342+0000 7f2807fff640 1 -- 172.21.15.53:0/3270580375 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28000b7070 con 0x7f281006edd0 2023-12-08T20:55:47.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.346+0000 7f2807fff640 1 --2- 172.21.15.53:0/3270580375 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f27f00664f0 0x7f27f00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.346+0000 7f280e7fc640 1 --2- 172.21.15.53:0/3270580375 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f27f00664f0 0x7f27f00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.346+0000 7f280e7fc640 1 --2- 172.21.15.53:0/3270580375 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f27f00664f0 0x7f27f00689b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2810157190 tx=0x7f27f8006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.354+0000 7f2807fff640 1 -- 172.21.15.53:0/3270580375 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f28000f3da0 con 0x7f281006edd0 2023-12-08T20:55:47.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.382+0000 7f2807fff640 1 -- 172.21.15.53:0/3270580375 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f28000efa20 con 0x7f281006edd0 2023-12-08T20:55:47.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.394+0000 7f2ae9180640 1 Processor -- start 2023-12-08T20:55:47.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.394+0000 7f2ae9180640 1 -- start start 2023-12-08T20:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.394+0000 7f2ae9180640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ae4153960 0x7f2ae406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.394+0000 7f2ae9180640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae40c2de0 0x7f2ae406aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.394+0000 7f2ae9180640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae4159610 con 0x7f2ae406edd0 2023-12-08T20:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.394+0000 7f2ae9180640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae4153d40 con 0x7f2ae4153960 2023-12-08T20:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.394+0000 7f2ae9180640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae41598d0 con 0x7f2ae40c2de0 2023-12-08T20:55:47.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.398+0000 7f682027a640 1 Processor -- start 2023-12-08T20:55:47.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.398+0000 7f682027a640 1 -- start start 2023-12-08T20:55:47.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.398+0000 7f682027a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68180c94b0 0x7f68180c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.398+0000 7f682027a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68180c6c00 con 0x7f68181518f0 2023-12-08T20:55:47.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.398+0000 7f682027a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68180c7a60 con 0x7f68180c75d0 2023-12-08T20:55:47.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.398+0000 7f682027a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68180c3920 con 0x7f68180c94b0 2023-12-08T20:55:47.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.402+0000 7ff1e67fc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1e806abf0 0x7ff1e806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.402+0000 7ff1e67fc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1e806abf0 0x7ff1e806b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40362/0 (socket says 172.21.15.53:40362) 2023-12-08T20:55:47.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.402+0000 7ff1e67fc640 1 -- 172.21.15.53:0/53785893 learned_addr learned my addr 172.21.15.53:0/53785893 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:47.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.406+0000 7f2ae2d9d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ae4153960 0x7f2ae406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.406+0000 7f2ae2d9d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ae4153960 0x7f2ae406a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40372/0 (socket says 172.21.15.53:40372) 2023-12-08T20:55:47.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.406+0000 7f2ae2d9d640 1 -- 172.21.15.53:0/2062158717 learned_addr learned my addr 172.21.15.53:0/2062158717 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:47.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.414+0000 7ff1e67fc640 1 -- 172.21.15.53:0/53785893 >> v1:172.21.15.146:6789/0 conn(0x7ff1e815d870 legacy=0x7ff1e8153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:47.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.414+0000 7ff1e67fc640 1 -- 172.21.15.53:0/53785893 >> v1:172.21.15.53:6789/0 conn(0x7ff1e806a810 legacy=0x7ff1e806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:47.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.414+0000 7ff1e67fc640 1 -- 172.21.15.53:0/53785893 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e80c2e80 con 0x7ff1e806abf0 2023-12-08T20:55:47.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.426+0000 7f2ae2d9d640 1 -- 172.21.15.53:0/2062158717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae40c2de0 msgr2=0x7f2ae406aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:47.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.426+0000 7f2ae2d9d640 1 --2- 172.21.15.53:0/2062158717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae40c2de0 0x7f2ae406aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.426+0000 7f2ae2d9d640 1 -- 172.21.15.53:0/2062158717 >> v1:172.21.15.53:6789/0 conn(0x7f2ae406edd0 legacy=0x7f2ae415cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:47.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.426+0000 7f2ae2d9d640 1 -- 172.21.15.53:0/2062158717 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae4159bb0 con 0x7f2ae4153960 2023-12-08T20:55:47.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.430+0000 7ff1e67fc640 1 --2- 172.21.15.53:0/53785893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e806abf0 0x7ff1e806b120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc009870 tx=0x7ff1dc01ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c504611c30fd5e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.430+0000 7f681e817640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f68180c75d0 0x7f6818161e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.53:45218/0 (socket says 172.21.15.53:45218) 2023-12-08T20:55:47.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.430+0000 7f681e817640 1 -- 172.21.15.53:0/3029664971 learned_addr learned my addr 172.21.15.53:0/3029664971 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:47.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.442+0000 7ff1e5ffb640 1 -- 172.21.15.53:0/53785893 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0a89b0 con 0x7ff1e806abf0 2023-12-08T20:55:47.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.442+0000 7ff1e5ffb640 1 -- 172.21.15.53:0/53785893 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0a8b10 con 0x7ff1e806abf0 2023-12-08T20:55:47.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.442+0000 7ff1e5ffb640 1 -- 172.21.15.53:0/53785893 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0a8ea0 con 0x7ff1e806abf0 2023-12-08T20:55:47.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.442+0000 7ff1ed57c640 1 -- 172.21.15.53:0/53785893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e806abf0 msgr2=0x7ff1e806b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.442+0000 7ff1ed57c640 1 --2- 172.21.15.53:0/53785893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e806abf0 0x7ff1e806b120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc009870 tx=0x7ff1dc01ecb0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.442+0000 7ff1ed57c640 1 -- 172.21.15.53:0/53785893 shutdown_connections 2023-12-08T20:55:47.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.442+0000 7ff1ed57c640 1 --2- 172.21.15.53:0/53785893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e806abf0 0x7ff1e806b120 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.442+0000 7ff1ed57c640 1 -- 172.21.15.53:0/53785893 >> 172.21.15.53:0/53785893 conn(0x7ff1e80c8990 msgr2=0x7ff1e80c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:47.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.442+0000 7ff1ed57c640 1 -- 172.21.15.53:0/53785893 shutdown_connections 2023-12-08T20:55:47.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.442+0000 7ff1ed57c640 1 -- 172.21.15.53:0/53785893 wait complete. 2023-12-08T20:55:47.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.446+0000 7ff1ed57c640 1 Processor -- start 2023-12-08T20:55:47.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.446+0000 7ff1ed57c640 1 -- start start 2023-12-08T20:55:47.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.446+0000 7ff1ed57c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e806a810 0x7ff1e8152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.446+0000 7ff1ed57c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e806abf0 0x7ff1e81efec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.446+0000 7ff1ed57c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1e815d870 0x7ff1e81f0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.446+0000 7ff1ed57c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e81532e0 con 0x7ff1e806a810 2023-12-08T20:55:47.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.446+0000 7ff1ed57c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e81efa30 con 0x7ff1e806abf0 2023-12-08T20:55:47.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.446+0000 7ff1ed57c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e8151700 con 0x7ff1e815d870 2023-12-08T20:55:47.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.450+0000 7ff1e67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e806abf0 0x7ff1e81efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.450+0000 7f2ae2d9d640 1 --2- 172.21.15.53:0/2062158717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae4153960 0x7f2ae406a5b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009870 tx=0x7f2ad401ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf07a8a1a38475f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.458+0000 7ff1e67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e806abf0 0x7ff1e81efec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40380/0 (socket says 172.21.15.53:40380) 2023-12-08T20:55:47.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.458+0000 7ff1e67fc640 1 -- 172.21.15.53:0/2693389588 learned_addr learned my addr 172.21.15.53:0/2693389588 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:47.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.462+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976136264 0 0) 0x7f68180c7a60 con 0x7f68180c75d0 2023-12-08T20:55:47.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.462+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6804003530 con 0x7f68180c75d0 2023-12-08T20:55:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.466+0000 7ff1e67fc640 1 -- 172.21.15.53:0/2693389588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1e815d870 msgr2=0x7ff1e81f0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.466+0000 7ff1e67fc640 1 --2- 172.21.15.53:0/2693389588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1e815d870 0x7ff1e81f0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.466+0000 7ff1e67fc640 1 -- 172.21.15.53:0/2693389588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e806a810 msgr2=0x7ff1e8152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.466+0000 7ff1e67fc640 1 --2- 172.21.15.53:0/2693389588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e806a810 0x7ff1e8152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.466+0000 7ff1e67fc640 1 -- 172.21.15.53:0/2693389588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc0094d0 con 0x7ff1e806abf0 2023-12-08T20:55:47.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.470+0000 7f2ae1d9b640 1 -- 172.21.15.53:0/2062158717 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40a89b0 con 0x7f2ae4153960 2023-12-08T20:55:47.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.470+0000 7f2ae1d9b640 1 -- 172.21.15.53:0/2062158717 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad40a8b10 con 0x7f2ae4153960 2023-12-08T20:55:47.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.470+0000 7f2ae1d9b640 1 -- 172.21.15.53:0/2062158717 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40a8ea0 con 0x7f2ae4153960 2023-12-08T20:55:47.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 -- 172.21.15.53:0/2062158717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae4153960 msgr2=0x7f2ae406a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 --2- 172.21.15.53:0/2062158717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae4153960 0x7f2ae406a5b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009870 tx=0x7f2ad401ecf0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 -- 172.21.15.53:0/2062158717 shutdown_connections 2023-12-08T20:55:47.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 --2- 172.21.15.53:0/2062158717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae40c2de0 0x7f2ae406aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 --2- 172.21.15.53:0/2062158717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae4153960 0x7f2ae406a5b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 -- 172.21.15.53:0/2062158717 >> 172.21.15.53:0/2062158717 conn(0x7f2ae40c8a00 msgr2=0x7f2ae40c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:47.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 -- 172.21.15.53:0/2062158717 shutdown_connections 2023-12-08T20:55:47.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 -- 172.21.15.53:0/2062158717 wait complete. 2023-12-08T20:55:47.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 Processor -- start 2023-12-08T20:55:47.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 -- start start 2023-12-08T20:55:47.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ae406edd0 0x7f2ae40c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae40c2de0 0x7f2ae40c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae4153960 0x7f2ae4155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae41f2690 con 0x7f2ae406edd0 2023-12-08T20:55:47.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae40c4fc0 con 0x7f2ae4153960 2023-12-08T20:55:47.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.474+0000 7f2ae9180640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae41f3630 con 0x7f2ae40c2de0 2023-12-08T20:55:47.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/1286242684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6d780050d0 con 0x7f6d9415b400 2023-12-08T20:55:47.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7ff1e67fc640 1 --2- 172.21.15.53:0/2693389588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e806abf0 0x7ff1e81efec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc01b8c0 tx=0x7ff1dc01ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 221210781 0 0) 0x7f6804003530 con 0x7f68180c75d0 2023-12-08T20:55:47.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 >> v2:172.21.15.53:3300/0 conn(0x7f68180c94b0 msgr2=0x7f68180c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:47.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 --2- 172.21.15.53:0/3029664971 >> v2:172.21.15.53:3300/0 conn(0x7f68180c94b0 0x7f68180c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 >> v1:172.21.15.53:6789/0 conn(0x7f68181518f0 legacy=0x7f681806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:47.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68180c41b0 con 0x7f68180c75d0 2023-12-08T20:55:47.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 149952835 0 0) 0x7f6810001a00 con 0x7f68180c75d0 2023-12-08T20:55:47.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 >> v1:172.21.15.146:6789/0 conn(0x7f68180c75d0 legacy=0x7f6818161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 --2- 172.21.15.53:0/3029664971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68040039d0 0x7f6804003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 --2- 172.21.15.53:0/3029664971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68040047d0 0x7f6804004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 --2- 172.21.15.53:0/3029664971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6804005340 0x7f680400b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68180c3920 con 0x7f68040039d0 2023-12-08T20:55:47.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680400c290 con 0x7f68040047d0 2023-12-08T20:55:47.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.486+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680400c450 con 0x7f6804005340 2023-12-08T20:55:47.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.498+0000 7f2ae359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae4153960 0x7f2ae4155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.502+0000 7f2ae359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae4153960 0x7f2ae4155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40382/0 (socket says 172.21.15.53:40382) 2023-12-08T20:55:47.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.502+0000 7f2ae359e640 1 -- 172.21.15.53:0/3079149905 learned_addr learned my addr 172.21.15.53:0/3079149905 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:47.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.514+0000 7f2ae359e640 1 -- 172.21.15.53:0/3079149905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae40c2de0 msgr2=0x7f2ae40c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.514+0000 7f2ae359e640 1 --2- 172.21.15.53:0/3079149905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae40c2de0 0x7f2ae40c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.514+0000 7f2ae359e640 1 -- 172.21.15.53:0/3079149905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ae406edd0 msgr2=0x7f2ae40c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.514+0000 7f2ae359e640 1 --2- 172.21.15.53:0/3079149905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ae406edd0 0x7f2ae40c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.514+0000 7f2ae359e640 1 -- 172.21.15.53:0/3079149905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40094d0 con 0x7f2ae4153960 2023-12-08T20:55:47.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.514+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/2693389588 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0b0e60 con 0x7ff1e806abf0 2023-12-08T20:55:47.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.514+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/2693389588 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0ba440 con 0x7ff1e806abf0 2023-12-08T20:55:47.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.514+0000 7ff1ed57c640 1 -- 172.21.15.53:0/2693389588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e8152240 con 0x7ff1e806abf0 2023-12-08T20:55:47.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.514+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/2693389588 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0ba7f0 con 0x7ff1e806abf0 2023-12-08T20:55:47.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.514+0000 7ff1ed57c640 1 -- 172.21.15.53:0/2693389588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e8151c80 con 0x7ff1e806abf0 2023-12-08T20:55:47.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.518+0000 7ff1ed57c640 1 -- 172.21.15.53:0/2693389588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e8151c80 con 0x7ff1e806abf0 2023-12-08T20:55:47.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.534+0000 7f2ae359e640 1 --2- 172.21.15.53:0/3079149905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae4153960 0x7f2ae4155ba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00b970 tx=0x7f2adc00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.538+0000 7f681d815640 1 --2- 172.21.15.53:0/3029664971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68040047d0 0x7f6804004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.562+0000 7f281580d640 1 -- 172.21.15.53:0/3270580375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2810074190 con 0x7f281006edd0 2023-12-08T20:55:47.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.574+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/2693389588 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff1dc0ba950 con 0x7ff1e806abf0 2023-12-08T20:55:47.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.574+0000 7ff1cf7fe640 1 --2- 172.21.15.53:0/2693389588 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff1d40664c0 0x7ff1d4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.574+0000 7ff1e6ffd640 1 --2- 172.21.15.53:0/2693389588 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff1d40664c0 0x7ff1d4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.574+0000 7ff1e6ffd640 1 --2- 172.21.15.53:0/2693389588 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff1d40664c0 0x7ff1d4068980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8007fd0 tx=0x7ff1d80079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.606+0000 7f2d127fc640 1 -- 172.21.15.53:0/1351727462 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2d180b7070 con 0x7f2d1c0ca680 2023-12-08T20:55:47.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.610+0000 7f2d127fc640 1 --2- 172.21.15.53:0/1351727462 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2d000664c0 0x7f2d00068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.610+0000 7f2d217e2640 1 --2- 172.21.15.53:0/1351727462 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2d000664c0 0x7f2d00068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.610+0000 7f2d217e2640 1 --2- 172.21.15.53:0/1351727462 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2d000664c0 0x7f2d00068980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c14e9e0 tx=0x7f2d0c006bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.614+0000 7f5987fff640 1 -- 172.21.15.53:0/3169316280 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5998003c70 con 0x7f59a00c8a60 2023-12-08T20:55:47.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.614+0000 7f5987fff640 1 --2- 172.21.15.53:0/3169316280 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f598c0664c0 0x7f598c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.614+0000 7f599effd640 1 --2- 172.21.15.53:0/3169316280 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f598c0664c0 0x7f598c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.618+0000 7f599effd640 1 --2- 172.21.15.53:0/3169316280 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f598c0664c0 0x7f598c068980 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f599000ab90 tx=0x7f5990009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.622+0000 7f5987fff640 1 -- 172.21.15.53:0/3169316280 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5998054f80 con 0x7f59a00c8a60 2023-12-08T20:55:47.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.638+0000 7f2d127fc640 1 -- 172.21.15.53:0/1351727462 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2d180f4590 con 0x7f2d1c0ca680 2023-12-08T20:55:47.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.638+0000 7f2d127fc640 1 -- 172.21.15.53:0/1351727462 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d180f01d0 con 0x7f2d1c0ca680 2023-12-08T20:55:47.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.650+0000 7f5987fff640 1 -- 172.21.15.53:0/3169316280 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5998050bc0 con 0x7f59a00c8a60 2023-12-08T20:55:47.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.666+0000 7f681e817640 1 --2- 172.21.15.53:0/3029664971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6804005340 0x7f680400b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.674+0000 7f681e817640 1 -- 172.21.15.53:0/3029664971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68040047d0 msgr2=0x7f6804004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:47.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.674+0000 7f681e817640 1 --2- 172.21.15.53:0/3029664971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68040047d0 0x7f6804004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.674+0000 7f681e817640 1 -- 172.21.15.53:0/3029664971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68040039d0 msgr2=0x7f6804003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:47.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.674+0000 7f681e817640 1 --2- 172.21.15.53:0/3029664971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68040039d0 0x7f6804003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.674+0000 7f681e817640 1 -- 172.21.15.53:0/3029664971 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6804003530 con 0x7f6804005340 2023-12-08T20:55:47.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.682+0000 7f681e817640 1 -- 172.21.15.53:0/3029664971 reap_dead start 2023-12-08T20:55:47.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.686+0000 7f681e817640 1 --2- 172.21.15.53:0/3029664971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6804005340 0x7f680400b9b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f681000a770 tx=0x7f681001d280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a11ebfc9cf0a3f34 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.694+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68100ac620 con 0x7f6804005340 2023-12-08T20:55:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.694+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68100a8070 con 0x7f6804005340 2023-12-08T20:55:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.694+0000 7f681d014640 1 -- 172.21.15.53:0/3029664971 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68100aca00 con 0x7f6804005340 2023-12-08T20:55:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.694+0000 7f682027a640 1 -- 172.21.15.53:0/3029664971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6804005340 msgr2=0x7f680400b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.694+0000 7f682027a640 1 --2- 172.21.15.53:0/3029664971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6804005340 0x7f680400b9b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f681000a770 tx=0x7f681001d280 comp rx=0 tx=0).stop 2023-12-08T20:55:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.694+0000 7f682027a640 1 -- 172.21.15.53:0/3029664971 shutdown_connections 2023-12-08T20:55:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.694+0000 7f682027a640 1 --2- 172.21.15.53:0/3029664971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6804005340 0x7f680400b9b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.694+0000 7f682027a640 1 -- 172.21.15.53:0/3029664971 >> 172.21.15.53:0/3029664971 conn(0x7f68180c8990 msgr2=0x7f68180c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.694+0000 7f682027a640 1 -- 172.21.15.53:0/3029664971 shutdown_connections 2023-12-08T20:55:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.694+0000 7f682027a640 1 -- 172.21.15.53:0/3029664971 wait complete. 2023-12-08T20:55:47.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.698+0000 7f682027a640 1 Processor -- start 2023-12-08T20:55:47.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.698+0000 7f682027a640 1 -- start start 2023-12-08T20:55:47.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.698+0000 7f682027a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6804005340 0x7f68180c2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.698+0000 7f682027a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68180c2a70 0x7f6818141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.698+0000 7f682027a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6818152900 0x7f6818152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.698+0000 7f682027a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68181548f0 con 0x7f6804005340 2023-12-08T20:55:47.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.698+0000 7f682027a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681814ff10 con 0x7f6818152900 2023-12-08T20:55:47.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.698+0000 7f682027a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68180c1960 con 0x7f68180c2a70 2023-12-08T20:55:47.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.698+0000 7f681d815640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68180c2a70 0x7f6818141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.702+0000 7f681d815640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68180c2a70 0x7f6818141800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:44286/0 (socket says 172.21.15.53:44286) 2023-12-08T20:55:47.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.702+0000 7f681d815640 1 -- 172.21.15.53:0/1617099913 learned_addr learned my addr 172.21.15.53:0/1617099913 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:47.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.710+0000 7f681d815640 1 -- 172.21.15.53:0/1617099913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6818152900 msgr2=0x7f6818152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.710+0000 7f681d815640 1 --2- 172.21.15.53:0/1617099913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6818152900 0x7f6818152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.710+0000 7f681d815640 1 -- 172.21.15.53:0/1617099913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6804005340 msgr2=0x7f68180c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.710+0000 7f681d815640 1 --2- 172.21.15.53:0/1617099913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6804005340 0x7f68180c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.710+0000 7f681d815640 1 -- 172.21.15.53:0/1617099913 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68181532c0 con 0x7f68180c2a70 2023-12-08T20:55:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.718+0000 7f681d815640 1 --2- 172.21.15.53:0/1617099913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68180c2a70 0x7f6818141800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f680800c5c0 tx=0x7f680800ca80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.726+0000 7f680effd640 1 -- 172.21.15.53:0/1617099913 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808004220 con 0x7f68180c2a70 2023-12-08T20:55:47.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.726+0000 7f680effd640 1 -- 172.21.15.53:0/1617099913 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808004380 con 0x7f68180c2a70 2023-12-08T20:55:47.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.726+0000 7f682027a640 1 -- 172.21.15.53:0/1617099913 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6818154b20 con 0x7f68180c2a70 2023-12-08T20:55:47.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.726+0000 7f680effd640 1 -- 172.21.15.53:0/1617099913 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080044f0 con 0x7f68180c2a70 2023-12-08T20:55:47.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.726+0000 7f682027a640 1 -- 172.21.15.53:0/1617099913 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68180c1ee0 con 0x7f68180c2a70 2023-12-08T20:55:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.726+0000 7f682027a640 1 -- 172.21.15.53:0/1617099913 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681806c650 con 0x7f68180c2a70 2023-12-08T20:55:47.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.742+0000 7f6d917fa640 1 -- 172.21.15.53:0/1286242684 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d8c018020 con 0x7f6d9415b400 2023-12-08T20:55:47.744 INFO:teuthology.orchestra.run.smithi053.stdout:64424509463 2023-12-08T20:55:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.746+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/1286242684 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6d74066470 msgr2=0x7f6d74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.746+0000 7f6d9a4cf640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6d74066470 0x7f6d74068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6d840af000 tx=0x7f6d840a7000 comp rx=0 tx=0).stop 2023-12-08T20:55:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.746+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/1286242684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d9415b400 msgr2=0x7f6d94153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.746+0000 7f6d9a4cf640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d9415b400 0x7f6d94153c10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00efc0 tx=0x7f6d8c00c490 comp rx=0 tx=0).stop 2023-12-08T20:55:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.746+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/1286242684 shutdown_connections 2023-12-08T20:55:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.746+0000 7f6d9a4cf640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6d74066470 0x7f6d74068930 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.746+0000 7f6d9a4cf640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d9415b400 0x7f6d94153c10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.746+0000 7f6d9a4cf640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d94151770 0x7f6d9414db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.746+0000 7f6d9a4cf640 1 --2- 172.21.15.53:0/1286242684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d940c8e60 0x7f6d94156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.746+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/1286242684 >> 172.21.15.53:0/1286242684 conn(0x7f6d94070c20 msgr2=0x7f6d94071000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.746+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/1286242684 shutdown_connections 2023-12-08T20:55:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.746+0000 7f6d9a4cf640 1 -- 172.21.15.53:0/1286242684 wait complete. 2023-12-08T20:55:47.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509463 for osd.1 2023-12-08T20:55:47.763 DEBUG:teuthology.parallel:result is None 2023-12-08T20:55:47.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.778+0000 7f680effd640 1 -- 172.21.15.53:0/1617099913 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6808003840 con 0x7f68180c2a70 2023-12-08T20:55:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.778+0000 7f680effd640 1 --2- 172.21.15.53:0/1617099913 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f67fc0664c0 0x7f67fc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.778+0000 7f681e016640 1 --2- 172.21.15.53:0/1617099913 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f67fc0664c0 0x7f67fc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.778+0000 7f681e016640 1 --2- 172.21.15.53:0/1617099913 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f67fc0664c0 0x7f67fc068980 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6814007fd0 tx=0x7f68140079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:47.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.814+0000 7f59a587e640 1 -- 172.21.15.53:0/3169316280 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f59a01dfd40 con 0x7f59a00c8a60 2023-12-08T20:55:47.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.826+0000 7f2cfffff640 1 -- 172.21.15.53:0/1351727462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2cf80057e0 con 0x7f2d1c0ca680 2023-12-08T20:55:47.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.830+0000 7f2d127fc640 1 -- 172.21.15.53:0/1351727462 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d180b5020 con 0x7f2d1c0ca680 2023-12-08T20:55:47.832 INFO:teuthology.orchestra.run.smithi053.stdout:64424509462 2023-12-08T20:55:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.834+0000 7f2cfffff640 1 -- 172.21.15.53:0/1351727462 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2d000664c0 msgr2=0x7f2d00068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.834+0000 7f2cfffff640 1 --2- 172.21.15.53:0/1351727462 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2d000664c0 0x7f2d00068980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c14e9e0 tx=0x7f2d0c006bb0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.834+0000 7f2cfffff640 1 -- 172.21.15.53:0/1351727462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c0ca680 msgr2=0x7f2d1c15b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.834+0000 7f2cfffff640 1 --2- 172.21.15.53:0/1351727462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c0ca680 0x7f2d1c15b120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2d180b3040 tx=0x7f2d1801ba50 comp rx=0 tx=0).stop 2023-12-08T20:55:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.834+0000 7f2cfffff640 1 -- 172.21.15.53:0/1351727462 shutdown_connections 2023-12-08T20:55:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.834+0000 7f2cfffff640 1 --2- 172.21.15.53:0/1351727462 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2d000664c0 0x7f2d00068980 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.834+0000 7f2cfffff640 1 --2- 172.21.15.53:0/1351727462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d1c15c710 0x7f2d1c1503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.834+0000 7f2cfffff640 1 --2- 172.21.15.53:0/1351727462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d1c153760 0x7f2d1c15b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.834+0000 7f2cfffff640 1 --2- 172.21.15.53:0/1351727462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c0ca680 0x7f2d1c15b120 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.834+0000 7f2cfffff640 1 -- 172.21.15.53:0/1351727462 >> 172.21.15.53:0/1351727462 conn(0x7f2d1c08b5c0 msgr2=0x7f2d1c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.834+0000 7f2cfffff640 1 -- 172.21.15.53:0/1351727462 shutdown_connections 2023-12-08T20:55:47.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.834+0000 7f2cfffff640 1 -- 172.21.15.53:0/1351727462 wait complete. 2023-12-08T20:55:47.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509462 for osd.3 2023-12-08T20:55:47.852 DEBUG:teuthology.parallel:result is None 2023-12-08T20:55:47.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.874+0000 7f2acb7fe640 1 -- 172.21.15.53:0/3079149905 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00cae0 con 0x7f2ae4153960 2023-12-08T20:55:47.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.874+0000 7f2acb7fe640 1 -- 172.21.15.53:0/3079149905 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc00cc60 con 0x7f2ae4153960 2023-12-08T20:55:47.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.874+0000 7f2ae9180640 1 -- 172.21.15.53:0/3079149905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae41f31a0 con 0x7f2ae4153960 2023-12-08T20:55:47.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.874+0000 7f2acb7fe640 1 -- 172.21.15.53:0/3079149905 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc014440 con 0x7f2ae4153960 2023-12-08T20:55:47.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.874+0000 7f2ae9180640 1 -- 172.21.15.53:0/3079149905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae41f2870 con 0x7f2ae4153960 2023-12-08T20:55:47.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.874+0000 7f2ae9180640 1 -- 172.21.15.53:0/3079149905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae4074190 con 0x7f2ae4153960 2023-12-08T20:55:47.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.878+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/2693389588 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff1dc0f4130 con 0x7ff1e806abf0 2023-12-08T20:55:47.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.906+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/2693389588 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1dc0efd70 con 0x7ff1e806abf0 2023-12-08T20:55:47.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.910+0000 7f2807fff640 1 -- 172.21.15.53:0/3270580375 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f28000b5030 con 0x7f281006edd0 2023-12-08T20:55:47.911 INFO:teuthology.orchestra.run.smithi053.stdout:64424509462 2023-12-08T20:55:47.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.914+0000 7f281580d640 1 -- 172.21.15.53:0/3270580375 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f27f00664f0 msgr2=0x7f27f00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.914+0000 7f281580d640 1 --2- 172.21.15.53:0/3270580375 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f27f00664f0 0x7f27f00689b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2810157190 tx=0x7f27f8006c90 comp rx=0 tx=0).stop 2023-12-08T20:55:47.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.914+0000 7f281580d640 1 -- 172.21.15.53:0/3270580375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281006edd0 msgr2=0x7f28101563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:47.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.914+0000 7f281580d640 1 --2- 172.21.15.53:0/3270580375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281006edd0 0x7f28101563b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f280001d3a0 tx=0x7f280001ba90 comp rx=0 tx=0).stop 2023-12-08T20:55:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.914+0000 7f281580d640 1 -- 172.21.15.53:0/3270580375 shutdown_connections 2023-12-08T20:55:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.914+0000 7f281580d640 1 --2- 172.21.15.53:0/3270580375 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f27f00664f0 0x7f27f00689b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.914+0000 7f281580d640 1 --2- 172.21.15.53:0/3270580375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2810153960 0x7f28101f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.914+0000 7f281580d640 1 --2- 172.21.15.53:0/3270580375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100c2de0 0x7f28101f24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.914+0000 7f281580d640 1 --2- 172.21.15.53:0/3270580375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281006edd0 0x7f28101563b0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f280001d3a0 tx=0x7f280001ba90 comp rx=0 tx=0).stop 2023-12-08T20:55:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.914+0000 7f281580d640 1 -- 172.21.15.53:0/3270580375 >> 172.21.15.53:0/3270580375 conn(0x7f28100c8a00 msgr2=0x7f28100c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.914+0000 7f281580d640 1 -- 172.21.15.53:0/3270580375 shutdown_connections 2023-12-08T20:55:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:47.914+0000 7f281580d640 1 -- 172.21.15.53:0/3270580375 wait complete. 2023-12-08T20:55:47.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509462 for osd.5 2023-12-08T20:55:47.935 DEBUG:teuthology.parallel:result is None 2023-12-08T20:55:48.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.058+0000 7f680effd640 1 -- 172.21.15.53:0/1617099913 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6808055850 con 0x7f68180c2a70 2023-12-08T20:55:48.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.066+0000 7ff1ed57c640 1 -- 172.21.15.53:0/2693389588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff1e8151c80 con 0x7ff1e806abf0 2023-12-08T20:55:48.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.070+0000 7f680effd640 1 -- 172.21.15.53:0/1617099913 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6808051490 con 0x7f68180c2a70 2023-12-08T20:55:48.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f5987fff640 1 -- 172.21.15.53:0/3169316280 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f59a01dfd40 con 0x7f59a00c8a60 2023-12-08T20:55:48.089 INFO:teuthology.orchestra.run.smithi053.stdout:64424509461 2023-12-08T20:55:48.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f59a587e640 1 -- 172.21.15.53:0/3169316280 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f598c0664c0 msgr2=0x7f598c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f59a587e640 1 --2- 172.21.15.53:0/3169316280 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f598c0664c0 0x7f598c068980 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f599000ab90 tx=0x7f5990009250 comp rx=0 tx=0).stop 2023-12-08T20:55:48.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f59a587e640 1 -- 172.21.15.53:0/3169316280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 msgr2=0x7f59a014f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f59a587e640 1 --2- 172.21.15.53:0/3169316280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 0x7f59a014f220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f599800c410 tx=0x7f599800c8d0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f59a587e640 1 -- 172.21.15.53:0/3169316280 shutdown_connections 2023-12-08T20:55:48.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f59a587e640 1 --2- 172.21.15.53:0/3169316280 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f598c0664c0 0x7f598c068980 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f59a587e640 1 --2- 172.21.15.53:0/3169316280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a00c8a60 0x7f59a014f220 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f59a587e640 1 --2- 172.21.15.53:0/3169316280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59a00c8680 0x7f59a00c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f59a587e640 1 --2- 172.21.15.53:0/3169316280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a006b7c0 0x7f59a01ee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f59a587e640 1 -- 172.21.15.53:0/3169316280 >> 172.21.15.53:0/3169316280 conn(0x7f59a00cb950 msgr2=0x7f59a00c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:48.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f59a587e640 1 -- 172.21.15.53:0/3169316280 shutdown_connections 2023-12-08T20:55:48.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.090+0000 7f59a587e640 1 -- 172.21.15.53:0/3169316280 wait complete. 2023-12-08T20:55:48.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509461 for osd.2 2023-12-08T20:55:48.115 DEBUG:teuthology.parallel:result is None 2023-12-08T20:55:48.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.190+0000 7f2acb7fe640 1 -- 172.21.15.53:0/3079149905 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2adc007370 con 0x7f2ae4153960 2023-12-08T20:55:48.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.190+0000 7f2acb7fe640 1 --2- 172.21.15.53:0/3079149905 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2ad00664f0 0x7f2ad00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:48.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.190+0000 7f2ae2d9d640 1 --2- 172.21.15.53:0/3079149905 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2ad00664f0 0x7f2ad00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:48.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.190+0000 7f2ae2d9d640 1 --2- 172.21.15.53:0/3079149905 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2ad00664f0 0x7f2ad00689b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40b2000 tx=0x7f2ad4004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:48.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.198+0000 7f2acb7fe640 1 -- 172.21.15.53:0/3079149905 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2adc055aa0 con 0x7f2ae4153960 2023-12-08T20:55:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.230+0000 7f2acb7fe640 1 -- 172.21.15.53:0/3079149905 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2adc055170 con 0x7f2ae4153960 2023-12-08T20:55:48.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.238+0000 7f682027a640 1 -- 172.21.15.53:0/1617099913 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6818074190 con 0x7f68180c2a70 2023-12-08T20:55:48.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f680effd640 1 -- 172.21.15.53:0/1617099913 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f680801e090 con 0x7f68180c2a70 2023-12-08T20:55:48.246 INFO:teuthology.orchestra.run.smithi053.stdout:64424509462 2023-12-08T20:55:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f682027a640 1 -- 172.21.15.53:0/1617099913 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f67fc0664c0 msgr2=0x7f67fc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f682027a640 1 --2- 172.21.15.53:0/1617099913 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f67fc0664c0 0x7f67fc068980 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6814007fd0 tx=0x7f68140079a0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f682027a640 1 -- 172.21.15.53:0/1617099913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68180c2a70 msgr2=0x7f6818141800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f682027a640 1 --2- 172.21.15.53:0/1617099913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68180c2a70 0x7f6818141800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f680800c5c0 tx=0x7f680800ca80 comp rx=0 tx=0).stop 2023-12-08T20:55:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f682027a640 1 -- 172.21.15.53:0/1617099913 shutdown_connections 2023-12-08T20:55:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f682027a640 1 --2- 172.21.15.53:0/1617099913 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f67fc0664c0 0x7f67fc068980 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f682027a640 1 --2- 172.21.15.53:0/1617099913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6818152900 0x7f6818152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f682027a640 1 --2- 172.21.15.53:0/1617099913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68180c2a70 0x7f6818141800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f682027a640 1 --2- 172.21.15.53:0/1617099913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6804005340 0x7f68180c2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f682027a640 1 -- 172.21.15.53:0/1617099913 >> 172.21.15.53:0/1617099913 conn(0x7f68180c8990 msgr2=0x7f681813f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f682027a640 1 -- 172.21.15.53:0/1617099913 shutdown_connections 2023-12-08T20:55:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.246+0000 7f682027a640 1 -- 172.21.15.53:0/1617099913 wait complete. 2023-12-08T20:55:48.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.258+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/2693389588 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1dc0b5030 con 0x7ff1e806abf0 2023-12-08T20:55:48.259 INFO:teuthology.orchestra.run.smithi053.stdout:60129542164 2023-12-08T20:55:48.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.262+0000 7ff1ed57c640 1 -- 172.21.15.53:0/2693389588 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff1d40664c0 msgr2=0x7ff1d4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.262+0000 7ff1ed57c640 1 --2- 172.21.15.53:0/2693389588 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff1d40664c0 0x7ff1d4068980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8007fd0 tx=0x7ff1d80079a0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.262+0000 7ff1ed57c640 1 -- 172.21.15.53:0/2693389588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e806abf0 msgr2=0x7ff1e81efec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.262+0000 7ff1ed57c640 1 --2- 172.21.15.53:0/2693389588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e806abf0 0x7ff1e81efec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc01b8c0 tx=0x7ff1dc01ba50 comp rx=0 tx=0).stop 2023-12-08T20:55:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.262+0000 7ff1ed57c640 1 -- 172.21.15.53:0/2693389588 shutdown_connections 2023-12-08T20:55:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.262+0000 7ff1ed57c640 1 --2- 172.21.15.53:0/2693389588 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff1d40664c0 0x7ff1d4068980 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.262+0000 7ff1ed57c640 1 --2- 172.21.15.53:0/2693389588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1e815d870 0x7ff1e81f0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.262+0000 7ff1ed57c640 1 --2- 172.21.15.53:0/2693389588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e806abf0 0x7ff1e81efec0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.262+0000 7ff1ed57c640 1 --2- 172.21.15.53:0/2693389588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e806a810 0x7ff1e8152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.262+0000 7ff1ed57c640 1 -- 172.21.15.53:0/2693389588 >> 172.21.15.53:0/2693389588 conn(0x7ff1e80c8990 msgr2=0x7ff1e815b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.262+0000 7ff1ed57c640 1 -- 172.21.15.53:0/2693389588 shutdown_connections 2023-12-08T20:55:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.262+0000 7ff1ed57c640 1 -- 172.21.15.53:0/2693389588 wait complete. 2023-12-08T20:55:48.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509462 for osd.0 2023-12-08T20:55:48.267 DEBUG:teuthology.parallel:result is None 2023-12-08T20:55:48.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542164 got 60129542164 for osd.4 2023-12-08T20:55:48.284 DEBUG:teuthology.parallel:result is None 2023-12-08T20:55:48.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.402+0000 7f2ae9180640 1 -- 172.21.15.53:0/3079149905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2ae406e530 con 0x7f2ae4153960 2023-12-08T20:55:48.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2acb7fe640 1 -- 172.21.15.53:0/3079149905 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2adc019070 con 0x7f2ae4153960 2023-12-08T20:55:48.425 INFO:teuthology.orchestra.run.smithi053.stdout:60129542165 2023-12-08T20:55:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2ae9180640 1 -- 172.21.15.53:0/3079149905 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2ad00664f0 msgr2=0x7f2ad00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2ae9180640 1 --2- 172.21.15.53:0/3079149905 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2ad00664f0 0x7f2ad00689b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40b2000 tx=0x7f2ad4004740 comp rx=0 tx=0).stop 2023-12-08T20:55:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2ae9180640 1 -- 172.21.15.53:0/3079149905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae4153960 msgr2=0x7f2ae4155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2ae9180640 1 --2- 172.21.15.53:0/3079149905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae4153960 0x7f2ae4155ba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00b970 tx=0x7f2adc00be30 comp rx=0 tx=0).stop 2023-12-08T20:55:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2ae9180640 1 -- 172.21.15.53:0/3079149905 shutdown_connections 2023-12-08T20:55:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2ae9180640 1 --2- 172.21.15.53:0/3079149905 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2ad00664f0 0x7f2ad00689b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2ae9180640 1 --2- 172.21.15.53:0/3079149905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae4153960 0x7f2ae4155ba0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2ae9180640 1 --2- 172.21.15.53:0/3079149905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae40c2de0 0x7f2ae40c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2ae9180640 1 --2- 172.21.15.53:0/3079149905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ae406edd0 0x7f2ae40c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2ae9180640 1 -- 172.21.15.53:0/3079149905 >> 172.21.15.53:0/3079149905 conn(0x7f2ae40c8a00 msgr2=0x7f2ae40c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2ae9180640 1 -- 172.21.15.53:0/3079149905 shutdown_connections 2023-12-08T20:55:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.426+0000 7f2ae9180640 1 -- 172.21.15.53:0/3079149905 wait complete. 2023-12-08T20:55:48.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542165 got 60129542165 for osd.7 2023-12-08T20:55:48.444 DEBUG:teuthology.parallel:result is None 2023-12-08T20:55:48.444 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-08T20:55:48.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T20:55:48.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.562+0000 7f91935a8640 1 Processor -- start 2023-12-08T20:55:48.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.562+0000 7f91935a8640 1 -- start start 2023-12-08T20:55:48.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.566+0000 7f91935a8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f918c0c0eb0 0x7f918c0c12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:48.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.566+0000 7f91935a8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918c06faf0 con 0x7f918c06e030 2023-12-08T20:55:48.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.566+0000 7f91935a8640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918c06fdd0 con 0x7f918c150300 2023-12-08T20:55:48.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.566+0000 7f91935a8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f918c06dc10 con 0x7f918c0c0eb0 2023-12-08T20:55:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.566+0000 7f9191344640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f918c150300 0x7f918c156db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.53:45226/0 (socket says 172.21.15.53:45226) 2023-12-08T20:55:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.566+0000 7f9191344640 1 -- 172.21.15.53:0/2213741018 learned_addr learned my addr 172.21.15.53:0/2213741018 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:48.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.582+0000 7f9191b45640 1 --2- 172.21.15.53:0/2213741018 >> v2:172.21.15.53:3300/0 conn(0x7f918c0c0eb0 0x7f918c0c12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:48.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.586+0000 7f9183fff640 1 -- 172.21.15.53:0/2213741018 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390411574 0 0) 0x7f918c06faf0 con 0x7f918c06e030 2023-12-08T20:55:48.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.586+0000 7f9183fff640 1 -- 172.21.15.53:0/2213741018 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9178005740 con 0x7f918c06e030 2023-12-08T20:55:48.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.590+0000 7f9191b45640 1 -- 172.21.15.53:0/2213741018 >> v1:172.21.15.146:6789/0 conn(0x7f918c150300 legacy=0x7f918c156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.590+0000 7f9191b45640 1 -- 172.21.15.53:0/2213741018 >> v1:172.21.15.53:6789/0 conn(0x7f918c06e030 legacy=0x7f918c06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.590+0000 7f9191b45640 1 -- 172.21.15.53:0/2213741018 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918c0700b0 con 0x7f918c0c0eb0 2023-12-08T20:55:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.598+0000 7f9191b45640 1 --2- 172.21.15.53:0/2213741018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f918c0c0eb0 0x7f918c0c12e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9184009d90 tx=0x7f918401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1e69de1af8ec58 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:48.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.606+0000 7f9183fff640 1 -- 172.21.15.53:0/2213741018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840a5710 con 0x7f918c0c0eb0 2023-12-08T20:55:48.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.606+0000 7f9183fff640 1 -- 172.21.15.53:0/2213741018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91840a5870 con 0x7f918c0c0eb0 2023-12-08T20:55:48.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.606+0000 7f9183fff640 1 -- 172.21.15.53:0/2213741018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840a5c00 con 0x7f918c0c0eb0 2023-12-08T20:55:48.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.606+0000 7f91935a8640 1 -- 172.21.15.53:0/2213741018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f918c0c0eb0 msgr2=0x7f918c0c12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.606+0000 7f91935a8640 1 --2- 172.21.15.53:0/2213741018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f918c0c0eb0 0x7f918c0c12e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9184009d90 tx=0x7f918401c950 comp rx=0 tx=0).stop 2023-12-08T20:55:48.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.606+0000 7f91935a8640 1 -- 172.21.15.53:0/2213741018 shutdown_connections 2023-12-08T20:55:48.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.606+0000 7f91935a8640 1 --2- 172.21.15.53:0/2213741018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f918c0c0eb0 0x7f918c0c12e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.606+0000 7f91935a8640 1 -- 172.21.15.53:0/2213741018 >> 172.21.15.53:0/2213741018 conn(0x7f918c06b6c0 msgr2=0x7f918c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:48.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.606+0000 7f91935a8640 1 -- 172.21.15.53:0/2213741018 shutdown_connections 2023-12-08T20:55:48.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.606+0000 7f91935a8640 1 -- 172.21.15.53:0/2213741018 wait complete. 2023-12-08T20:55:48.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.610+0000 7f91935a8640 1 Processor -- start 2023-12-08T20:55:48.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.610+0000 7f91935a8640 1 -- start start 2023-12-08T20:55:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.610+0000 7f91935a8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f918c06e030 0x7f918c13ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.610+0000 7f91935a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f918c0c0eb0 0x7f918c1f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.610+0000 7f91935a8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f918c150300 0x7f918c13b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.610+0000 7f91935a8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918c13b080 con 0x7f918c0c0eb0 2023-12-08T20:55:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.610+0000 7f91935a8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918c13f500 con 0x7f918c06e030 2023-12-08T20:55:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.610+0000 7f91935a8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918c0c3830 con 0x7f918c150300 2023-12-08T20:55:48.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.610+0000 7f9190b43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f918c0c0eb0 0x7f918c1f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:48.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.610+0000 7f9190b43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f918c0c0eb0 0x7f918c1f2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56720/0 (socket says 172.21.15.53:56720) 2023-12-08T20:55:48.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.610+0000 7f9190b43640 1 -- 172.21.15.53:0/4022266070 learned_addr learned my addr 172.21.15.53:0/4022266070 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:48.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.614+0000 7f9190b43640 1 -- 172.21.15.53:0/4022266070 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f918c150300 msgr2=0x7f918c13b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.614+0000 7f9190b43640 1 --2- 172.21.15.53:0/4022266070 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f918c150300 0x7f918c13b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.614+0000 7f9190b43640 1 -- 172.21.15.53:0/4022266070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f918c06e030 msgr2=0x7f918c13ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:48.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.614+0000 7f9190b43640 1 --2- 172.21.15.53:0/4022266070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f918c06e030 0x7f918c13ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:48.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.614+0000 7f9190b43640 1 -- 172.21.15.53:0/4022266070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9184009a70 con 0x7f918c0c0eb0 2023-12-08T20:55:48.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.618+0000 7f9190b43640 1 --2- 172.21.15.53:0/4022266070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f918c0c0eb0 0x7f918c1f2330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f917c00c500 tx=0x7f917c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:48.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.622+0000 7f9181ffb640 1 -- 172.21.15.53:0/4022266070 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c0052d0 con 0x7f918c0c0eb0 2023-12-08T20:55:48.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.622+0000 7f9181ffb640 1 -- 172.21.15.53:0/4022266070 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c005450 con 0x7f918c0c0eb0 2023-12-08T20:55:48.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.622+0000 7f9181ffb640 1 -- 172.21.15.53:0/4022266070 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c012870 con 0x7f918c0c0eb0 2023-12-08T20:55:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.622+0000 7f91935a8640 1 -- 172.21.15.53:0/4022266070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918c0c3b10 con 0x7f918c0c0eb0 2023-12-08T20:55:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.622+0000 7f91935a8640 1 -- 172.21.15.53:0/4022266070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918c0c5860 con 0x7f918c0c0eb0 2023-12-08T20:55:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.622+0000 7f91935a8640 1 -- 172.21.15.53:0/4022266070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f918c074190 con 0x7f918c0c0eb0 2023-12-08T20:55:48.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.642+0000 7f9181ffb640 1 -- 172.21.15.53:0/4022266070 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f917c0129d0 con 0x7f918c0c0eb0 2023-12-08T20:55:48.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.642+0000 7f9181ffb640 1 --2- 172.21.15.53:0/4022266070 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f91700664c0 0x7f9170068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:48.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.642+0000 7f9191344640 1 --2- 172.21.15.53:0/4022266070 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f91700664c0 0x7f9170068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:48.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.642+0000 7f9191344640 1 --2- 172.21.15.53:0/4022266070 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f91700664c0 0x7f9170068980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9188001560 tx=0x7f9188007a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:48.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.922+0000 7f9181ffb640 1 -- 172.21.15.53:0/4022266070 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f917c055d50 con 0x7f918c0c0eb0 2023-12-08T20:55:48.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:48.922+0000 7f9181ffb640 1 -- 172.21.15.53:0/4022266070 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f917c051990 con 0x7f918c0c0eb0 2023-12-08T20:55:49.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.070+0000 7f91935a8640 1 -- 172.21.15.53:0/4022266070 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f918c06adc0 con 0x7f91700664c0 2023-12-08T20:55:49.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.082+0000 7f9181ffb640 1 -- 172.21.15.53:0/4022266070 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368781 (secure 0 0 0) 0x7f91880058c0 con 0x7f91700664c0 2023-12-08T20:55:49.084 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:49.088 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-12-08T20:55:49.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.086+0000 7f91935a8640 1 -- 172.21.15.53:0/4022266070 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f91700664c0 msgr2=0x7f9170068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:49.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.086+0000 7f91935a8640 1 --2- 172.21.15.53:0/4022266070 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f91700664c0 0x7f9170068980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9188001560 tx=0x7f9188007a50 comp rx=0 tx=0).stop 2023-12-08T20:55:49.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.086+0000 7f91935a8640 1 -- 172.21.15.53:0/4022266070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f918c0c0eb0 msgr2=0x7f918c1f2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:49.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.086+0000 7f91935a8640 1 --2- 172.21.15.53:0/4022266070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f918c0c0eb0 0x7f918c1f2330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f917c00c500 tx=0x7f917c00c9c0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.086+0000 7f91935a8640 1 -- 172.21.15.53:0/4022266070 shutdown_connections 2023-12-08T20:55:49.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.086+0000 7f91935a8640 1 --2- 172.21.15.53:0/4022266070 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f91700664c0 0x7f9170068980 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.086+0000 7f91935a8640 1 --2- 172.21.15.53:0/4022266070 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f918c150300 0x7f918c13b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.086+0000 7f91935a8640 1 --2- 172.21.15.53:0/4022266070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f918c0c0eb0 0x7f918c1f2330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.086+0000 7f91935a8640 1 --2- 172.21.15.53:0/4022266070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f918c06e030 0x7f918c13ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.086+0000 7f91935a8640 1 -- 172.21.15.53:0/4022266070 >> 172.21.15.53:0/4022266070 conn(0x7f918c06b6c0 msgr2=0x7f918c0c2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:49.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.090+0000 7f91935a8640 1 -- 172.21.15.53:0/4022266070 shutdown_connections 2023-12-08T20:55:49.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.090+0000 7f91935a8640 1 -- 172.21.15.53:0/4022266070 wait complete. 2023-12-08T20:55:49.104 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-12-08T20:55:47.245805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235312,"kb_used_data":2496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739408,"statfs":{"total":773094113280,"available":772853153792,"internally_reserved":0,"allocated":2555904,"data_stored":2132114,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004857"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360564+0000","last_change":"2023-12-08T20:54:54.983255+0000","last_active":"2023-12-08T20:55:04.360564+0000","last_peered":"2023-12-08T20:55:04.360564+0000","last_clean":"2023-12-08T20:55:04.360564+0000","last_became_active":"2023-12-08T20:54:54.982479+0000","last_became_peered":"2023-12-08T20:54:54.982479+0000","last_unstale":"2023-12-08T20:55:04.360564+0000","last_undegraded":"2023-12-08T20:55:04.360564+0000","last_fullsized":"2023-12-08T20:55:04.360564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:17:36.784429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.542062+0000","last_change":"2023-12-08T20:54:56.407614+0000","last_active":"2023-12-08T20:55:04.542062+0000","last_peered":"2023-12-08T20:55:04.542062+0000","last_clean":"2023-12-08T20:55:04.542062+0000","last_became_active":"2023-12-08T20:54:56.406245+0000","last_became_peered":"2023-12-08T20:54:56.406245+0000","last_unstale":"2023-12-08T20:55:04.542062+0000","last_undegraded":"2023-12-08T20:55:04.542062+0000","last_fullsized":"2023-12-08T20:55:04.542062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:29.997818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.414972+0000","last_change":"2023-12-08T20:55:04.459400+0000","last_active":"2023-12-08T20:55:05.414972+0000","last_peered":"2023-12-08T20:55:05.414972+0000","last_clean":"2023-12-08T20:55:05.414972+0000","last_became_active":"2023-12-08T20:55:04.458087+0000","last_became_peered":"2023-12-08T20:55:04.458087+0000","last_unstale":"2023-12-08T20:55:05.414972+0000","last_undegraded":"2023-12-08T20:55:05.414972+0000","last_fullsized":"2023-12-08T20:55:05.414972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:23.378911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.542369+0000","last_change":"2023-12-08T20:54:54.929925+0000","last_active":"2023-12-08T20:55:04.542369+0000","last_peered":"2023-12-08T20:55:04.542369+0000","last_clean":"2023-12-08T20:55:04.542369+0000","last_became_active":"2023-12-08T20:54:54.929391+0000","last_became_peered":"2023-12-08T20:54:54.929391+0000","last_unstale":"2023-12-08T20:55:04.542369+0000","last_undegraded":"2023-12-08T20:55:04.542369+0000","last_fullsized":"2023-12-08T20:55:04.542369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:15:29.148520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540789+0000","last_change":"2023-12-08T20:54:56.409201+0000","last_active":"2023-12-08T20:55:04.540789+0000","last_peered":"2023-12-08T20:55:04.540789+0000","last_clean":"2023-12-08T20:55:04.540789+0000","last_became_active":"2023-12-08T20:54:56.408361+0000","last_became_peered":"2023-12-08T20:54:56.408361+0000","last_unstale":"2023-12-08T20:55:04.540789+0000","last_undegraded":"2023-12-08T20:55:04.540789+0000","last_fullsized":"2023-12-08T20:55:04.540789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:43:42.044530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491431+0000","last_change":"2023-12-08T20:55:04.529086+0000","last_active":"2023-12-08T20:55:05.491431+0000","last_peered":"2023-12-08T20:55:05.491431+0000","last_clean":"2023-12-08T20:55:05.491431+0000","last_became_active":"2023-12-08T20:55:04.528732+0000","last_became_peered":"2023-12-08T20:55:04.528732+0000","last_unstale":"2023-12-08T20:55:05.491431+0000","last_undegraded":"2023-12-08T20:55:05.491431+0000","last_fullsized":"2023-12-08T20:55:05.491431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:09:07.484233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504210+0000","last_change":"2023-12-08T20:54:54.935973+0000","last_active":"2023-12-08T20:55:04.504210+0000","last_peered":"2023-12-08T20:55:04.504210+0000","last_clean":"2023-12-08T20:55:04.504210+0000","last_became_active":"2023-12-08T20:54:54.935620+0000","last_became_peered":"2023-12-08T20:54:54.935620+0000","last_unstale":"2023-12-08T20:55:04.504210+0000","last_undegraded":"2023-12-08T20:55:04.504210+0000","last_fullsized":"2023-12-08T20:55:04.504210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:57.947192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456300+0000","last_change":"2023-12-08T20:54:56.382016+0000","last_active":"2023-12-08T20:55:04.456300+0000","last_peered":"2023-12-08T20:55:04.456300+0000","last_clean":"2023-12-08T20:55:04.456300+0000","last_became_active":"2023-12-08T20:54:56.380927+0000","last_became_peered":"2023-12-08T20:54:56.380927+0000","last_unstale":"2023-12-08T20:55:04.456300+0000","last_undegraded":"2023-12-08T20:55:04.456300+0000","last_fullsized":"2023-12-08T20:55:04.456300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491749+0000","last_change":"2023-12-08T20:55:04.527024+0000","last_active":"2023-12-08T20:55:05.491749+0000","last_peered":"2023-12-08T20:55:05.491749+0000","last_clean":"2023-12-08T20:55:05.491749+0000","last_became_active":"2023-12-08T20:55:04.526605+0000","last_became_peered":"2023-12-08T20:55:04.526605+0000","last_unstale":"2023-12-08T20:55:05.491749+0000","last_undegraded":"2023-12-08T20:55:05.491749+0000","last_fullsized":"2023-12-08T20:55:05.491749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:15.471006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.505308+0000","last_change":"2023-12-08T20:54:54.929388+0000","last_active":"2023-12-08T20:55:04.505308+0000","last_peered":"2023-12-08T20:55:04.505308+0000","last_clean":"2023-12-08T20:55:04.505308+0000","last_became_active":"2023-12-08T20:54:54.926132+0000","last_became_peered":"2023-12-08T20:54:54.926132+0000","last_unstale":"2023-12-08T20:55:04.505308+0000","last_undegraded":"2023-12-08T20:55:04.505308+0000","last_fullsized":"2023-12-08T20:55:04.505308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:00.435948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508722+0000","last_change":"2023-12-08T20:54:56.388306+0000","last_active":"2023-12-08T20:55:04.508722+0000","last_peered":"2023-12-08T20:55:04.508722+0000","last_clean":"2023-12-08T20:55:04.508722+0000","last_became_active":"2023-12-08T20:54:56.387528+0000","last_became_peered":"2023-12-08T20:54:56.387528+0000","last_unstale":"2023-12-08T20:55:04.508722+0000","last_undegraded":"2023-12-08T20:55:04.508722+0000","last_fullsized":"2023-12-08T20:55:04.508722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:22.236935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491559+0000","last_change":"2023-12-08T20:55:04.523251+0000","last_active":"2023-12-08T20:55:05.491559+0000","last_peered":"2023-12-08T20:55:05.491559+0000","last_clean":"2023-12-08T20:55:05.491559+0000","last_became_active":"2023-12-08T20:55:04.522777+0000","last_became_peered":"2023-12-08T20:55:04.522777+0000","last_unstale":"2023-12-08T20:55:05.491559+0000","last_undegraded":"2023-12-08T20:55:05.491559+0000","last_fullsized":"2023-12-08T20:55:05.491559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:09.972989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508344+0000","last_change":"2023-12-08T20:54:56.319638+0000","last_active":"2023-12-08T20:55:04.508344+0000","last_peered":"2023-12-08T20:55:04.508344+0000","last_clean":"2023-12-08T20:55:04.508344+0000","last_became_active":"2023-12-08T20:54:56.318855+0000","last_became_peered":"2023-12-08T20:54:56.318855+0000","last_unstale":"2023-12-08T20:55:04.508344+0000","last_undegraded":"2023-12-08T20:55:04.508344+0000","last_fullsized":"2023-12-08T20:55:04.508344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:27.151902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508472+0000","last_change":"2023-12-08T20:54:54.929584+0000","last_active":"2023-12-08T20:55:04.508472+0000","last_peered":"2023-12-08T20:55:04.508472+0000","last_clean":"2023-12-08T20:55:04.508472+0000","last_became_active":"2023-12-08T20:54:54.928702+0000","last_became_peered":"2023-12-08T20:54:54.928702+0000","last_unstale":"2023-12-08T20:55:04.508472+0000","last_undegraded":"2023-12-08T20:55:04.508472+0000","last_fullsized":"2023-12-08T20:55:04.508472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:40.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.450640+0000","last_change":"2023-12-08T20:55:04.535786+0000","last_active":"2023-12-08T20:55:05.450640+0000","last_peered":"2023-12-08T20:55:05.450640+0000","last_clean":"2023-12-08T20:55:05.450640+0000","last_became_active":"2023-12-08T20:55:04.535119+0000","last_became_peered":"2023-12-08T20:55:04.535119+0000","last_unstale":"2023-12-08T20:55:05.450640+0000","last_undegraded":"2023-12-08T20:55:05.450640+0000","last_fullsized":"2023-12-08T20:55:05.450640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:23:32.647822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.305734+0000","last_change":"2023-12-08T20:54:56.370877+0000","last_active":"2023-12-08T20:55:04.305734+0000","last_peered":"2023-12-08T20:55:04.305734+0000","last_clean":"2023-12-08T20:55:04.305734+0000","last_became_active":"2023-12-08T20:54:56.370044+0000","last_became_peered":"2023-12-08T20:54:56.370044+0000","last_unstale":"2023-12-08T20:55:04.305734+0000","last_undegraded":"2023-12-08T20:55:04.305734+0000","last_fullsized":"2023-12-08T20:55:04.305734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.407476+0000","last_change":"2023-12-08T20:54:54.923604+0000","last_active":"2023-12-08T20:55:04.407476+0000","last_peered":"2023-12-08T20:55:04.407476+0000","last_clean":"2023-12-08T20:55:04.407476+0000","last_became_active":"2023-12-08T20:54:54.922960+0000","last_became_peered":"2023-12-08T20:54:54.922960+0000","last_unstale":"2023-12-08T20:55:04.407476+0000","last_undegraded":"2023-12-08T20:55:04.407476+0000","last_fullsized":"2023-12-08T20:55:04.407476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:41:46.444603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.554984+0000","last_change":"2023-12-08T20:55:04.522655+0000","last_active":"2023-12-08T20:55:05.554984+0000","last_peered":"2023-12-08T20:55:05.554984+0000","last_clean":"2023-12-08T20:55:05.554984+0000","last_became_active":"2023-12-08T20:55:04.522172+0000","last_became_peered":"2023-12-08T20:55:04.522172+0000","last_unstale":"2023-12-08T20:55:05.554984+0000","last_undegraded":"2023-12-08T20:55:05.554984+0000","last_fullsized":"2023-12-08T20:55:05.554984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:09:00.038275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360579+0000","last_change":"2023-12-08T20:54:56.366227+0000","last_active":"2023-12-08T20:55:04.360579+0000","last_peered":"2023-12-08T20:55:04.360579+0000","last_clean":"2023-12-08T20:55:04.360579+0000","last_became_active":"2023-12-08T20:54:56.365552+0000","last_became_peered":"2023-12-08T20:54:56.365552+0000","last_unstale":"2023-12-08T20:55:04.360579+0000","last_undegraded":"2023-12-08T20:55:04.360579+0000","last_fullsized":"2023-12-08T20:55:04.360579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:00.821031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.361153+0000","last_change":"2023-12-08T20:54:54.980466+0000","last_active":"2023-12-08T20:55:04.361153+0000","last_peered":"2023-12-08T20:55:04.361153+0000","last_clean":"2023-12-08T20:55:04.361153+0000","last_became_active":"2023-12-08T20:54:54.979668+0000","last_became_peered":"2023-12-08T20:54:54.979668+0000","last_unstale":"2023-12-08T20:55:04.361153+0000","last_undegraded":"2023-12-08T20:55:04.361153+0000","last_fullsized":"2023-12-08T20:55:04.361153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:53.529738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.415715+0000","last_change":"2023-12-08T20:55:04.513186+0000","last_active":"2023-12-08T20:55:05.415715+0000","last_peered":"2023-12-08T20:55:05.415715+0000","last_clean":"2023-12-08T20:55:05.415715+0000","last_became_active":"2023-12-08T20:55:04.512549+0000","last_became_peered":"2023-12-08T20:55:04.512549+0000","last_unstale":"2023-12-08T20:55:05.415715+0000","last_undegraded":"2023-12-08T20:55:05.415715+0000","last_fullsized":"2023-12-08T20:55:05.415715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:49:31.307794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508158+0000","last_change":"2023-12-08T20:54:56.261452+0000","last_active":"2023-12-08T20:55:04.508158+0000","last_peered":"2023-12-08T20:55:04.508158+0000","last_clean":"2023-12-08T20:55:04.508158+0000","last_became_active":"2023-12-08T20:54:56.260355+0000","last_became_peered":"2023-12-08T20:54:56.260355+0000","last_unstale":"2023-12-08T20:55:04.508158+0000","last_undegraded":"2023-12-08T20:55:04.508158+0000","last_fullsized":"2023-12-08T20:55:04.508158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:47:02.249125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503832+0000","last_change":"2023-12-08T20:54:54.926546+0000","last_active":"2023-12-08T20:55:04.503832+0000","last_peered":"2023-12-08T20:55:04.503832+0000","last_clean":"2023-12-08T20:55:04.503832+0000","last_became_active":"2023-12-08T20:54:54.925888+0000","last_became_peered":"2023-12-08T20:54:54.925888+0000","last_unstale":"2023-12-08T20:55:04.503832+0000","last_undegraded":"2023-12-08T20:55:04.503832+0000","last_fullsized":"2023-12-08T20:55:04.503832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:25:20.796728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.492624+0000","last_change":"2023-12-08T20:55:04.529041+0000","last_active":"2023-12-08T20:55:05.492624+0000","last_peered":"2023-12-08T20:55:05.492624+0000","last_clean":"2023-12-08T20:55:05.492624+0000","last_became_active":"2023-12-08T20:55:04.528640+0000","last_became_peered":"2023-12-08T20:55:04.528640+0000","last_unstale":"2023-12-08T20:55:05.492624+0000","last_undegraded":"2023-12-08T20:55:05.492624+0000","last_fullsized":"2023-12-08T20:55:05.492624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:18.653508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360612+0000","last_change":"2023-12-08T20:54:56.365339+0000","last_active":"2023-12-08T20:55:04.360612+0000","last_peered":"2023-12-08T20:55:04.360612+0000","last_clean":"2023-12-08T20:55:04.360612+0000","last_became_active":"2023-12-08T20:54:56.364597+0000","last_became_peered":"2023-12-08T20:54:56.364597+0000","last_unstale":"2023-12-08T20:55:04.360612+0000","last_undegraded":"2023-12-08T20:55:04.360612+0000","last_fullsized":"2023-12-08T20:55:04.360612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:17:58.931401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.509296+0000","last_change":"2023-12-08T20:54:54.928399+0000","last_active":"2023-12-08T20:55:04.509296+0000","last_peered":"2023-12-08T20:55:04.509296+0000","last_clean":"2023-12-08T20:55:04.509296+0000","last_became_active":"2023-12-08T20:54:54.927814+0000","last_became_peered":"2023-12-08T20:54:54.927814+0000","last_unstale":"2023-12-08T20:55:04.509296+0000","last_undegraded":"2023-12-08T20:55:04.509296+0000","last_fullsized":"2023-12-08T20:55:04.509296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:04:22.986992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491362+0000","last_change":"2023-12-08T20:55:04.523561+0000","last_active":"2023-12-08T20:55:05.491362+0000","last_peered":"2023-12-08T20:55:05.491362+0000","last_clean":"2023-12-08T20:55:05.491362+0000","last_became_active":"2023-12-08T20:55:04.522714+0000","last_became_peered":"2023-12-08T20:55:04.522714+0000","last_unstale":"2023-12-08T20:55:05.491362+0000","last_undegraded":"2023-12-08T20:55:05.491362+0000","last_fullsized":"2023-12-08T20:55:05.491362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:14.534456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360043+0000","last_change":"2023-12-08T20:54:56.331268+0000","last_active":"2023-12-08T20:55:04.360043+0000","last_peered":"2023-12-08T20:55:04.360043+0000","last_clean":"2023-12-08T20:55:04.360043+0000","last_became_active":"2023-12-08T20:54:56.330508+0000","last_became_peered":"2023-12-08T20:54:56.330508+0000","last_unstale":"2023-12-08T20:55:04.360043+0000","last_undegraded":"2023-12-08T20:55:04.360043+0000","last_fullsized":"2023-12-08T20:55:04.360043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:52.392589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.361147+0000","last_change":"2023-12-08T20:54:54.982136+0000","last_active":"2023-12-08T20:55:04.361147+0000","last_peered":"2023-12-08T20:55:04.361147+0000","last_clean":"2023-12-08T20:55:04.361147+0000","last_became_active":"2023-12-08T20:54:54.981168+0000","last_became_peered":"2023-12-08T20:54:54.981168+0000","last_unstale":"2023-12-08T20:55:04.361147+0000","last_undegraded":"2023-12-08T20:55:04.361147+0000","last_fullsized":"2023-12-08T20:55:04.361147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:13.841870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.556069+0000","last_change":"2023-12-08T20:55:04.513360+0000","last_active":"2023-12-08T20:55:05.556069+0000","last_peered":"2023-12-08T20:55:05.556069+0000","last_clean":"2023-12-08T20:55:05.556069+0000","last_became_active":"2023-12-08T20:55:04.511032+0000","last_became_peered":"2023-12-08T20:55:04.511032+0000","last_unstale":"2023-12-08T20:55:05.556069+0000","last_undegraded":"2023-12-08T20:55:05.556069+0000","last_fullsized":"2023-12-08T20:55:05.556069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:38:04.841172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.413307+0000","last_change":"2023-12-08T20:54:56.409829+0000","last_active":"2023-12-08T20:55:04.413307+0000","last_peered":"2023-12-08T20:55:04.413307+0000","last_clean":"2023-12-08T20:55:04.413307+0000","last_became_active":"2023-12-08T20:54:56.409291+0000","last_became_peered":"2023-12-08T20:54:56.409291+0000","last_unstale":"2023-12-08T20:55:04.413307+0000","last_undegraded":"2023-12-08T20:55:04.413307+0000","last_fullsized":"2023-12-08T20:55:04.413307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:06:37.234510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508973+0000","last_change":"2023-12-08T20:54:54.978750+0000","last_active":"2023-12-08T20:55:04.508973+0000","last_peered":"2023-12-08T20:55:04.508973+0000","last_clean":"2023-12-08T20:55:04.508973+0000","last_became_active":"2023-12-08T20:54:54.978416+0000","last_became_peered":"2023-12-08T20:54:54.978416+0000","last_unstale":"2023-12-08T20:55:04.508973+0000","last_undegraded":"2023-12-08T20:55:04.508973+0000","last_fullsized":"2023-12-08T20:55:04.508973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:00:08.584168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553308+0000","last_change":"2023-12-08T20:55:04.507859+0000","last_active":"2023-12-08T20:55:05.553308+0000","last_peered":"2023-12-08T20:55:05.553308+0000","last_clean":"2023-12-08T20:55:05.553308+0000","last_became_active":"2023-12-08T20:55:04.507454+0000","last_became_peered":"2023-12-08T20:55:04.507454+0000","last_unstale":"2023-12-08T20:55:05.553308+0000","last_undegraded":"2023-12-08T20:55:05.553308+0000","last_fullsized":"2023-12-08T20:55:05.553308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:56:57.279368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.498994+0000","last_change":"2023-12-08T20:54:56.372983+0000","last_active":"2023-12-08T20:55:04.498994+0000","last_peered":"2023-12-08T20:55:04.498994+0000","last_clean":"2023-12-08T20:55:04.498994+0000","last_became_active":"2023-12-08T20:54:56.369974+0000","last_became_peered":"2023-12-08T20:54:56.369974+0000","last_unstale":"2023-12-08T20:55:04.498994+0000","last_undegraded":"2023-12-08T20:55:04.498994+0000","last_fullsized":"2023-12-08T20:55:04.498994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.531685+0000","last_change":"2023-12-08T20:54:54.925560+0000","last_active":"2023-12-08T20:55:04.531685+0000","last_peered":"2023-12-08T20:55:04.531685+0000","last_clean":"2023-12-08T20:55:04.531685+0000","last_became_active":"2023-12-08T20:54:54.925022+0000","last_became_peered":"2023-12-08T20:54:54.925022+0000","last_unstale":"2023-12-08T20:55:04.531685+0000","last_undegraded":"2023-12-08T20:55:04.531685+0000","last_fullsized":"2023-12-08T20:55:04.531685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:10:52.902793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.552418+0000","last_change":"2023-12-08T20:55:04.531931+0000","last_active":"2023-12-08T20:55:05.552418+0000","last_peered":"2023-12-08T20:55:05.552418+0000","last_clean":"2023-12-08T20:55:05.552418+0000","last_became_active":"2023-12-08T20:55:04.530774+0000","last_became_peered":"2023-12-08T20:55:04.530774+0000","last_unstale":"2023-12-08T20:55:05.552418+0000","last_undegraded":"2023-12-08T20:55:05.552418+0000","last_fullsized":"2023-12-08T20:55:05.552418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:39:26.927665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503831+0000","last_change":"2023-12-08T20:54:56.391492+0000","last_active":"2023-12-08T20:55:04.503831+0000","last_peered":"2023-12-08T20:55:04.503831+0000","last_clean":"2023-12-08T20:55:04.503831+0000","last_became_active":"2023-12-08T20:54:56.385090+0000","last_became_peered":"2023-12-08T20:54:56.385090+0000","last_unstale":"2023-12-08T20:55:04.503831+0000","last_undegraded":"2023-12-08T20:55:04.503831+0000","last_fullsized":"2023-12-08T20:55:04.503831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:21:29.009005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508632+0000","last_change":"2023-12-08T20:54:54.932503+0000","last_active":"2023-12-08T20:55:04.508632+0000","last_peered":"2023-12-08T20:55:04.508632+0000","last_clean":"2023-12-08T20:55:04.508632+0000","last_became_active":"2023-12-08T20:54:54.932121+0000","last_became_peered":"2023-12-08T20:54:54.932121+0000","last_unstale":"2023-12-08T20:55:04.508632+0000","last_undegraded":"2023-12-08T20:55:04.508632+0000","last_fullsized":"2023-12-08T20:55:04.508632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:58.013744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553088+0000","last_change":"2023-12-08T20:55:04.529911+0000","last_active":"2023-12-08T20:55:05.553088+0000","last_peered":"2023-12-08T20:55:05.553088+0000","last_clean":"2023-12-08T20:55:05.553088+0000","last_became_active":"2023-12-08T20:55:04.528698+0000","last_became_peered":"2023-12-08T20:55:04.528698+0000","last_unstale":"2023-12-08T20:55:05.553088+0000","last_undegraded":"2023-12-08T20:55:05.553088+0000","last_fullsized":"2023-12-08T20:55:05.553088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:33:11.874876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.512905+0000","last_change":"2023-12-08T20:54:56.413886+0000","last_active":"2023-12-08T20:55:04.512905+0000","last_peered":"2023-12-08T20:55:04.512905+0000","last_clean":"2023-12-08T20:55:04.512905+0000","last_became_active":"2023-12-08T20:54:56.412786+0000","last_became_peered":"2023-12-08T20:54:56.412786+0000","last_unstale":"2023-12-08T20:55:04.512905+0000","last_undegraded":"2023-12-08T20:55:04.512905+0000","last_fullsized":"2023-12-08T20:55:04.512905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:39.331476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.305732+0000","last_change":"2023-12-08T20:54:54.922605+0000","last_active":"2023-12-08T20:55:04.305732+0000","last_peered":"2023-12-08T20:55:04.305732+0000","last_clean":"2023-12-08T20:55:04.305732+0000","last_became_active":"2023-12-08T20:54:54.922014+0000","last_became_peered":"2023-12-08T20:54:54.922014+0000","last_unstale":"2023-12-08T20:55:04.305732+0000","last_undegraded":"2023-12-08T20:55:04.305732+0000","last_fullsized":"2023-12-08T20:55:04.305732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:08:48.601596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.554232+0000","last_change":"2023-12-08T20:55:04.509438+0000","last_active":"2023-12-08T20:55:05.554232+0000","last_peered":"2023-12-08T20:55:05.554232+0000","last_clean":"2023-12-08T20:55:05.554232+0000","last_became_active":"2023-12-08T20:55:04.508219+0000","last_became_peered":"2023-12-08T20:55:04.508219+0000","last_unstale":"2023-12-08T20:55:05.554232+0000","last_undegraded":"2023-12-08T20:55:05.554232+0000","last_fullsized":"2023-12-08T20:55:05.554232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:16:31.758437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.406374+0000","last_change":"2023-12-08T20:54:56.370599+0000","last_active":"2023-12-08T20:55:04.406374+0000","last_peered":"2023-12-08T20:55:04.406374+0000","last_clean":"2023-12-08T20:55:04.406374+0000","last_became_active":"2023-12-08T20:54:56.370121+0000","last_became_peered":"2023-12-08T20:54:56.370121+0000","last_unstale":"2023-12-08T20:55:04.406374+0000","last_undegraded":"2023-12-08T20:55:04.406374+0000","last_fullsized":"2023-12-08T20:55:04.406374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:58:13.927241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507925+0000","last_change":"2023-12-08T20:54:54.927599+0000","last_active":"2023-12-08T20:55:04.507925+0000","last_peered":"2023-12-08T20:55:04.507925+0000","last_clean":"2023-12-08T20:55:04.507925+0000","last_became_active":"2023-12-08T20:54:54.927120+0000","last_became_peered":"2023-12-08T20:54:54.927120+0000","last_unstale":"2023-12-08T20:55:04.507925+0000","last_undegraded":"2023-12-08T20:55:04.507925+0000","last_fullsized":"2023-12-08T20:55:04.507925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:38.042201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.557221+0000","last_change":"2023-12-08T20:55:04.546945+0000","last_active":"2023-12-08T20:55:05.557221+0000","last_peered":"2023-12-08T20:55:05.557221+0000","last_clean":"2023-12-08T20:55:05.557221+0000","last_became_active":"2023-12-08T20:55:04.546439+0000","last_became_peered":"2023-12-08T20:55:04.546439+0000","last_unstale":"2023-12-08T20:55:05.557221+0000","last_undegraded":"2023-12-08T20:55:05.557221+0000","last_fullsized":"2023-12-08T20:55:05.557221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:30.484701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.361611+0000","last_change":"2023-12-08T20:54:56.372770+0000","last_active":"2023-12-08T20:55:04.361611+0000","last_peered":"2023-12-08T20:55:04.361611+0000","last_clean":"2023-12-08T20:55:04.361611+0000","last_became_active":"2023-12-08T20:54:56.372205+0000","last_became_peered":"2023-12-08T20:54:56.372205+0000","last_unstale":"2023-12-08T20:55:04.361611+0000","last_undegraded":"2023-12-08T20:55:04.361611+0000","last_fullsized":"2023-12-08T20:55:04.361611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:06.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508582+0000","last_change":"2023-12-08T20:54:54.929937+0000","last_active":"2023-12-08T20:55:04.508582+0000","last_peered":"2023-12-08T20:55:04.508582+0000","last_clean":"2023-12-08T20:55:04.508582+0000","last_became_active":"2023-12-08T20:54:54.929177+0000","last_became_peered":"2023-12-08T20:54:54.929177+0000","last_unstale":"2023-12-08T20:55:04.508582+0000","last_undegraded":"2023-12-08T20:55:04.508582+0000","last_fullsized":"2023-12-08T20:55:04.508582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:39:58.988364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.455933+0000","last_change":"2023-12-08T20:54:16.149485+0000","last_active":"2023-12-08T20:55:04.455933+0000","last_peered":"2023-12-08T20:55:04.455933+0000","last_clean":"2023-12-08T20:55:04.455933+0000","last_became_active":"2023-12-08T20:54:16.147507+0000","last_became_peered":"2023-12-08T20:54:16.147507+0000","last_unstale":"2023-12-08T20:55:04.455933+0000","last_undegraded":"2023-12-08T20:55:04.455933+0000","last_fullsized":"2023-12-08T20:55:04.455933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_clean_scrub_stamp":"2023-12-08T20:54:14.141045+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:17.484651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.451649+0000","last_change":"2023-12-08T20:55:04.515531+0000","last_active":"2023-12-08T20:55:05.451649+0000","last_peered":"2023-12-08T20:55:05.451649+0000","last_clean":"2023-12-08T20:55:05.451649+0000","last_became_active":"2023-12-08T20:55:04.515200+0000","last_became_peered":"2023-12-08T20:55:04.515200+0000","last_unstale":"2023-12-08T20:55:05.451649+0000","last_undegraded":"2023-12-08T20:55:05.451649+0000","last_fullsized":"2023-12-08T20:55:05.451649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:00:08.085700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508800+0000","last_change":"2023-12-08T20:54:56.318724+0000","last_active":"2023-12-08T20:55:04.508800+0000","last_peered":"2023-12-08T20:55:04.508800+0000","last_clean":"2023-12-08T20:55:04.508800+0000","last_became_active":"2023-12-08T20:54:56.318408+0000","last_became_peered":"2023-12-08T20:54:56.318408+0000","last_unstale":"2023-12-08T20:55:04.508800+0000","last_undegraded":"2023-12-08T20:55:04.508800+0000","last_fullsized":"2023-12-08T20:55:04.508800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:14:20.217847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.413648+0000","last_change":"2023-12-08T20:54:54.926031+0000","last_active":"2023-12-08T20:55:04.413648+0000","last_peered":"2023-12-08T20:55:04.413648+0000","last_clean":"2023-12-08T20:55:04.413648+0000","last_became_active":"2023-12-08T20:54:54.925610+0000","last_became_peered":"2023-12-08T20:54:54.925610+0000","last_unstale":"2023-12-08T20:55:04.413648+0000","last_undegraded":"2023-12-08T20:55:04.413648+0000","last_fullsized":"2023-12-08T20:55:04.413648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:05:08.857673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491648+0000","last_change":"2023-12-08T20:55:04.523264+0000","last_active":"2023-12-08T20:55:05.491648+0000","last_peered":"2023-12-08T20:55:05.491648+0000","last_clean":"2023-12-08T20:55:05.491648+0000","last_became_active":"2023-12-08T20:55:04.522245+0000","last_became_peered":"2023-12-08T20:55:04.522245+0000","last_unstale":"2023-12-08T20:55:05.491648+0000","last_undegraded":"2023-12-08T20:55:05.491648+0000","last_fullsized":"2023-12-08T20:55:05.491648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:23.322536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.505093+0000","last_change":"2023-12-08T20:54:56.378291+0000","last_active":"2023-12-08T20:55:04.505093+0000","last_peered":"2023-12-08T20:55:04.505093+0000","last_clean":"2023-12-08T20:55:04.505093+0000","last_became_active":"2023-12-08T20:54:56.377762+0000","last_became_peered":"2023-12-08T20:54:56.377762+0000","last_unstale":"2023-12-08T20:55:04.505093+0000","last_undegraded":"2023-12-08T20:55:04.505093+0000","last_fullsized":"2023-12-08T20:55:04.505093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:11:11.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540684+0000","last_change":"2023-12-08T20:54:54.936008+0000","last_active":"2023-12-08T20:55:04.540684+0000","last_peered":"2023-12-08T20:55:04.540684+0000","last_clean":"2023-12-08T20:55:04.540684+0000","last_became_active":"2023-12-08T20:54:54.935472+0000","last_became_peered":"2023-12-08T20:54:54.935472+0000","last_unstale":"2023-12-08T20:55:04.540684+0000","last_undegraded":"2023-12-08T20:55:04.540684+0000","last_fullsized":"2023-12-08T20:55:04.540684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:11:02.460764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.557220+0000","last_change":"2023-12-08T20:55:04.534674+0000","last_active":"2023-12-08T20:55:05.557220+0000","last_peered":"2023-12-08T20:55:05.557220+0000","last_clean":"2023-12-08T20:55:05.557220+0000","last_became_active":"2023-12-08T20:55:04.533305+0000","last_became_peered":"2023-12-08T20:55:04.533305+0000","last_unstale":"2023-12-08T20:55:05.557220+0000","last_undegraded":"2023-12-08T20:55:05.557220+0000","last_fullsized":"2023-12-08T20:55:05.557220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:18.790378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504316+0000","last_change":"2023-12-08T20:54:56.380702+0000","last_active":"2023-12-08T20:55:04.504316+0000","last_peered":"2023-12-08T20:55:04.504316+0000","last_clean":"2023-12-08T20:55:04.504316+0000","last_became_active":"2023-12-08T20:54:56.379933+0000","last_became_peered":"2023-12-08T20:54:56.379933+0000","last_unstale":"2023-12-08T20:55:04.504316+0000","last_undegraded":"2023-12-08T20:55:04.504316+0000","last_fullsized":"2023-12-08T20:55:04.504316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:31:18.872161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360865+0000","last_change":"2023-12-08T20:54:54.983221+0000","last_active":"2023-12-08T20:55:04.360865+0000","last_peered":"2023-12-08T20:55:04.360865+0000","last_clean":"2023-12-08T20:55:04.360865+0000","last_became_active":"2023-12-08T20:54:54.982414+0000","last_became_peered":"2023-12-08T20:54:54.982414+0000","last_unstale":"2023-12-08T20:55:04.360865+0000","last_undegraded":"2023-12-08T20:55:04.360865+0000","last_fullsized":"2023-12-08T20:55:04.360865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:36:42.874558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.449898+0000","last_change":"2023-12-08T20:55:04.515310+0000","last_active":"2023-12-08T20:55:05.449898+0000","last_peered":"2023-12-08T20:55:05.449898+0000","last_clean":"2023-12-08T20:55:05.449898+0000","last_became_active":"2023-12-08T20:55:04.514907+0000","last_became_peered":"2023-12-08T20:55:04.514907+0000","last_unstale":"2023-12-08T20:55:05.449898+0000","last_undegraded":"2023-12-08T20:55:05.449898+0000","last_fullsized":"2023-12-08T20:55:05.449898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:26:19.536478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499717+0000","last_change":"2023-12-08T20:54:56.378176+0000","last_active":"2023-12-08T20:55:04.499717+0000","last_peered":"2023-12-08T20:55:04.499717+0000","last_clean":"2023-12-08T20:55:04.499717+0000","last_became_active":"2023-12-08T20:54:56.377430+0000","last_became_peered":"2023-12-08T20:54:56.377430+0000","last_unstale":"2023-12-08T20:55:04.499717+0000","last_undegraded":"2023-12-08T20:55:04.499717+0000","last_fullsized":"2023-12-08T20:55:04.499717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504536+0000","last_change":"2023-12-08T20:54:54.926769+0000","last_active":"2023-12-08T20:55:04.504536+0000","last_peered":"2023-12-08T20:55:04.504536+0000","last_clean":"2023-12-08T20:55:04.504536+0000","last_became_active":"2023-12-08T20:54:54.926386+0000","last_became_peered":"2023-12-08T20:54:54.926386+0000","last_unstale":"2023-12-08T20:55:04.504536+0000","last_undegraded":"2023-12-08T20:55:04.504536+0000","last_fullsized":"2023-12-08T20:55:04.504536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:05.933965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553168+0000","last_change":"2023-12-08T20:55:04.523709+0000","last_active":"2023-12-08T20:55:05.553168+0000","last_peered":"2023-12-08T20:55:05.553168+0000","last_clean":"2023-12-08T20:55:05.553168+0000","last_became_active":"2023-12-08T20:55:04.523074+0000","last_became_peered":"2023-12-08T20:55:04.523074+0000","last_unstale":"2023-12-08T20:55:05.553168+0000","last_undegraded":"2023-12-08T20:55:05.553168+0000","last_fullsized":"2023-12-08T20:55:05.553168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508063+0000","last_change":"2023-12-08T20:54:56.373188+0000","last_active":"2023-12-08T20:55:04.508063+0000","last_peered":"2023-12-08T20:55:04.508063+0000","last_clean":"2023-12-08T20:55:04.508063+0000","last_became_active":"2023-12-08T20:54:56.371132+0000","last_became_peered":"2023-12-08T20:54:56.371132+0000","last_unstale":"2023-12-08T20:55:04.508063+0000","last_undegraded":"2023-12-08T20:55:04.508063+0000","last_fullsized":"2023-12-08T20:55:04.508063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:30:06.387412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360789+0000","last_change":"2023-12-08T20:54:54.985432+0000","last_active":"2023-12-08T20:55:04.360789+0000","last_peered":"2023-12-08T20:55:04.360789+0000","last_clean":"2023-12-08T20:55:04.360789+0000","last_became_active":"2023-12-08T20:54:54.984661+0000","last_became_peered":"2023-12-08T20:54:54.984661+0000","last_unstale":"2023-12-08T20:55:04.360789+0000","last_undegraded":"2023-12-08T20:55:04.360789+0000","last_fullsized":"2023-12-08T20:55:04.360789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:16:34.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.558071+0000","last_change":"2023-12-08T20:55:04.543349+0000","last_active":"2023-12-08T20:55:05.558071+0000","last_peered":"2023-12-08T20:55:05.558071+0000","last_clean":"2023-12-08T20:55:05.558071+0000","last_became_active":"2023-12-08T20:55:04.541074+0000","last_became_peered":"2023-12-08T20:55:04.541074+0000","last_unstale":"2023-12-08T20:55:05.558071+0000","last_undegraded":"2023-12-08T20:55:05.558071+0000","last_fullsized":"2023-12-08T20:55:05.558071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:35.399668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.455813+0000","last_change":"2023-12-08T20:54:56.413772+0000","last_active":"2023-12-08T20:55:04.455813+0000","last_peered":"2023-12-08T20:55:04.455813+0000","last_clean":"2023-12-08T20:55:04.455813+0000","last_became_active":"2023-12-08T20:54:56.413023+0000","last_became_peered":"2023-12-08T20:54:56.413023+0000","last_unstale":"2023-12-08T20:55:04.455813+0000","last_undegraded":"2023-12-08T20:55:04.455813+0000","last_fullsized":"2023-12-08T20:55:04.455813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504120+0000","last_change":"2023-12-08T20:54:54.929238+0000","last_active":"2023-12-08T20:55:04.504120+0000","last_peered":"2023-12-08T20:55:04.504120+0000","last_clean":"2023-12-08T20:55:04.504120+0000","last_became_active":"2023-12-08T20:54:54.928543+0000","last_became_peered":"2023-12-08T20:54:54.928543+0000","last_unstale":"2023-12-08T20:55:04.504120+0000","last_undegraded":"2023-12-08T20:55:04.504120+0000","last_fullsized":"2023-12-08T20:55:04.504120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:04.997415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.557550+0000","last_change":"2023-12-08T20:55:04.540347+0000","last_active":"2023-12-08T20:55:05.557550+0000","last_peered":"2023-12-08T20:55:05.557550+0000","last_clean":"2023-12-08T20:55:05.557550+0000","last_became_active":"2023-12-08T20:55:04.535002+0000","last_became_peered":"2023-12-08T20:55:04.535002+0000","last_unstale":"2023-12-08T20:55:05.557550+0000","last_undegraded":"2023-12-08T20:55:05.557550+0000","last_fullsized":"2023-12-08T20:55:05.557550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:09.576246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508370+0000","last_change":"2023-12-08T20:54:56.394016+0000","last_active":"2023-12-08T20:55:04.508370+0000","last_peered":"2023-12-08T20:55:04.508370+0000","last_clean":"2023-12-08T20:55:04.508370+0000","last_became_active":"2023-12-08T20:54:56.393187+0000","last_became_peered":"2023-12-08T20:54:56.393187+0000","last_unstale":"2023-12-08T20:55:04.508370+0000","last_undegraded":"2023-12-08T20:55:04.508370+0000","last_fullsized":"2023-12-08T20:55:04.508370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:20:56.762499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508542+0000","last_change":"2023-12-08T20:54:54.930839+0000","last_active":"2023-12-08T20:55:04.508542+0000","last_peered":"2023-12-08T20:55:04.508542+0000","last_clean":"2023-12-08T20:55:04.508542+0000","last_became_active":"2023-12-08T20:54:54.928065+0000","last_became_peered":"2023-12-08T20:54:54.928065+0000","last_unstale":"2023-12-08T20:55:04.508542+0000","last_undegraded":"2023-12-08T20:55:04.508542+0000","last_fullsized":"2023-12-08T20:55:04.508542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:28.708543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.552940+0000","last_change":"2023-12-08T20:55:04.520698+0000","last_active":"2023-12-08T20:55:05.552940+0000","last_peered":"2023-12-08T20:55:05.552940+0000","last_clean":"2023-12-08T20:55:05.552940+0000","last_became_active":"2023-12-08T20:55:04.516783+0000","last_became_peered":"2023-12-08T20:55:04.516783+0000","last_unstale":"2023-12-08T20:55:05.552940+0000","last_undegraded":"2023-12-08T20:55:05.552940+0000","last_fullsized":"2023-12-08T20:55:05.552940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:46:00.331700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.407130+0000","last_change":"2023-12-08T20:54:56.331045+0000","last_active":"2023-12-08T20:55:04.407130+0000","last_peered":"2023-12-08T20:55:04.407130+0000","last_clean":"2023-12-08T20:55:04.407130+0000","last_became_active":"2023-12-08T20:54:56.330346+0000","last_became_peered":"2023-12-08T20:54:56.330346+0000","last_unstale":"2023-12-08T20:55:04.407130+0000","last_undegraded":"2023-12-08T20:55:04.407130+0000","last_fullsized":"2023-12-08T20:55:04.407130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:43:36.950589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.306013+0000","last_change":"2023-12-08T20:54:54.927094+0000","last_active":"2023-12-08T20:55:04.306013+0000","last_peered":"2023-12-08T20:55:04.306013+0000","last_clean":"2023-12-08T20:55:04.306013+0000","last_became_active":"2023-12-08T20:54:54.926435+0000","last_became_peered":"2023-12-08T20:54:54.926435+0000","last_unstale":"2023-12-08T20:55:04.306013+0000","last_undegraded":"2023-12-08T20:55:04.306013+0000","last_fullsized":"2023-12-08T20:55:04.306013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.450954+0000","last_change":"2023-12-08T20:55:04.534630+0000","last_active":"2023-12-08T20:55:05.450954+0000","last_peered":"2023-12-08T20:55:05.450954+0000","last_clean":"2023-12-08T20:55:05.450954+0000","last_became_active":"2023-12-08T20:55:04.534289+0000","last_became_peered":"2023-12-08T20:55:04.534289+0000","last_unstale":"2023-12-08T20:55:05.450954+0000","last_undegraded":"2023-12-08T20:55:05.450954+0000","last_fullsized":"2023-12-08T20:55:05.450954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:36:33.771845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504120+0000","last_change":"2023-12-08T20:54:56.376691+0000","last_active":"2023-12-08T20:55:04.504120+0000","last_peered":"2023-12-08T20:55:04.504120+0000","last_clean":"2023-12-08T20:55:04.504120+0000","last_became_active":"2023-12-08T20:54:56.375922+0000","last_became_peered":"2023-12-08T20:54:56.375922+0000","last_unstale":"2023-12-08T20:55:04.504120+0000","last_undegraded":"2023-12-08T20:55:04.504120+0000","last_fullsized":"2023-12-08T20:55:04.504120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:37:56.593406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'10","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:15.154004+0000","last_change":"2023-12-08T20:54:54.978427+0000","last_active":"2023-12-08T20:55:15.154004+0000","last_peered":"2023-12-08T20:55:15.154004+0000","last_clean":"2023-12-08T20:55:15.154004+0000","last_became_active":"2023-12-08T20:54:54.977999+0000","last_became_peered":"2023-12-08T20:54:54.977999+0000","last_unstale":"2023-12-08T20:55:15.154004+0000","last_undegraded":"2023-12-08T20:55:15.154004+0000","last_fullsized":"2023-12-08T20:55:15.154004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.554268+0000","last_change":"2023-12-08T20:55:04.522691+0000","last_active":"2023-12-08T20:55:05.554268+0000","last_peered":"2023-12-08T20:55:05.554268+0000","last_clean":"2023-12-08T20:55:05.554268+0000","last_became_active":"2023-12-08T20:55:04.522190+0000","last_became_peered":"2023-12-08T20:55:04.522190+0000","last_unstale":"2023-12-08T20:55:05.554268+0000","last_undegraded":"2023-12-08T20:55:05.554268+0000","last_fullsized":"2023-12-08T20:55:05.554268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:52.945031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508584+0000","last_change":"2023-12-08T20:54:56.384439+0000","last_active":"2023-12-08T20:55:04.508584+0000","last_peered":"2023-12-08T20:55:04.508584+0000","last_clean":"2023-12-08T20:55:04.508584+0000","last_became_active":"2023-12-08T20:54:56.383561+0000","last_became_peered":"2023-12-08T20:54:56.383561+0000","last_unstale":"2023-12-08T20:55:04.508584+0000","last_undegraded":"2023-12-08T20:55:04.508584+0000","last_fullsized":"2023-12-08T20:55:04.508584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:01.328480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.307220+0000","last_change":"2023-12-08T20:54:54.980625+0000","last_active":"2023-12-08T20:55:04.307220+0000","last_peered":"2023-12-08T20:55:04.307220+0000","last_clean":"2023-12-08T20:55:04.307220+0000","last_became_active":"2023-12-08T20:54:54.980023+0000","last_became_peered":"2023-12-08T20:54:54.980023+0000","last_unstale":"2023-12-08T20:55:04.307220+0000","last_undegraded":"2023-12-08T20:55:04.307220+0000","last_fullsized":"2023-12-08T20:55:04.307220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:44:27.401600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.492065+0000","last_change":"2023-12-08T20:55:04.523658+0000","last_active":"2023-12-08T20:55:05.492065+0000","last_peered":"2023-12-08T20:55:05.492065+0000","last_clean":"2023-12-08T20:55:05.492065+0000","last_became_active":"2023-12-08T20:55:04.522325+0000","last_became_peered":"2023-12-08T20:55:04.522325+0000","last_unstale":"2023-12-08T20:55:05.492065+0000","last_undegraded":"2023-12-08T20:55:05.492065+0000","last_fullsized":"2023-12-08T20:55:05.492065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:32:03.125815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540898+0000","last_change":"2023-12-08T20:54:56.410075+0000","last_active":"2023-12-08T20:55:04.540898+0000","last_peered":"2023-12-08T20:55:04.540898+0000","last_clean":"2023-12-08T20:55:04.540898+0000","last_became_active":"2023-12-08T20:54:56.409539+0000","last_became_peered":"2023-12-08T20:54:56.409539+0000","last_unstale":"2023-12-08T20:55:04.540898+0000","last_undegraded":"2023-12-08T20:55:04.540898+0000","last_fullsized":"2023-12-08T20:55:04.540898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:37:03.173965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504113+0000","last_change":"2023-12-08T20:54:54.936311+0000","last_active":"2023-12-08T20:55:04.504113+0000","last_peered":"2023-12-08T20:55:04.504113+0000","last_clean":"2023-12-08T20:55:04.504113+0000","last_became_active":"2023-12-08T20:54:54.935889+0000","last_became_peered":"2023-12-08T20:54:54.935889+0000","last_unstale":"2023-12-08T20:55:04.504113+0000","last_undegraded":"2023-12-08T20:55:04.504113+0000","last_fullsized":"2023-12-08T20:55:04.504113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:13.785495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.414801+0000","last_change":"2023-12-08T20:55:04.519274+0000","last_active":"2023-12-08T20:55:05.414801+0000","last_peered":"2023-12-08T20:55:05.414801+0000","last_clean":"2023-12-08T20:55:05.414801+0000","last_became_active":"2023-12-08T20:55:04.518048+0000","last_became_peered":"2023-12-08T20:55:04.518048+0000","last_unstale":"2023-12-08T20:55:05.414801+0000","last_undegraded":"2023-12-08T20:55:05.414801+0000","last_fullsized":"2023-12-08T20:55:05.414801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:36:52.411600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499617+0000","last_change":"2023-12-08T20:54:56.376709+0000","last_active":"2023-12-08T20:55:04.499617+0000","last_peered":"2023-12-08T20:55:04.499617+0000","last_clean":"2023-12-08T20:55:04.499617+0000","last_became_active":"2023-12-08T20:54:56.369709+0000","last_became_peered":"2023-12-08T20:54:56.369709+0000","last_unstale":"2023-12-08T20:55:04.499617+0000","last_undegraded":"2023-12-08T20:55:04.499617+0000","last_fullsized":"2023-12-08T20:55:04.499617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456242+0000","last_change":"2023-12-08T20:54:54.980040+0000","last_active":"2023-12-08T20:55:04.456242+0000","last_peered":"2023-12-08T20:55:04.456242+0000","last_clean":"2023-12-08T20:55:04.456242+0000","last_became_active":"2023-12-08T20:54:54.979751+0000","last_became_peered":"2023-12-08T20:54:54.979751+0000","last_unstale":"2023-12-08T20:55:04.456242+0000","last_undegraded":"2023-12-08T20:55:04.456242+0000","last_fullsized":"2023-12-08T20:55:04.456242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:08.789175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553699+0000","last_change":"2023-12-08T20:55:04.513429+0000","last_active":"2023-12-08T20:55:05.553699+0000","last_peered":"2023-12-08T20:55:05.553699+0000","last_clean":"2023-12-08T20:55:05.553699+0000","last_became_active":"2023-12-08T20:55:04.511405+0000","last_became_peered":"2023-12-08T20:55:04.511405+0000","last_unstale":"2023-12-08T20:55:05.553699+0000","last_undegraded":"2023-12-08T20:55:05.553699+0000","last_fullsized":"2023-12-08T20:55:05.553699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:48:08.081679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553779+0000","last_change":"2023-12-08T20:55:04.537067+0000","last_active":"2023-12-08T20:55:05.553779+0000","last_peered":"2023-12-08T20:55:05.553779+0000","last_clean":"2023-12-08T20:55:05.553779+0000","last_became_active":"2023-12-08T20:55:04.536497+0000","last_became_peered":"2023-12-08T20:55:04.536497+0000","last_unstale":"2023-12-08T20:55:05.553779+0000","last_undegraded":"2023-12-08T20:55:05.553779+0000","last_fullsized":"2023-12-08T20:55:05.553779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:49.322641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360960+0000","last_change":"2023-12-08T20:54:56.318249+0000","last_active":"2023-12-08T20:55:04.360960+0000","last_peered":"2023-12-08T20:55:04.360960+0000","last_clean":"2023-12-08T20:55:04.360960+0000","last_became_active":"2023-12-08T20:54:56.317895+0000","last_became_peered":"2023-12-08T20:54:56.317895+0000","last_unstale":"2023-12-08T20:55:04.360960+0000","last_undegraded":"2023-12-08T20:55:04.360960+0000","last_fullsized":"2023-12-08T20:55:04.360960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:47:45.185235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507838+0000","last_change":"2023-12-08T20:54:54.935924+0000","last_active":"2023-12-08T20:55:04.507838+0000","last_peered":"2023-12-08T20:55:04.507838+0000","last_clean":"2023-12-08T20:55:04.507838+0000","last_became_active":"2023-12-08T20:54:54.935578+0000","last_became_peered":"2023-12-08T20:54:54.935578+0000","last_unstale":"2023-12-08T20:55:04.507838+0000","last_undegraded":"2023-12-08T20:55:04.507838+0000","last_fullsized":"2023-12-08T20:55:04.507838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:22.627774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.451614+0000","last_change":"2023-12-08T20:55:04.535940+0000","last_active":"2023-12-08T20:55:05.451614+0000","last_peered":"2023-12-08T20:55:05.451614+0000","last_clean":"2023-12-08T20:55:05.451614+0000","last_became_active":"2023-12-08T20:55:04.535525+0000","last_became_peered":"2023-12-08T20:55:04.535525+0000","last_unstale":"2023-12-08T20:55:05.451614+0000","last_undegraded":"2023-12-08T20:55:05.451614+0000","last_fullsized":"2023-12-08T20:55:05.451614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:30:14.451021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.513649+0000","last_change":"2023-12-08T20:54:56.413484+0000","last_active":"2023-12-08T20:55:04.513649+0000","last_peered":"2023-12-08T20:55:04.513649+0000","last_clean":"2023-12-08T20:55:04.513649+0000","last_became_active":"2023-12-08T20:54:56.412133+0000","last_became_peered":"2023-12-08T20:54:56.412133+0000","last_unstale":"2023-12-08T20:55:04.513649+0000","last_undegraded":"2023-12-08T20:55:04.513649+0000","last_fullsized":"2023-12-08T20:55:04.513649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:41:41.172811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.406565+0000","last_change":"2023-12-08T20:54:54.927237+0000","last_active":"2023-12-08T20:55:04.406565+0000","last_peered":"2023-12-08T20:55:04.406565+0000","last_clean":"2023-12-08T20:55:04.406565+0000","last_became_active":"2023-12-08T20:54:54.926804+0000","last_became_peered":"2023-12-08T20:54:54.926804+0000","last_unstale":"2023-12-08T20:55:04.406565+0000","last_undegraded":"2023-12-08T20:55:04.406565+0000","last_fullsized":"2023-12-08T20:55:04.406565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:30:21.341630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508451+0000","last_change":"2023-12-08T20:54:54.931212+0000","last_active":"2023-12-08T20:55:04.508451+0000","last_peered":"2023-12-08T20:55:04.508451+0000","last_clean":"2023-12-08T20:55:04.508451+0000","last_became_active":"2023-12-08T20:54:54.930324+0000","last_became_peered":"2023-12-08T20:54:54.930324+0000","last_unstale":"2023-12-08T20:55:04.508451+0000","last_undegraded":"2023-12-08T20:55:04.508451+0000","last_fullsized":"2023-12-08T20:55:04.508451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:54.461219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360041+0000","last_change":"2023-12-08T20:54:56.383879+0000","last_active":"2023-12-08T20:55:04.360041+0000","last_peered":"2023-12-08T20:55:04.360041+0000","last_clean":"2023-12-08T20:55:04.360041+0000","last_became_active":"2023-12-08T20:54:56.383467+0000","last_became_peered":"2023-12-08T20:54:56.383467+0000","last_unstale":"2023-12-08T20:55:04.360041+0000","last_undegraded":"2023-12-08T20:55:04.360041+0000","last_fullsized":"2023-12-08T20:55:04.360041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:59.236467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553946+0000","last_change":"2023-12-08T20:55:04.541743+0000","last_active":"2023-12-08T20:55:05.553946+0000","last_peered":"2023-12-08T20:55:05.553946+0000","last_clean":"2023-12-08T20:55:05.553946+0000","last_became_active":"2023-12-08T20:55:04.536537+0000","last_became_peered":"2023-12-08T20:55:04.536537+0000","last_unstale":"2023-12-08T20:55:05.553946+0000","last_undegraded":"2023-12-08T20:55:05.553946+0000","last_fullsized":"2023-12-08T20:55:05.553946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:45.443252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.532310+0000","last_change":"2023-12-08T20:54:54.925711+0000","last_active":"2023-12-08T20:55:04.532310+0000","last_peered":"2023-12-08T20:55:04.532310+0000","last_clean":"2023-12-08T20:55:04.532310+0000","last_became_active":"2023-12-08T20:54:54.925229+0000","last_became_peered":"2023-12-08T20:54:54.925229+0000","last_unstale":"2023-12-08T20:55:04.532310+0000","last_undegraded":"2023-12-08T20:55:04.532310+0000","last_fullsized":"2023-12-08T20:55:04.532310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:33:15.472131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456015+0000","last_change":"2023-12-08T20:54:56.404755+0000","last_active":"2023-12-08T20:55:04.456015+0000","last_peered":"2023-12-08T20:55:04.456015+0000","last_clean":"2023-12-08T20:55:04.456015+0000","last_became_active":"2023-12-08T20:54:56.403996+0000","last_became_peered":"2023-12-08T20:54:56.403996+0000","last_unstale":"2023-12-08T20:55:04.456015+0000","last_undegraded":"2023-12-08T20:55:04.456015+0000","last_fullsized":"2023-12-08T20:55:04.456015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.416387+0000","last_change":"2023-12-08T20:55:04.523477+0000","last_active":"2023-12-08T20:55:05.416387+0000","last_peered":"2023-12-08T20:55:05.416387+0000","last_clean":"2023-12-08T20:55:05.416387+0000","last_became_active":"2023-12-08T20:55:04.523137+0000","last_became_peered":"2023-12-08T20:55:04.523137+0000","last_unstale":"2023-12-08T20:55:05.416387+0000","last_undegraded":"2023-12-08T20:55:05.416387+0000","last_fullsized":"2023-12-08T20:55:05.416387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499296+0000","last_change":"2023-12-08T20:54:56.379055+0000","last_active":"2023-12-08T20:55:04.499296+0000","last_peered":"2023-12-08T20:55:04.499296+0000","last_clean":"2023-12-08T20:55:04.499296+0000","last_became_active":"2023-12-08T20:54:56.373080+0000","last_became_peered":"2023-12-08T20:54:56.373080+0000","last_unstale":"2023-12-08T20:55:04.499296+0000","last_undegraded":"2023-12-08T20:55:04.499296+0000","last_fullsized":"2023-12-08T20:55:04.499296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.305471+0000","last_change":"2023-12-08T20:54:56.378688+0000","last_active":"2023-12-08T20:55:04.305471+0000","last_peered":"2023-12-08T20:55:04.305471+0000","last_clean":"2023-12-08T20:55:04.305471+0000","last_became_active":"2023-12-08T20:54:56.378154+0000","last_became_peered":"2023-12-08T20:54:56.378154+0000","last_unstale":"2023-12-08T20:55:04.305471+0000","last_undegraded":"2023-12-08T20:55:04.305471+0000","last_fullsized":"2023-12-08T20:55:04.305471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:22:06.625769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508260+0000","last_change":"2023-12-08T20:54:56.410526+0000","last_active":"2023-12-08T20:55:04.508260+0000","last_peered":"2023-12-08T20:55:04.508260+0000","last_clean":"2023-12-08T20:55:04.508260+0000","last_became_active":"2023-12-08T20:54:56.409863+0000","last_became_peered":"2023-12-08T20:54:56.409863+0000","last_unstale":"2023-12-08T20:55:04.508260+0000","last_undegraded":"2023-12-08T20:55:04.508260+0000","last_fullsized":"2023-12-08T20:55:04.508260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:10.542611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.525819+0000","last_change":"2023-12-08T20:54:56.408750+0000","last_active":"2023-12-08T20:55:04.525819+0000","last_peered":"2023-12-08T20:55:04.525819+0000","last_clean":"2023-12-08T20:55:04.525819+0000","last_became_active":"2023-12-08T20:54:56.408205+0000","last_became_peered":"2023-12-08T20:54:56.408205+0000","last_unstale":"2023-12-08T20:55:04.525819+0000","last_undegraded":"2023-12-08T20:55:04.525819+0000","last_fullsized":"2023-12-08T20:55:04.525819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:55.750494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.413106+0000","last_change":"2023-12-08T20:54:56.386660+0000","last_active":"2023-12-08T20:55:04.413106+0000","last_peered":"2023-12-08T20:55:04.413106+0000","last_clean":"2023-12-08T20:55:04.413106+0000","last_became_active":"2023-12-08T20:54:56.386344+0000","last_became_peered":"2023-12-08T20:54:56.386344+0000","last_unstale":"2023-12-08T20:55:04.413106+0000","last_undegraded":"2023-12-08T20:55:04.413106+0000","last_fullsized":"2023-12-08T20:55:04.413106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:33:27.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.408612+0000","last_change":"2023-12-08T20:54:56.367640+0000","last_active":"2023-12-08T20:55:04.408612+0000","last_peered":"2023-12-08T20:55:04.408612+0000","last_clean":"2023-12-08T20:55:04.408612+0000","last_became_active":"2023-12-08T20:54:56.366967+0000","last_became_peered":"2023-12-08T20:54:56.366967+0000","last_unstale":"2023-12-08T20:55:04.408612+0000","last_undegraded":"2023-12-08T20:55:04.408612+0000","last_fullsized":"2023-12-08T20:55:04.408612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:22:24.171129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499446+0000","last_change":"2023-12-08T20:54:56.376663+0000","last_active":"2023-12-08T20:55:04.499446+0000","last_peered":"2023-12-08T20:55:04.499446+0000","last_clean":"2023-12-08T20:55:04.499446+0000","last_became_active":"2023-12-08T20:54:56.371954+0000","last_became_peered":"2023-12-08T20:54:56.371954+0000","last_unstale":"2023-12-08T20:55:04.499446+0000","last_undegraded":"2023-12-08T20:55:04.499446+0000","last_fullsized":"2023-12-08T20:55:04.499446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540616+0000","last_change":"2023-12-08T20:54:56.410398+0000","last_active":"2023-12-08T20:55:04.540616+0000","last_peered":"2023-12-08T20:55:04.540616+0000","last_clean":"2023-12-08T20:55:04.540616+0000","last_became_active":"2023-12-08T20:54:56.409462+0000","last_became_peered":"2023-12-08T20:54:56.409462+0000","last_unstale":"2023-12-08T20:55:04.540616+0000","last_undegraded":"2023-12-08T20:55:04.540616+0000","last_fullsized":"2023-12-08T20:55:04.540616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:07:04.340773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507752+0000","last_change":"2023-12-08T20:54:56.415800+0000","last_active":"2023-12-08T20:55:04.507752+0000","last_peered":"2023-12-08T20:55:04.507752+0000","last_clean":"2023-12-08T20:55:04.507752+0000","last_became_active":"2023-12-08T20:54:56.415176+0000","last_became_peered":"2023-12-08T20:54:56.415176+0000","last_unstale":"2023-12-08T20:55:04.507752+0000","last_undegraded":"2023-12-08T20:55:04.507752+0000","last_fullsized":"2023-12-08T20:55:04.507752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:24:27.173941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.524613+0000","last_change":"2023-12-08T20:54:56.401521+0000","last_active":"2023-12-08T20:55:04.524613+0000","last_peered":"2023-12-08T20:55:04.524613+0000","last_clean":"2023-12-08T20:55:04.524613+0000","last_became_active":"2023-12-08T20:54:56.400980+0000","last_became_peered":"2023-12-08T20:54:56.400980+0000","last_unstale":"2023-12-08T20:55:04.524613+0000","last_undegraded":"2023-12-08T20:55:04.524613+0000","last_fullsized":"2023-12-08T20:55:04.524613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:42.093754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.455672+0000","last_change":"2023-12-08T20:54:56.387218+0000","last_active":"2023-12-08T20:55:04.455672+0000","last_peered":"2023-12-08T20:55:04.455672+0000","last_clean":"2023-12-08T20:55:04.455672+0000","last_became_active":"2023-12-08T20:54:56.386413+0000","last_became_peered":"2023-12-08T20:54:56.386413+0000","last_unstale":"2023-12-08T20:55:04.455672+0000","last_undegraded":"2023-12-08T20:55:04.455672+0000","last_fullsized":"2023-12-08T20:55:04.455672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.359808+0000","last_change":"2023-12-08T20:54:56.371962+0000","last_active":"2023-12-08T20:55:04.359808+0000","last_peered":"2023-12-08T20:55:04.359808+0000","last_clean":"2023-12-08T20:55:04.359808+0000","last_became_active":"2023-12-08T20:54:56.371456+0000","last_became_peered":"2023-12-08T20:54:56.371456+0000","last_unstale":"2023-12-08T20:55:04.359808+0000","last_undegraded":"2023-12-08T20:55:04.359808+0000","last_fullsized":"2023-12-08T20:55:04.359808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:01.725223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.505002+0000","last_change":"2023-12-08T20:54:56.381311+0000","last_active":"2023-12-08T20:55:04.505002+0000","last_peered":"2023-12-08T20:55:04.505002+0000","last_clean":"2023-12-08T20:55:04.505002+0000","last_became_active":"2023-12-08T20:54:56.380860+0000","last_became_peered":"2023-12-08T20:54:56.380860+0000","last_unstale":"2023-12-08T20:55:04.505002+0000","last_undegraded":"2023-12-08T20:55:04.505002+0000","last_fullsized":"2023-12-08T20:55:04.505002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:11:11.173329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508899+0000","last_change":"2023-12-08T20:54:56.261370+0000","last_active":"2023-12-08T20:55:04.508899+0000","last_peered":"2023-12-08T20:55:04.508899+0000","last_clean":"2023-12-08T20:55:04.508899+0000","last_became_active":"2023-12-08T20:54:56.260387+0000","last_became_peered":"2023-12-08T20:54:56.260387+0000","last_unstale":"2023-12-08T20:55:04.508899+0000","last_undegraded":"2023-12-08T20:55:04.508899+0000","last_fullsized":"2023-12-08T20:55:04.508899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:17:07.046357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.306216+0000","last_change":"2023-12-08T20:54:56.388280+0000","last_active":"2023-12-08T20:55:04.306216+0000","last_peered":"2023-12-08T20:55:04.306216+0000","last_clean":"2023-12-08T20:55:04.306216+0000","last_became_active":"2023-12-08T20:54:56.387774+0000","last_became_peered":"2023-12-08T20:54:56.387774+0000","last_unstale":"2023-12-08T20:55:04.306216+0000","last_undegraded":"2023-12-08T20:55:04.306216+0000","last_fullsized":"2023-12-08T20:55:04.306216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:15:20.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.509158+0000","last_change":"2023-12-08T20:54:56.378804+0000","last_active":"2023-12-08T20:55:04.509158+0000","last_peered":"2023-12-08T20:55:04.509158+0000","last_clean":"2023-12-08T20:55:04.509158+0000","last_became_active":"2023-12-08T20:54:56.377029+0000","last_became_peered":"2023-12-08T20:54:56.377029+0000","last_unstale":"2023-12-08T20:55:04.509158+0000","last_undegraded":"2023-12-08T20:55:04.509158+0000","last_fullsized":"2023-12-08T20:55:04.509158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:55:29.247824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507664+0000","last_change":"2023-12-08T20:54:56.372118+0000","last_active":"2023-12-08T20:55:04.507664+0000","last_peered":"2023-12-08T20:55:04.507664+0000","last_clean":"2023-12-08T20:55:04.507664+0000","last_became_active":"2023-12-08T20:54:56.370707+0000","last_became_peered":"2023-12-08T20:54:56.370707+0000","last_unstale":"2023-12-08T20:55:04.507664+0000","last_undegraded":"2023-12-08T20:55:04.507664+0000","last_fullsized":"2023-12-08T20:55:04.507664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:35.994091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.524392+0000","last_change":"2023-12-08T20:54:56.405033+0000","last_active":"2023-12-08T20:55:04.524392+0000","last_peered":"2023-12-08T20:55:04.524392+0000","last_clean":"2023-12-08T20:55:04.524392+0000","last_became_active":"2023-12-08T20:54:56.401544+0000","last_became_peered":"2023-12-08T20:54:56.401544+0000","last_unstale":"2023-12-08T20:55:04.524392+0000","last_undegraded":"2023-12-08T20:55:04.524392+0000","last_fullsized":"2023-12-08T20:55:04.524392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:59.303019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.406433+0000","last_change":"2023-12-08T20:54:56.366037+0000","last_active":"2023-12-08T20:55:04.406433+0000","last_peered":"2023-12-08T20:55:04.406433+0000","last_clean":"2023-12-08T20:55:04.406433+0000","last_became_active":"2023-12-08T20:54:56.365432+0000","last_became_peered":"2023-12-08T20:54:56.365432+0000","last_unstale":"2023-12-08T20:55:04.406433+0000","last_undegraded":"2023-12-08T20:55:04.406433+0000","last_fullsized":"2023-12-08T20:55:04.406433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:48:49.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.407208+0000","last_change":"2023-12-08T20:54:56.393022+0000","last_active":"2023-12-08T20:55:04.407208+0000","last_peered":"2023-12-08T20:55:04.407208+0000","last_clean":"2023-12-08T20:55:04.407208+0000","last_became_active":"2023-12-08T20:54:56.392408+0000","last_became_peered":"2023-12-08T20:54:56.392408+0000","last_unstale":"2023-12-08T20:55:04.407208+0000","last_undegraded":"2023-12-08T20:55:04.407208+0000","last_fullsized":"2023-12-08T20:55:04.407208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:30:22.435898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504911+0000","last_change":"2023-12-08T20:54:56.380654+0000","last_active":"2023-12-08T20:55:04.504911+0000","last_peered":"2023-12-08T20:55:04.504911+0000","last_clean":"2023-12-08T20:55:04.504911+0000","last_became_active":"2023-12-08T20:54:56.380137+0000","last_became_peered":"2023-12-08T20:54:56.380137+0000","last_unstale":"2023-12-08T20:55:04.504911+0000","last_undegraded":"2023-12-08T20:55:04.504911+0000","last_fullsized":"2023-12-08T20:55:04.504911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:47:59.833913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504032+0000","last_change":"2023-12-08T20:54:56.392997+0000","last_active":"2023-12-08T20:55:04.504032+0000","last_peered":"2023-12-08T20:55:04.504032+0000","last_clean":"2023-12-08T20:55:04.504032+0000","last_became_active":"2023-12-08T20:54:56.391299+0000","last_became_peered":"2023-12-08T20:54:56.391299+0000","last_unstale":"2023-12-08T20:55:04.504032+0000","last_undegraded":"2023-12-08T20:55:04.504032+0000","last_fullsized":"2023-12-08T20:55:04.504032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:37.195485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503945+0000","last_change":"2023-12-08T20:54:56.393461+0000","last_active":"2023-12-08T20:55:04.503945+0000","last_peered":"2023-12-08T20:55:04.503945+0000","last_clean":"2023-12-08T20:55:04.503945+0000","last_became_active":"2023-12-08T20:54:56.392708+0000","last_became_peered":"2023-12-08T20:54:56.392708+0000","last_unstale":"2023-12-08T20:55:04.503945+0000","last_undegraded":"2023-12-08T20:55:04.503945+0000","last_fullsized":"2023-12-08T20:55:04.503945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:44.697264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456232+0000","last_change":"2023-12-08T20:54:56.319183+0000","last_active":"2023-12-08T20:55:04.456232+0000","last_peered":"2023-12-08T20:55:04.456232+0000","last_clean":"2023-12-08T20:55:04.456232+0000","last_became_active":"2023-12-08T20:54:56.318400+0000","last_became_peered":"2023-12-08T20:54:56.318400+0000","last_unstale":"2023-12-08T20:55:04.456232+0000","last_undegraded":"2023-12-08T20:55:04.456232+0000","last_fullsized":"2023-12-08T20:55:04.456232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.512685+0000","last_change":"2023-12-08T20:54:56.414028+0000","last_active":"2023-12-08T20:55:04.512685+0000","last_peered":"2023-12-08T20:55:04.512685+0000","last_clean":"2023-12-08T20:55:04.512685+0000","last_became_active":"2023-12-08T20:54:56.413220+0000","last_became_peered":"2023-12-08T20:54:56.413220+0000","last_unstale":"2023-12-08T20:55:04.512685+0000","last_undegraded":"2023-12-08T20:55:04.512685+0000","last_fullsized":"2023-12-08T20:55:04.512685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:23.917049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504035+0000","last_change":"2023-12-08T20:54:56.366203+0000","last_active":"2023-12-08T20:55:04.504035+0000","last_peered":"2023-12-08T20:55:04.504035+0000","last_clean":"2023-12-08T20:55:04.504035+0000","last_became_active":"2023-12-08T20:54:56.365448+0000","last_became_peered":"2023-12-08T20:54:56.365448+0000","last_unstale":"2023-12-08T20:55:04.504035+0000","last_undegraded":"2023-12-08T20:55:04.504035+0000","last_fullsized":"2023-12-08T20:55:04.504035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:10.405742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499135+0000","last_change":"2023-12-08T20:54:56.373847+0000","last_active":"2023-12-08T20:55:04.499135+0000","last_peered":"2023-12-08T20:55:04.499135+0000","last_clean":"2023-12-08T20:55:04.499135+0000","last_became_active":"2023-12-08T20:54:56.369574+0000","last_became_peered":"2023-12-08T20:54:56.369574+0000","last_unstale":"2023-12-08T20:55:04.499135+0000","last_undegraded":"2023-12-08T20:55:04.499135+0000","last_fullsized":"2023-12-08T20:55:04.499135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:10.078450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503926+0000","last_change":"2023-12-08T20:54:56.411972+0000","last_active":"2023-12-08T20:55:04.503926+0000","last_peered":"2023-12-08T20:55:04.503926+0000","last_clean":"2023-12-08T20:55:04.503926+0000","last_became_active":"2023-12-08T20:54:56.411339+0000","last_became_peered":"2023-12-08T20:54:56.411339+0000","last_unstale":"2023-12-08T20:55:04.503926+0000","last_undegraded":"2023-12-08T20:55:04.503926+0000","last_fullsized":"2023-12-08T20:55:04.503926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:41.074875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499247+0000","last_change":"2023-12-08T20:54:56.370763+0000","last_active":"2023-12-08T20:55:04.499247+0000","last_peered":"2023-12-08T20:55:04.499247+0000","last_clean":"2023-12-08T20:55:04.499247+0000","last_became_active":"2023-12-08T20:54:56.369650+0000","last_became_peered":"2023-12-08T20:54:56.369650+0000","last_unstale":"2023-12-08T20:55:04.499247+0000","last_undegraded":"2023-12-08T20:55:04.499247+0000","last_fullsized":"2023-12-08T20:55:04.499247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540578+0000","last_change":"2023-12-08T20:54:56.409124+0000","last_active":"2023-12-08T20:55:04.540578+0000","last_peered":"2023-12-08T20:55:04.540578+0000","last_clean":"2023-12-08T20:55:04.540578+0000","last_became_active":"2023-12-08T20:54:56.408861+0000","last_became_peered":"2023-12-08T20:54:56.408861+0000","last_unstale":"2023-12-08T20:55:04.540578+0000","last_undegraded":"2023-12-08T20:55:04.540578+0000","last_fullsized":"2023-12-08T20:55:04.540578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:40:00.277639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.541600+0000","last_change":"2023-12-08T20:54:56.407010+0000","last_active":"2023-12-08T20:55:04.541600+0000","last_peered":"2023-12-08T20:55:04.541600+0000","last_clean":"2023-12-08T20:55:04.541600+0000","last_became_active":"2023-12-08T20:54:56.404697+0000","last_became_peered":"2023-12-08T20:54:56.404697+0000","last_unstale":"2023-12-08T20:55:04.541600+0000","last_undegraded":"2023-12-08T20:55:04.541600+0000","last_fullsized":"2023-12-08T20:55:04.541600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:58:49.474462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504231+0000","last_change":"2023-12-08T20:54:56.378873+0000","last_active":"2023-12-08T20:55:04.504231+0000","last_peered":"2023-12-08T20:55:04.504231+0000","last_clean":"2023-12-08T20:55:04.504231+0000","last_became_active":"2023-12-08T20:54:56.377835+0000","last_became_peered":"2023-12-08T20:54:56.377835+0000","last_unstale":"2023-12-08T20:55:04.504231+0000","last_undegraded":"2023-12-08T20:55:04.504231+0000","last_fullsized":"2023-12-08T20:55:04.504231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:54:57.439693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":708223,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.0509999999999999}]},{"osd":1,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.92700000000000005}]},{"osd":3,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.097}]},{"osd":4,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.127}]},{"osd":6,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.226},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.1639999999999999}]},{"osd":7,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.256},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.284}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":118345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.92600000000000005}]},{"osd":4,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.83499999999999996}]},{"osd":5,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.0720000000000001}]},{"osd":6,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.004},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.1990000000000001}]},{"osd":7,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.139},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.96899999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":121602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.28000000000000003}]},{"osd":1,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.87}]},{"osd":6,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.048}]},{"osd":7,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.69799999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":364544,"data_stored":708201,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.79900000000000004}]},{"osd":4,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.107}]},{"osd":5,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.083}]},{"osd":6,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.151}]},{"osd":7,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.169}]}]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":303104,"data_stored":117819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.497}]},{"osd":4,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.73799999999999999}]},{"osd":5,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.0409999999999999}]},{"osd":7,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.78100000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":117887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.875}]},{"osd":3,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Dec 8 20:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.998}]},{"osd":5,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.135},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2549999999999999}]},{"osd":6,"last update":"Fri Dec 8 20:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.431}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":117763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.93400000000000005}]},{"osd":1,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.0620000000000001}]},{"osd":2,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.1519999999999999}]},{"osd":3,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1}]},{"osd":4,"last update":"Fri Dec 8 20:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.258}]},{"osd":5,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.347},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.2210000000000001}]},{"osd":7,"last update":"Fri Dec 8 20:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.3080000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":122274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.71799999999999997}]},{"osd":1,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.753},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.0469999999999999}]},{"osd":6,"last update":"Fri Dec 8 20:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Dec 8 20:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.99199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T20:55:49.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T20:55:49.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.266+0000 7faa212b7640 1 Processor -- start 2023-12-08T20:55:49.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.270+0000 7faa212b7640 1 -- start start 2023-12-08T20:55:49.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.270+0000 7faa212b7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faa1c1518f0 0x7faa1c06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:49.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.270+0000 7faa212b7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa1c0c94b0 0x7faa1c06aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:49.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.270+0000 7faa212b7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c0c6c00 con 0x7faa1c0c7090 2023-12-08T20:55:49.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.270+0000 7faa212b7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c0c3920 con 0x7faa1c1518f0 2023-12-08T20:55:49.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.270+0000 7faa212b7640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c0c41b0 con 0x7faa1c0c94b0 2023-12-08T20:55:49.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.270+0000 7faa1a7fc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa1c0c94b0 0x7faa1c06aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:49.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.270+0000 7faa1a7fc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa1c0c94b0 0x7faa1c06aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:40428/0 (socket says 172.21.15.53:40428) 2023-12-08T20:55:49.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.270+0000 7faa1a7fc640 1 -- 172.21.15.53:0/3430536458 learned_addr learned my addr 172.21.15.53:0/3430536458 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:49.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.278+0000 7faa1a7fc640 1 -- 172.21.15.53:0/3430536458 >> v2:172.21.15.53:3300/0 conn(0x7faa1c1518f0 msgr2=0x7faa1c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:49.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.278+0000 7faa1a7fc640 1 --2- 172.21.15.53:0/3430536458 >> v2:172.21.15.53:3300/0 conn(0x7faa1c1518f0 0x7faa1c06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.278+0000 7faa1a7fc640 1 -- 172.21.15.53:0/3430536458 >> v1:172.21.15.53:6789/0 conn(0x7faa1c0c7090 legacy=0x7faa1c0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:49.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.278+0000 7faa1a7fc640 1 -- 172.21.15.53:0/3430536458 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c151cd0 con 0x7faa1c0c94b0 2023-12-08T20:55:49.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.282+0000 7faa1a7fc640 1 --2- 172.21.15.53:0/3430536458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1c0c94b0 0x7faa1c06aaf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faa1c061a10 tx=0x7faa0401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb7ec4cb915cd96e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.298+0000 7faa19ffb640 1 -- 172.21.15.53:0/3430536458 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa040a7070 con 0x7faa1c0c94b0 2023-12-08T20:55:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.298+0000 7faa19ffb640 1 -- 172.21.15.53:0/3430536458 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa040ab430 con 0x7faa1c0c94b0 2023-12-08T20:55:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.298+0000 7faa19ffb640 1 -- 172.21.15.53:0/3430536458 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa040ab7c0 con 0x7faa1c0c94b0 2023-12-08T20:55:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.298+0000 7faa212b7640 1 -- 172.21.15.53:0/3430536458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1c0c94b0 msgr2=0x7faa1c06aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.298+0000 7faa212b7640 1 --2- 172.21.15.53:0/3430536458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1c0c94b0 0x7faa1c06aaf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faa1c061a10 tx=0x7faa0401c430 comp rx=0 tx=0).stop 2023-12-08T20:55:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 -- 172.21.15.53:0/3430536458 shutdown_connections 2023-12-08T20:55:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 --2- 172.21.15.53:0/3430536458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1c0c94b0 0x7faa1c06aaf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 --2- 172.21.15.53:0/3430536458 >> v2:172.21.15.53:3300/0 conn(0x7faa1c1518f0 0x7faa1c06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 -- 172.21.15.53:0/3430536458 >> 172.21.15.53:0/3430536458 conn(0x7faa1c0c8990 msgr2=0x7faa1c0c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 -- 172.21.15.53:0/3430536458 shutdown_connections 2023-12-08T20:55:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 -- 172.21.15.53:0/3430536458 wait complete. 2023-12-08T20:55:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 Processor -- start 2023-12-08T20:55:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 -- start start 2023-12-08T20:55:49.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c0c7090 0x7faa1c156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:49.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1c0c94b0 0x7faa1c1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:49.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa1c1518f0 0x7faa1c1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:49.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c15ac30 con 0x7faa1c0c7090 2023-12-08T20:55:49.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c15a970 con 0x7faa1c0c94b0 2023-12-08T20:55:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.302+0000 7faa212b7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c1552d0 con 0x7faa1c1518f0 2023-12-08T20:55:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.306+0000 7faa1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c0c7090 0x7faa1c156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.306+0000 7faa1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c0c7090 0x7faa1c156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56740/0 (socket says 172.21.15.53:56740) 2023-12-08T20:55:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.306+0000 7faa1affd640 1 -- 172.21.15.53:0/2871700025 learned_addr learned my addr 172.21.15.53:0/2871700025 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:49.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.310+0000 7faa1a7fc640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1c0c94b0 0x7faa1c1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:49.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.314+0000 7faa1b7fe640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa1c1518f0 0x7faa1c1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:49.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.314+0000 7faa1affd640 1 -- 172.21.15.53:0/2871700025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa1c1518f0 msgr2=0x7faa1c1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:49.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.314+0000 7faa1affd640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa1c1518f0 0x7faa1c1571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.314+0000 7faa1affd640 1 -- 172.21.15.53:0/2871700025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1c0c94b0 msgr2=0x7faa1c1565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:49.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.314+0000 7faa1affd640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1c0c94b0 0x7faa1c1565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.314+0000 7faa1affd640 1 -- 172.21.15.53:0/2871700025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa040094d0 con 0x7faa1c0c7090 2023-12-08T20:55:49.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.322+0000 7faa1affd640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c0c7090 0x7faa1c156090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00ba50 tx=0x7faa0c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:49.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.338+0000 7faa137fe640 1 -- 172.21.15.53:0/2871700025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00cbe0 con 0x7faa1c0c7090 2023-12-08T20:55:49.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.338+0000 7faa137fe640 1 -- 172.21.15.53:0/2871700025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c00cd60 con 0x7faa1c0c7090 2023-12-08T20:55:49.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.338+0000 7faa137fe640 1 -- 172.21.15.53:0/2871700025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c014680 con 0x7faa1c0c7090 2023-12-08T20:55:49.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.338+0000 7faa212b7640 1 -- 172.21.15.53:0/2871700025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c1555b0 con 0x7faa1c0c7090 2023-12-08T20:55:49.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.338+0000 7faa212b7640 1 -- 172.21.15.53:0/2871700025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c155b70 con 0x7faa1c0c7090 2023-12-08T20:55:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.338+0000 7faa212b7640 1 -- 172.21.15.53:0/2871700025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c06c650 con 0x7faa1c0c7090 2023-12-08T20:55:49.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.754+0000 7faa137fe640 1 -- 172.21.15.53:0/2871700025 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa0c007370 con 0x7faa1c0c7090 2023-12-08T20:55:49.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.754+0000 7faa137fe640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa9fc0664f0 0x7fa9fc0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:49.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.758+0000 7faa1a7fc640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa9fc0664f0 0x7fa9fc0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:49.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.758+0000 7faa1a7fc640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa9fc0664f0 0x7fa9fc0689b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa040af000 tx=0x7faa04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:49.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.774+0000 7faa137fe640 1 -- 172.21.15.53:0/2871700025 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa0c055e10 con 0x7faa1c0c7090 2023-12-08T20:55:49.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.774+0000 7faa137fe640 1 -- 172.21.15.53:0/2871700025 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa0c051a50 con 0x7faa1c0c7090 2023-12-08T20:55:49.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.974+0000 7faa212b7640 1 -- 172.21.15.53:0/2871700025 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa1c06ec30 con 0x7fa9fc0664f0 2023-12-08T20:55:49.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.990+0000 7faa137fe640 1 -- 172.21.15.53:0/2871700025 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368843 (secure 0 0 0) 0x7faa040bb090 con 0x7fa9fc0664f0 2023-12-08T20:55:49.992 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:49.994 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-12-08T20:55:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.994+0000 7faa212b7640 1 -- 172.21.15.53:0/2871700025 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa9fc0664f0 msgr2=0x7fa9fc0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.994+0000 7faa212b7640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa9fc0664f0 0x7fa9fc0689b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa040af000 tx=0x7faa04008040 comp rx=0 tx=0).stop 2023-12-08T20:55:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.994+0000 7faa212b7640 1 -- 172.21.15.53:0/2871700025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c0c7090 msgr2=0x7faa1c156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.994+0000 7faa212b7640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c0c7090 0x7faa1c156090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00ba50 tx=0x7faa0c00bf10 comp rx=0 tx=0).stop 2023-12-08T20:55:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.994+0000 7faa212b7640 1 -- 172.21.15.53:0/2871700025 shutdown_connections 2023-12-08T20:55:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.994+0000 7faa212b7640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa9fc0664f0 0x7fa9fc0689b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.994+0000 7faa212b7640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa1c1518f0 0x7faa1c1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.994+0000 7faa212b7640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1c0c94b0 0x7faa1c1565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.994+0000 7faa212b7640 1 --2- 172.21.15.53:0/2871700025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c0c7090 0x7faa1c156090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.994+0000 7faa212b7640 1 -- 172.21.15.53:0/2871700025 >> 172.21.15.53:0/2871700025 conn(0x7faa1c0c8990 msgr2=0x7faa1c14fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.994+0000 7faa212b7640 1 -- 172.21.15.53:0/2871700025 shutdown_connections 2023-12-08T20:55:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:49.994+0000 7faa212b7640 1 -- 172.21.15.53:0/2871700025 wait complete. 2023-12-08T20:55:50.012 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-12-08T20:55:49.246285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235312,"kb_used_data":2496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739408,"statfs":{"total":773094113280,"available":772853153792,"internally_reserved":0,"allocated":2555904,"data_stored":2132114,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004330"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360564+0000","last_change":"2023-12-08T20:54:54.983255+0000","last_active":"2023-12-08T20:55:04.360564+0000","last_peered":"2023-12-08T20:55:04.360564+0000","last_clean":"2023-12-08T20:55:04.360564+0000","last_became_active":"2023-12-08T20:54:54.982479+0000","last_became_peered":"2023-12-08T20:54:54.982479+0000","last_unstale":"2023-12-08T20:55:04.360564+0000","last_undegraded":"2023-12-08T20:55:04.360564+0000","last_fullsized":"2023-12-08T20:55:04.360564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:17:36.784429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.542062+0000","last_change":"2023-12-08T20:54:56.407614+0000","last_active":"2023-12-08T20:55:04.542062+0000","last_peered":"2023-12-08T20:55:04.542062+0000","last_clean":"2023-12-08T20:55:04.542062+0000","last_became_active":"2023-12-08T20:54:56.406245+0000","last_became_peered":"2023-12-08T20:54:56.406245+0000","last_unstale":"2023-12-08T20:55:04.542062+0000","last_undegraded":"2023-12-08T20:55:04.542062+0000","last_fullsized":"2023-12-08T20:55:04.542062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:29.997818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.414972+0000","last_change":"2023-12-08T20:55:04.459400+0000","last_active":"2023-12-08T20:55:05.414972+0000","last_peered":"2023-12-08T20:55:05.414972+0000","last_clean":"2023-12-08T20:55:05.414972+0000","last_became_active":"2023-12-08T20:55:04.458087+0000","last_became_peered":"2023-12-08T20:55:04.458087+0000","last_unstale":"2023-12-08T20:55:05.414972+0000","last_undegraded":"2023-12-08T20:55:05.414972+0000","last_fullsized":"2023-12-08T20:55:05.414972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:23.378911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.542369+0000","last_change":"2023-12-08T20:54:54.929925+0000","last_active":"2023-12-08T20:55:04.542369+0000","last_peered":"2023-12-08T20:55:04.542369+0000","last_clean":"2023-12-08T20:55:04.542369+0000","last_became_active":"2023-12-08T20:54:54.929391+0000","last_became_peered":"2023-12-08T20:54:54.929391+0000","last_unstale":"2023-12-08T20:55:04.542369+0000","last_undegraded":"2023-12-08T20:55:04.542369+0000","last_fullsized":"2023-12-08T20:55:04.542369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:15:29.148520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540789+0000","last_change":"2023-12-08T20:54:56.409201+0000","last_active":"2023-12-08T20:55:04.540789+0000","last_peered":"2023-12-08T20:55:04.540789+0000","last_clean":"2023-12-08T20:55:04.540789+0000","last_became_active":"2023-12-08T20:54:56.408361+0000","last_became_peered":"2023-12-08T20:54:56.408361+0000","last_unstale":"2023-12-08T20:55:04.540789+0000","last_undegraded":"2023-12-08T20:55:04.540789+0000","last_fullsized":"2023-12-08T20:55:04.540789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:43:42.044530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491431+0000","last_change":"2023-12-08T20:55:04.529086+0000","last_active":"2023-12-08T20:55:05.491431+0000","last_peered":"2023-12-08T20:55:05.491431+0000","last_clean":"2023-12-08T20:55:05.491431+0000","last_became_active":"2023-12-08T20:55:04.528732+0000","last_became_peered":"2023-12-08T20:55:04.528732+0000","last_unstale":"2023-12-08T20:55:05.491431+0000","last_undegraded":"2023-12-08T20:55:05.491431+0000","last_fullsized":"2023-12-08T20:55:05.491431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:09:07.484233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504210+0000","last_change":"2023-12-08T20:54:54.935973+0000","last_active":"2023-12-08T20:55:04.504210+0000","last_peered":"2023-12-08T20:55:04.504210+0000","last_clean":"2023-12-08T20:55:04.504210+0000","last_became_active":"2023-12-08T20:54:54.935620+0000","last_became_peered":"2023-12-08T20:54:54.935620+0000","last_unstale":"2023-12-08T20:55:04.504210+0000","last_undegraded":"2023-12-08T20:55:04.504210+0000","last_fullsized":"2023-12-08T20:55:04.504210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:57.947192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456300+0000","last_change":"2023-12-08T20:54:56.382016+0000","last_active":"2023-12-08T20:55:04.456300+0000","last_peered":"2023-12-08T20:55:04.456300+0000","last_clean":"2023-12-08T20:55:04.456300+0000","last_became_active":"2023-12-08T20:54:56.380927+0000","last_became_peered":"2023-12-08T20:54:56.380927+0000","last_unstale":"2023-12-08T20:55:04.456300+0000","last_undegraded":"2023-12-08T20:55:04.456300+0000","last_fullsized":"2023-12-08T20:55:04.456300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491749+0000","last_change":"2023-12-08T20:55:04.527024+0000","last_active":"2023-12-08T20:55:05.491749+0000","last_peered":"2023-12-08T20:55:05.491749+0000","last_clean":"2023-12-08T20:55:05.491749+0000","last_became_active":"2023-12-08T20:55:04.526605+0000","last_became_peered":"2023-12-08T20:55:04.526605+0000","last_unstale":"2023-12-08T20:55:05.491749+0000","last_undegraded":"2023-12-08T20:55:05.491749+0000","last_fullsized":"2023-12-08T20:55:05.491749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:15.471006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.505308+0000","last_change":"2023-12-08T20:54:54.929388+0000","last_active":"2023-12-08T20:55:04.505308+0000","last_peered":"2023-12-08T20:55:04.505308+0000","last_clean":"2023-12-08T20:55:04.505308+0000","last_became_active":"2023-12-08T20:54:54.926132+0000","last_became_peered":"2023-12-08T20:54:54.926132+0000","last_unstale":"2023-12-08T20:55:04.505308+0000","last_undegraded":"2023-12-08T20:55:04.505308+0000","last_fullsized":"2023-12-08T20:55:04.505308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:00.435948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508722+0000","last_change":"2023-12-08T20:54:56.388306+0000","last_active":"2023-12-08T20:55:04.508722+0000","last_peered":"2023-12-08T20:55:04.508722+0000","last_clean":"2023-12-08T20:55:04.508722+0000","last_became_active":"2023-12-08T20:54:56.387528+0000","last_became_peered":"2023-12-08T20:54:56.387528+0000","last_unstale":"2023-12-08T20:55:04.508722+0000","last_undegraded":"2023-12-08T20:55:04.508722+0000","last_fullsized":"2023-12-08T20:55:04.508722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:22.236935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491559+0000","last_change":"2023-12-08T20:55:04.523251+0000","last_active":"2023-12-08T20:55:05.491559+0000","last_peered":"2023-12-08T20:55:05.491559+0000","last_clean":"2023-12-08T20:55:05.491559+0000","last_became_active":"2023-12-08T20:55:04.522777+0000","last_became_peered":"2023-12-08T20:55:04.522777+0000","last_unstale":"2023-12-08T20:55:05.491559+0000","last_undegraded":"2023-12-08T20:55:05.491559+0000","last_fullsized":"2023-12-08T20:55:05.491559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:09.972989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508344+0000","last_change":"2023-12-08T20:54:56.319638+0000","last_active":"2023-12-08T20:55:04.508344+0000","last_peered":"2023-12-08T20:55:04.508344+0000","last_clean":"2023-12-08T20:55:04.508344+0000","last_became_active":"2023-12-08T20:54:56.318855+0000","last_became_peered":"2023-12-08T20:54:56.318855+0000","last_unstale":"2023-12-08T20:55:04.508344+0000","last_undegraded":"2023-12-08T20:55:04.508344+0000","last_fullsized":"2023-12-08T20:55:04.508344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:27.151902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508472+0000","last_change":"2023-12-08T20:54:54.929584+0000","last_active":"2023-12-08T20:55:04.508472+0000","last_peered":"2023-12-08T20:55:04.508472+0000","last_clean":"2023-12-08T20:55:04.508472+0000","last_became_active":"2023-12-08T20:54:54.928702+0000","last_became_peered":"2023-12-08T20:54:54.928702+0000","last_unstale":"2023-12-08T20:55:04.508472+0000","last_undegraded":"2023-12-08T20:55:04.508472+0000","last_fullsized":"2023-12-08T20:55:04.508472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:40.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.450640+0000","last_change":"2023-12-08T20:55:04.535786+0000","last_active":"2023-12-08T20:55:05.450640+0000","last_peered":"2023-12-08T20:55:05.450640+0000","last_clean":"2023-12-08T20:55:05.450640+0000","last_became_active":"2023-12-08T20:55:04.535119+0000","last_became_peered":"2023-12-08T20:55:04.535119+0000","last_unstale":"2023-12-08T20:55:05.450640+0000","last_undegraded":"2023-12-08T20:55:05.450640+0000","last_fullsized":"2023-12-08T20:55:05.450640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:23:32.647822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.305734+0000","last_change":"2023-12-08T20:54:56.370877+0000","last_active":"2023-12-08T20:55:04.305734+0000","last_peered":"2023-12-08T20:55:04.305734+0000","last_clean":"2023-12-08T20:55:04.305734+0000","last_became_active":"2023-12-08T20:54:56.370044+0000","last_became_peered":"2023-12-08T20:54:56.370044+0000","last_unstale":"2023-12-08T20:55:04.305734+0000","last_undegraded":"2023-12-08T20:55:04.305734+0000","last_fullsized":"2023-12-08T20:55:04.305734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.407476+0000","last_change":"2023-12-08T20:54:54.923604+0000","last_active":"2023-12-08T20:55:04.407476+0000","last_peered":"2023-12-08T20:55:04.407476+0000","last_clean":"2023-12-08T20:55:04.407476+0000","last_became_active":"2023-12-08T20:54:54.922960+0000","last_became_peered":"2023-12-08T20:54:54.922960+0000","last_unstale":"2023-12-08T20:55:04.407476+0000","last_undegraded":"2023-12-08T20:55:04.407476+0000","last_fullsized":"2023-12-08T20:55:04.407476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:41:46.444603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.554984+0000","last_change":"2023-12-08T20:55:04.522655+0000","last_active":"2023-12-08T20:55:05.554984+0000","last_peered":"2023-12-08T20:55:05.554984+0000","last_clean":"2023-12-08T20:55:05.554984+0000","last_became_active":"2023-12-08T20:55:04.522172+0000","last_became_peered":"2023-12-08T20:55:04.522172+0000","last_unstale":"2023-12-08T20:55:05.554984+0000","last_undegraded":"2023-12-08T20:55:05.554984+0000","last_fullsized":"2023-12-08T20:55:05.554984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:09:00.038275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360579+0000","last_change":"2023-12-08T20:54:56.366227+0000","last_active":"2023-12-08T20:55:04.360579+0000","last_peered":"2023-12-08T20:55:04.360579+0000","last_clean":"2023-12-08T20:55:04.360579+0000","last_became_active":"2023-12-08T20:54:56.365552+0000","last_became_peered":"2023-12-08T20:54:56.365552+0000","last_unstale":"2023-12-08T20:55:04.360579+0000","last_undegraded":"2023-12-08T20:55:04.360579+0000","last_fullsized":"2023-12-08T20:55:04.360579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:00.821031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.361153+0000","last_change":"2023-12-08T20:54:54.980466+0000","last_active":"2023-12-08T20:55:04.361153+0000","last_peered":"2023-12-08T20:55:04.361153+0000","last_clean":"2023-12-08T20:55:04.361153+0000","last_became_active":"2023-12-08T20:54:54.979668+0000","last_became_peered":"2023-12-08T20:54:54.979668+0000","last_unstale":"2023-12-08T20:55:04.361153+0000","last_undegraded":"2023-12-08T20:55:04.361153+0000","last_fullsized":"2023-12-08T20:55:04.361153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:53.529738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.415715+0000","last_change":"2023-12-08T20:55:04.513186+0000","last_active":"2023-12-08T20:55:05.415715+0000","last_peered":"2023-12-08T20:55:05.415715+0000","last_clean":"2023-12-08T20:55:05.415715+0000","last_became_active":"2023-12-08T20:55:04.512549+0000","last_became_peered":"2023-12-08T20:55:04.512549+0000","last_unstale":"2023-12-08T20:55:05.415715+0000","last_undegraded":"2023-12-08T20:55:05.415715+0000","last_fullsized":"2023-12-08T20:55:05.415715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:49:31.307794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508158+0000","last_change":"2023-12-08T20:54:56.261452+0000","last_active":"2023-12-08T20:55:04.508158+0000","last_peered":"2023-12-08T20:55:04.508158+0000","last_clean":"2023-12-08T20:55:04.508158+0000","last_became_active":"2023-12-08T20:54:56.260355+0000","last_became_peered":"2023-12-08T20:54:56.260355+0000","last_unstale":"2023-12-08T20:55:04.508158+0000","last_undegraded":"2023-12-08T20:55:04.508158+0000","last_fullsized":"2023-12-08T20:55:04.508158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:47:02.249125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503832+0000","last_change":"2023-12-08T20:54:54.926546+0000","last_active":"2023-12-08T20:55:04.503832+0000","last_peered":"2023-12-08T20:55:04.503832+0000","last_clean":"2023-12-08T20:55:04.503832+0000","last_became_active":"2023-12-08T20:54:54.925888+0000","last_became_peered":"2023-12-08T20:54:54.925888+0000","last_unstale":"2023-12-08T20:55:04.503832+0000","last_undegraded":"2023-12-08T20:55:04.503832+0000","last_fullsized":"2023-12-08T20:55:04.503832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:25:20.796728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.492624+0000","last_change":"2023-12-08T20:55:04.529041+0000","last_active":"2023-12-08T20:55:05.492624+0000","last_peered":"2023-12-08T20:55:05.492624+0000","last_clean":"2023-12-08T20:55:05.492624+0000","last_became_active":"2023-12-08T20:55:04.528640+0000","last_became_peered":"2023-12-08T20:55:04.528640+0000","last_unstale":"2023-12-08T20:55:05.492624+0000","last_undegraded":"2023-12-08T20:55:05.492624+0000","last_fullsized":"2023-12-08T20:55:05.492624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:18.653508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360612+0000","last_change":"2023-12-08T20:54:56.365339+0000","last_active":"2023-12-08T20:55:04.360612+0000","last_peered":"2023-12-08T20:55:04.360612+0000","last_clean":"2023-12-08T20:55:04.360612+0000","last_became_active":"2023-12-08T20:54:56.364597+0000","last_became_peered":"2023-12-08T20:54:56.364597+0000","last_unstale":"2023-12-08T20:55:04.360612+0000","last_undegraded":"2023-12-08T20:55:04.360612+0000","last_fullsized":"2023-12-08T20:55:04.360612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:17:58.931401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.509296+0000","last_change":"2023-12-08T20:54:54.928399+0000","last_active":"2023-12-08T20:55:04.509296+0000","last_peered":"2023-12-08T20:55:04.509296+0000","last_clean":"2023-12-08T20:55:04.509296+0000","last_became_active":"2023-12-08T20:54:54.927814+0000","last_became_peered":"2023-12-08T20:54:54.927814+0000","last_unstale":"2023-12-08T20:55:04.509296+0000","last_undegraded":"2023-12-08T20:55:04.509296+0000","last_fullsized":"2023-12-08T20:55:04.509296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:04:22.986992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491362+0000","last_change":"2023-12-08T20:55:04.523561+0000","last_active":"2023-12-08T20:55:05.491362+0000","last_peered":"2023-12-08T20:55:05.491362+0000","last_clean":"2023-12-08T20:55:05.491362+0000","last_became_active":"2023-12-08T20:55:04.522714+0000","last_became_peered":"2023-12-08T20:55:04.522714+0000","last_unstale":"2023-12-08T20:55:05.491362+0000","last_undegraded":"2023-12-08T20:55:05.491362+0000","last_fullsized":"2023-12-08T20:55:05.491362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:14.534456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360043+0000","last_change":"2023-12-08T20:54:56.331268+0000","last_active":"2023-12-08T20:55:04.360043+0000","last_peered":"2023-12-08T20:55:04.360043+0000","last_clean":"2023-12-08T20:55:04.360043+0000","last_became_active":"2023-12-08T20:54:56.330508+0000","last_became_peered":"2023-12-08T20:54:56.330508+0000","last_unstale":"2023-12-08T20:55:04.360043+0000","last_undegraded":"2023-12-08T20:55:04.360043+0000","last_fullsized":"2023-12-08T20:55:04.360043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:52.392589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.361147+0000","last_change":"2023-12-08T20:54:54.982136+0000","last_active":"2023-12-08T20:55:04.361147+0000","last_peered":"2023-12-08T20:55:04.361147+0000","last_clean":"2023-12-08T20:55:04.361147+0000","last_became_active":"2023-12-08T20:54:54.981168+0000","last_became_peered":"2023-12-08T20:54:54.981168+0000","last_unstale":"2023-12-08T20:55:04.361147+0000","last_undegraded":"2023-12-08T20:55:04.361147+0000","last_fullsized":"2023-12-08T20:55:04.361147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:13.841870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.556069+0000","last_change":"2023-12-08T20:55:04.513360+0000","last_active":"2023-12-08T20:55:05.556069+0000","last_peered":"2023-12-08T20:55:05.556069+0000","last_clean":"2023-12-08T20:55:05.556069+0000","last_became_active":"2023-12-08T20:55:04.511032+0000","last_became_peered":"2023-12-08T20:55:04.511032+0000","last_unstale":"2023-12-08T20:55:05.556069+0000","last_undegraded":"2023-12-08T20:55:05.556069+0000","last_fullsized":"2023-12-08T20:55:05.556069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:38:04.841172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.413307+0000","last_change":"2023-12-08T20:54:56.409829+0000","last_active":"2023-12-08T20:55:04.413307+0000","last_peered":"2023-12-08T20:55:04.413307+0000","last_clean":"2023-12-08T20:55:04.413307+0000","last_became_active":"2023-12-08T20:54:56.409291+0000","last_became_peered":"2023-12-08T20:54:56.409291+0000","last_unstale":"2023-12-08T20:55:04.413307+0000","last_undegraded":"2023-12-08T20:55:04.413307+0000","last_fullsized":"2023-12-08T20:55:04.413307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:06:37.234510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508973+0000","last_change":"2023-12-08T20:54:54.978750+0000","last_active":"2023-12-08T20:55:04.508973+0000","last_peered":"2023-12-08T20:55:04.508973+0000","last_clean":"2023-12-08T20:55:04.508973+0000","last_became_active":"2023-12-08T20:54:54.978416+0000","last_became_peered":"2023-12-08T20:54:54.978416+0000","last_unstale":"2023-12-08T20:55:04.508973+0000","last_undegraded":"2023-12-08T20:55:04.508973+0000","last_fullsized":"2023-12-08T20:55:04.508973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:00:08.584168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553308+0000","last_change":"2023-12-08T20:55:04.507859+0000","last_active":"2023-12-08T20:55:05.553308+0000","last_peered":"2023-12-08T20:55:05.553308+0000","last_clean":"2023-12-08T20:55:05.553308+0000","last_became_active":"2023-12-08T20:55:04.507454+0000","last_became_peered":"2023-12-08T20:55:04.507454+0000","last_unstale":"2023-12-08T20:55:05.553308+0000","last_undegraded":"2023-12-08T20:55:05.553308+0000","last_fullsized":"2023-12-08T20:55:05.553308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:56:57.279368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.498994+0000","last_change":"2023-12-08T20:54:56.372983+0000","last_active":"2023-12-08T20:55:04.498994+0000","last_peered":"2023-12-08T20:55:04.498994+0000","last_clean":"2023-12-08T20:55:04.498994+0000","last_became_active":"2023-12-08T20:54:56.369974+0000","last_became_peered":"2023-12-08T20:54:56.369974+0000","last_unstale":"2023-12-08T20:55:04.498994+0000","last_undegraded":"2023-12-08T20:55:04.498994+0000","last_fullsized":"2023-12-08T20:55:04.498994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.531685+0000","last_change":"2023-12-08T20:54:54.925560+0000","last_active":"2023-12-08T20:55:04.531685+0000","last_peered":"2023-12-08T20:55:04.531685+0000","last_clean":"2023-12-08T20:55:04.531685+0000","last_became_active":"2023-12-08T20:54:54.925022+0000","last_became_peered":"2023-12-08T20:54:54.925022+0000","last_unstale":"2023-12-08T20:55:04.531685+0000","last_undegraded":"2023-12-08T20:55:04.531685+0000","last_fullsized":"2023-12-08T20:55:04.531685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:10:52.902793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.552418+0000","last_change":"2023-12-08T20:55:04.531931+0000","last_active":"2023-12-08T20:55:05.552418+0000","last_peered":"2023-12-08T20:55:05.552418+0000","last_clean":"2023-12-08T20:55:05.552418+0000","last_became_active":"2023-12-08T20:55:04.530774+0000","last_became_peered":"2023-12-08T20:55:04.530774+0000","last_unstale":"2023-12-08T20:55:05.552418+0000","last_undegraded":"2023-12-08T20:55:05.552418+0000","last_fullsized":"2023-12-08T20:55:05.552418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:39:26.927665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503831+0000","last_change":"2023-12-08T20:54:56.391492+0000","last_active":"2023-12-08T20:55:04.503831+0000","last_peered":"2023-12-08T20:55:04.503831+0000","last_clean":"2023-12-08T20:55:04.503831+0000","last_became_active":"2023-12-08T20:54:56.385090+0000","last_became_peered":"2023-12-08T20:54:56.385090+0000","last_unstale":"2023-12-08T20:55:04.503831+0000","last_undegraded":"2023-12-08T20:55:04.503831+0000","last_fullsized":"2023-12-08T20:55:04.503831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:21:29.009005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508632+0000","last_change":"2023-12-08T20:54:54.932503+0000","last_active":"2023-12-08T20:55:04.508632+0000","last_peered":"2023-12-08T20:55:04.508632+0000","last_clean":"2023-12-08T20:55:04.508632+0000","last_became_active":"2023-12-08T20:54:54.932121+0000","last_became_peered":"2023-12-08T20:54:54.932121+0000","last_unstale":"2023-12-08T20:55:04.508632+0000","last_undegraded":"2023-12-08T20:55:04.508632+0000","last_fullsized":"2023-12-08T20:55:04.508632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:58.013744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553088+0000","last_change":"2023-12-08T20:55:04.529911+0000","last_active":"2023-12-08T20:55:05.553088+0000","last_peered":"2023-12-08T20:55:05.553088+0000","last_clean":"2023-12-08T20:55:05.553088+0000","last_became_active":"2023-12-08T20:55:04.528698+0000","last_became_peered":"2023-12-08T20:55:04.528698+0000","last_unstale":"2023-12-08T20:55:05.553088+0000","last_undegraded":"2023-12-08T20:55:05.553088+0000","last_fullsized":"2023-12-08T20:55:05.553088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:33:11.874876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.512905+0000","last_change":"2023-12-08T20:54:56.413886+0000","last_active":"2023-12-08T20:55:04.512905+0000","last_peered":"2023-12-08T20:55:04.512905+0000","last_clean":"2023-12-08T20:55:04.512905+0000","last_became_active":"2023-12-08T20:54:56.412786+0000","last_became_peered":"2023-12-08T20:54:56.412786+0000","last_unstale":"2023-12-08T20:55:04.512905+0000","last_undegraded":"2023-12-08T20:55:04.512905+0000","last_fullsized":"2023-12-08T20:55:04.512905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:39.331476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.305732+0000","last_change":"2023-12-08T20:54:54.922605+0000","last_active":"2023-12-08T20:55:04.305732+0000","last_peered":"2023-12-08T20:55:04.305732+0000","last_clean":"2023-12-08T20:55:04.305732+0000","last_became_active":"2023-12-08T20:54:54.922014+0000","last_became_peered":"2023-12-08T20:54:54.922014+0000","last_unstale":"2023-12-08T20:55:04.305732+0000","last_undegraded":"2023-12-08T20:55:04.305732+0000","last_fullsized":"2023-12-08T20:55:04.305732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:08:48.601596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.554232+0000","last_change":"2023-12-08T20:55:04.509438+0000","last_active":"2023-12-08T20:55:05.554232+0000","last_peered":"2023-12-08T20:55:05.554232+0000","last_clean":"2023-12-08T20:55:05.554232+0000","last_became_active":"2023-12-08T20:55:04.508219+0000","last_became_peered":"2023-12-08T20:55:04.508219+0000","last_unstale":"2023-12-08T20:55:05.554232+0000","last_undegraded":"2023-12-08T20:55:05.554232+0000","last_fullsized":"2023-12-08T20:55:05.554232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:16:31.758437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.406374+0000","last_change":"2023-12-08T20:54:56.370599+0000","last_active":"2023-12-08T20:55:04.406374+0000","last_peered":"2023-12-08T20:55:04.406374+0000","last_clean":"2023-12-08T20:55:04.406374+0000","last_became_active":"2023-12-08T20:54:56.370121+0000","last_became_peered":"2023-12-08T20:54:56.370121+0000","last_unstale":"2023-12-08T20:55:04.406374+0000","last_undegraded":"2023-12-08T20:55:04.406374+0000","last_fullsized":"2023-12-08T20:55:04.406374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:58:13.927241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507925+0000","last_change":"2023-12-08T20:54:54.927599+0000","last_active":"2023-12-08T20:55:04.507925+0000","last_peered":"2023-12-08T20:55:04.507925+0000","last_clean":"2023-12-08T20:55:04.507925+0000","last_became_active":"2023-12-08T20:54:54.927120+0000","last_became_peered":"2023-12-08T20:54:54.927120+0000","last_unstale":"2023-12-08T20:55:04.507925+0000","last_undegraded":"2023-12-08T20:55:04.507925+0000","last_fullsized":"2023-12-08T20:55:04.507925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:38.042201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.557221+0000","last_change":"2023-12-08T20:55:04.546945+0000","last_active":"2023-12-08T20:55:05.557221+0000","last_peered":"2023-12-08T20:55:05.557221+0000","last_clean":"2023-12-08T20:55:05.557221+0000","last_became_active":"2023-12-08T20:55:04.546439+0000","last_became_peered":"2023-12-08T20:55:04.546439+0000","last_unstale":"2023-12-08T20:55:05.557221+0000","last_undegraded":"2023-12-08T20:55:05.557221+0000","last_fullsized":"2023-12-08T20:55:05.557221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:30.484701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.361611+0000","last_change":"2023-12-08T20:54:56.372770+0000","last_active":"2023-12-08T20:55:04.361611+0000","last_peered":"2023-12-08T20:55:04.361611+0000","last_clean":"2023-12-08T20:55:04.361611+0000","last_became_active":"2023-12-08T20:54:56.372205+0000","last_became_peered":"2023-12-08T20:54:56.372205+0000","last_unstale":"2023-12-08T20:55:04.361611+0000","last_undegraded":"2023-12-08T20:55:04.361611+0000","last_fullsized":"2023-12-08T20:55:04.361611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:06.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508582+0000","last_change":"2023-12-08T20:54:54.929937+0000","last_active":"2023-12-08T20:55:04.508582+0000","last_peered":"2023-12-08T20:55:04.508582+0000","last_clean":"2023-12-08T20:55:04.508582+0000","last_became_active":"2023-12-08T20:54:54.929177+0000","last_became_peered":"2023-12-08T20:54:54.929177+0000","last_unstale":"2023-12-08T20:55:04.508582+0000","last_undegraded":"2023-12-08T20:55:04.508582+0000","last_fullsized":"2023-12-08T20:55:04.508582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:39:58.988364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.455933+0000","last_change":"2023-12-08T20:54:16.149485+0000","last_active":"2023-12-08T20:55:04.455933+0000","last_peered":"2023-12-08T20:55:04.455933+0000","last_clean":"2023-12-08T20:55:04.455933+0000","last_became_active":"2023-12-08T20:54:16.147507+0000","last_became_peered":"2023-12-08T20:54:16.147507+0000","last_unstale":"2023-12-08T20:55:04.455933+0000","last_undegraded":"2023-12-08T20:55:04.455933+0000","last_fullsized":"2023-12-08T20:55:04.455933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_clean_scrub_stamp":"2023-12-08T20:54:14.141045+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:17.484651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.451649+0000","last_change":"2023-12-08T20:55:04.515531+0000","last_active":"2023-12-08T20:55:05.451649+0000","last_peered":"2023-12-08T20:55:05.451649+0000","last_clean":"2023-12-08T20:55:05.451649+0000","last_became_active":"2023-12-08T20:55:04.515200+0000","last_became_peered":"2023-12-08T20:55:04.515200+0000","last_unstale":"2023-12-08T20:55:05.451649+0000","last_undegraded":"2023-12-08T20:55:05.451649+0000","last_fullsized":"2023-12-08T20:55:05.451649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:00:08.085700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508800+0000","last_change":"2023-12-08T20:54:56.318724+0000","last_active":"2023-12-08T20:55:04.508800+0000","last_peered":"2023-12-08T20:55:04.508800+0000","last_clean":"2023-12-08T20:55:04.508800+0000","last_became_active":"2023-12-08T20:54:56.318408+0000","last_became_peered":"2023-12-08T20:54:56.318408+0000","last_unstale":"2023-12-08T20:55:04.508800+0000","last_undegraded":"2023-12-08T20:55:04.508800+0000","last_fullsized":"2023-12-08T20:55:04.508800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:14:20.217847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.413648+0000","last_change":"2023-12-08T20:54:54.926031+0000","last_active":"2023-12-08T20:55:04.413648+0000","last_peered":"2023-12-08T20:55:04.413648+0000","last_clean":"2023-12-08T20:55:04.413648+0000","last_became_active":"2023-12-08T20:54:54.925610+0000","last_became_peered":"2023-12-08T20:54:54.925610+0000","last_unstale":"2023-12-08T20:55:04.413648+0000","last_undegraded":"2023-12-08T20:55:04.413648+0000","last_fullsized":"2023-12-08T20:55:04.413648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:05:08.857673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.491648+0000","last_change":"2023-12-08T20:55:04.523264+0000","last_active":"2023-12-08T20:55:05.491648+0000","last_peered":"2023-12-08T20:55:05.491648+0000","last_clean":"2023-12-08T20:55:05.491648+0000","last_became_active":"2023-12-08T20:55:04.522245+0000","last_became_peered":"2023-12-08T20:55:04.522245+0000","last_unstale":"2023-12-08T20:55:05.491648+0000","last_undegraded":"2023-12-08T20:55:05.491648+0000","last_fullsized":"2023-12-08T20:55:05.491648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:23.322536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.505093+0000","last_change":"2023-12-08T20:54:56.378291+0000","last_active":"2023-12-08T20:55:04.505093+0000","last_peered":"2023-12-08T20:55:04.505093+0000","last_clean":"2023-12-08T20:55:04.505093+0000","last_became_active":"2023-12-08T20:54:56.377762+0000","last_became_peered":"2023-12-08T20:54:56.377762+0000","last_unstale":"2023-12-08T20:55:04.505093+0000","last_undegraded":"2023-12-08T20:55:04.505093+0000","last_fullsized":"2023-12-08T20:55:04.505093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:11:11.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540684+0000","last_change":"2023-12-08T20:54:54.936008+0000","last_active":"2023-12-08T20:55:04.540684+0000","last_peered":"2023-12-08T20:55:04.540684+0000","last_clean":"2023-12-08T20:55:04.540684+0000","last_became_active":"2023-12-08T20:54:54.935472+0000","last_became_peered":"2023-12-08T20:54:54.935472+0000","last_unstale":"2023-12-08T20:55:04.540684+0000","last_undegraded":"2023-12-08T20:55:04.540684+0000","last_fullsized":"2023-12-08T20:55:04.540684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:11:02.460764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.557220+0000","last_change":"2023-12-08T20:55:04.534674+0000","last_active":"2023-12-08T20:55:05.557220+0000","last_peered":"2023-12-08T20:55:05.557220+0000","last_clean":"2023-12-08T20:55:05.557220+0000","last_became_active":"2023-12-08T20:55:04.533305+0000","last_became_peered":"2023-12-08T20:55:04.533305+0000","last_unstale":"2023-12-08T20:55:05.557220+0000","last_undegraded":"2023-12-08T20:55:05.557220+0000","last_fullsized":"2023-12-08T20:55:05.557220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:18.790378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504316+0000","last_change":"2023-12-08T20:54:56.380702+0000","last_active":"2023-12-08T20:55:04.504316+0000","last_peered":"2023-12-08T20:55:04.504316+0000","last_clean":"2023-12-08T20:55:04.504316+0000","last_became_active":"2023-12-08T20:54:56.379933+0000","last_became_peered":"2023-12-08T20:54:56.379933+0000","last_unstale":"2023-12-08T20:55:04.504316+0000","last_undegraded":"2023-12-08T20:55:04.504316+0000","last_fullsized":"2023-12-08T20:55:04.504316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:31:18.872161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360865+0000","last_change":"2023-12-08T20:54:54.983221+0000","last_active":"2023-12-08T20:55:04.360865+0000","last_peered":"2023-12-08T20:55:04.360865+0000","last_clean":"2023-12-08T20:55:04.360865+0000","last_became_active":"2023-12-08T20:54:54.982414+0000","last_became_peered":"2023-12-08T20:54:54.982414+0000","last_unstale":"2023-12-08T20:55:04.360865+0000","last_undegraded":"2023-12-08T20:55:04.360865+0000","last_fullsized":"2023-12-08T20:55:04.360865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:36:42.874558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.449898+0000","last_change":"2023-12-08T20:55:04.515310+0000","last_active":"2023-12-08T20:55:05.449898+0000","last_peered":"2023-12-08T20:55:05.449898+0000","last_clean":"2023-12-08T20:55:05.449898+0000","last_became_active":"2023-12-08T20:55:04.514907+0000","last_became_peered":"2023-12-08T20:55:04.514907+0000","last_unstale":"2023-12-08T20:55:05.449898+0000","last_undegraded":"2023-12-08T20:55:05.449898+0000","last_fullsized":"2023-12-08T20:55:05.449898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:26:19.536478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499717+0000","last_change":"2023-12-08T20:54:56.378176+0000","last_active":"2023-12-08T20:55:04.499717+0000","last_peered":"2023-12-08T20:55:04.499717+0000","last_clean":"2023-12-08T20:55:04.499717+0000","last_became_active":"2023-12-08T20:54:56.377430+0000","last_became_peered":"2023-12-08T20:54:56.377430+0000","last_unstale":"2023-12-08T20:55:04.499717+0000","last_undegraded":"2023-12-08T20:55:04.499717+0000","last_fullsized":"2023-12-08T20:55:04.499717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504536+0000","last_change":"2023-12-08T20:54:54.926769+0000","last_active":"2023-12-08T20:55:04.504536+0000","last_peered":"2023-12-08T20:55:04.504536+0000","last_clean":"2023-12-08T20:55:04.504536+0000","last_became_active":"2023-12-08T20:54:54.926386+0000","last_became_peered":"2023-12-08T20:54:54.926386+0000","last_unstale":"2023-12-08T20:55:04.504536+0000","last_undegraded":"2023-12-08T20:55:04.504536+0000","last_fullsized":"2023-12-08T20:55:04.504536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:05.933965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553168+0000","last_change":"2023-12-08T20:55:04.523709+0000","last_active":"2023-12-08T20:55:05.553168+0000","last_peered":"2023-12-08T20:55:05.553168+0000","last_clean":"2023-12-08T20:55:05.553168+0000","last_became_active":"2023-12-08T20:55:04.523074+0000","last_became_peered":"2023-12-08T20:55:04.523074+0000","last_unstale":"2023-12-08T20:55:05.553168+0000","last_undegraded":"2023-12-08T20:55:05.553168+0000","last_fullsized":"2023-12-08T20:55:05.553168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508063+0000","last_change":"2023-12-08T20:54:56.373188+0000","last_active":"2023-12-08T20:55:04.508063+0000","last_peered":"2023-12-08T20:55:04.508063+0000","last_clean":"2023-12-08T20:55:04.508063+0000","last_became_active":"2023-12-08T20:54:56.371132+0000","last_became_peered":"2023-12-08T20:54:56.371132+0000","last_unstale":"2023-12-08T20:55:04.508063+0000","last_undegraded":"2023-12-08T20:55:04.508063+0000","last_fullsized":"2023-12-08T20:55:04.508063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:30:06.387412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360789+0000","last_change":"2023-12-08T20:54:54.985432+0000","last_active":"2023-12-08T20:55:04.360789+0000","last_peered":"2023-12-08T20:55:04.360789+0000","last_clean":"2023-12-08T20:55:04.360789+0000","last_became_active":"2023-12-08T20:54:54.984661+0000","last_became_peered":"2023-12-08T20:54:54.984661+0000","last_unstale":"2023-12-08T20:55:04.360789+0000","last_undegraded":"2023-12-08T20:55:04.360789+0000","last_fullsized":"2023-12-08T20:55:04.360789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:16:34.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.558071+0000","last_change":"2023-12-08T20:55:04.543349+0000","last_active":"2023-12-08T20:55:05.558071+0000","last_peered":"2023-12-08T20:55:05.558071+0000","last_clean":"2023-12-08T20:55:05.558071+0000","last_became_active":"2023-12-08T20:55:04.541074+0000","last_became_peered":"2023-12-08T20:55:04.541074+0000","last_unstale":"2023-12-08T20:55:05.558071+0000","last_undegraded":"2023-12-08T20:55:05.558071+0000","last_fullsized":"2023-12-08T20:55:05.558071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:35.399668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.455813+0000","last_change":"2023-12-08T20:54:56.413772+0000","last_active":"2023-12-08T20:55:04.455813+0000","last_peered":"2023-12-08T20:55:04.455813+0000","last_clean":"2023-12-08T20:55:04.455813+0000","last_became_active":"2023-12-08T20:54:56.413023+0000","last_became_peered":"2023-12-08T20:54:56.413023+0000","last_unstale":"2023-12-08T20:55:04.455813+0000","last_undegraded":"2023-12-08T20:55:04.455813+0000","last_fullsized":"2023-12-08T20:55:04.455813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504120+0000","last_change":"2023-12-08T20:54:54.929238+0000","last_active":"2023-12-08T20:55:04.504120+0000","last_peered":"2023-12-08T20:55:04.504120+0000","last_clean":"2023-12-08T20:55:04.504120+0000","last_became_active":"2023-12-08T20:54:54.928543+0000","last_became_peered":"2023-12-08T20:54:54.928543+0000","last_unstale":"2023-12-08T20:55:04.504120+0000","last_undegraded":"2023-12-08T20:55:04.504120+0000","last_fullsized":"2023-12-08T20:55:04.504120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:04.997415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.557550+0000","last_change":"2023-12-08T20:55:04.540347+0000","last_active":"2023-12-08T20:55:05.557550+0000","last_peered":"2023-12-08T20:55:05.557550+0000","last_clean":"2023-12-08T20:55:05.557550+0000","last_became_active":"2023-12-08T20:55:04.535002+0000","last_became_peered":"2023-12-08T20:55:04.535002+0000","last_unstale":"2023-12-08T20:55:05.557550+0000","last_undegraded":"2023-12-08T20:55:05.557550+0000","last_fullsized":"2023-12-08T20:55:05.557550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:09.576246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508370+0000","last_change":"2023-12-08T20:54:56.394016+0000","last_active":"2023-12-08T20:55:04.508370+0000","last_peered":"2023-12-08T20:55:04.508370+0000","last_clean":"2023-12-08T20:55:04.508370+0000","last_became_active":"2023-12-08T20:54:56.393187+0000","last_became_peered":"2023-12-08T20:54:56.393187+0000","last_unstale":"2023-12-08T20:55:04.508370+0000","last_undegraded":"2023-12-08T20:55:04.508370+0000","last_fullsized":"2023-12-08T20:55:04.508370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:20:56.762499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508542+0000","last_change":"2023-12-08T20:54:54.930839+0000","last_active":"2023-12-08T20:55:04.508542+0000","last_peered":"2023-12-08T20:55:04.508542+0000","last_clean":"2023-12-08T20:55:04.508542+0000","last_became_active":"2023-12-08T20:54:54.928065+0000","last_became_peered":"2023-12-08T20:54:54.928065+0000","last_unstale":"2023-12-08T20:55:04.508542+0000","last_undegraded":"2023-12-08T20:55:04.508542+0000","last_fullsized":"2023-12-08T20:55:04.508542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:28.708543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.552940+0000","last_change":"2023-12-08T20:55:04.520698+0000","last_active":"2023-12-08T20:55:05.552940+0000","last_peered":"2023-12-08T20:55:05.552940+0000","last_clean":"2023-12-08T20:55:05.552940+0000","last_became_active":"2023-12-08T20:55:04.516783+0000","last_became_peered":"2023-12-08T20:55:04.516783+0000","last_unstale":"2023-12-08T20:55:05.552940+0000","last_undegraded":"2023-12-08T20:55:05.552940+0000","last_fullsized":"2023-12-08T20:55:05.552940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:46:00.331700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.407130+0000","last_change":"2023-12-08T20:54:56.331045+0000","last_active":"2023-12-08T20:55:04.407130+0000","last_peered":"2023-12-08T20:55:04.407130+0000","last_clean":"2023-12-08T20:55:04.407130+0000","last_became_active":"2023-12-08T20:54:56.330346+0000","last_became_peered":"2023-12-08T20:54:56.330346+0000","last_unstale":"2023-12-08T20:55:04.407130+0000","last_undegraded":"2023-12-08T20:55:04.407130+0000","last_fullsized":"2023-12-08T20:55:04.407130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:43:36.950589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.306013+0000","last_change":"2023-12-08T20:54:54.927094+0000","last_active":"2023-12-08T20:55:04.306013+0000","last_peered":"2023-12-08T20:55:04.306013+0000","last_clean":"2023-12-08T20:55:04.306013+0000","last_became_active":"2023-12-08T20:54:54.926435+0000","last_became_peered":"2023-12-08T20:54:54.926435+0000","last_unstale":"2023-12-08T20:55:04.306013+0000","last_undegraded":"2023-12-08T20:55:04.306013+0000","last_fullsized":"2023-12-08T20:55:04.306013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.450954+0000","last_change":"2023-12-08T20:55:04.534630+0000","last_active":"2023-12-08T20:55:05.450954+0000","last_peered":"2023-12-08T20:55:05.450954+0000","last_clean":"2023-12-08T20:55:05.450954+0000","last_became_active":"2023-12-08T20:55:04.534289+0000","last_became_peered":"2023-12-08T20:55:04.534289+0000","last_unstale":"2023-12-08T20:55:05.450954+0000","last_undegraded":"2023-12-08T20:55:05.450954+0000","last_fullsized":"2023-12-08T20:55:05.450954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:36:33.771845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504120+0000","last_change":"2023-12-08T20:54:56.376691+0000","last_active":"2023-12-08T20:55:04.504120+0000","last_peered":"2023-12-08T20:55:04.504120+0000","last_clean":"2023-12-08T20:55:04.504120+0000","last_became_active":"2023-12-08T20:54:56.375922+0000","last_became_peered":"2023-12-08T20:54:56.375922+0000","last_unstale":"2023-12-08T20:55:04.504120+0000","last_undegraded":"2023-12-08T20:55:04.504120+0000","last_fullsized":"2023-12-08T20:55:04.504120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:37:56.593406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'10","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:15.154004+0000","last_change":"2023-12-08T20:54:54.978427+0000","last_active":"2023-12-08T20:55:15.154004+0000","last_peered":"2023-12-08T20:55:15.154004+0000","last_clean":"2023-12-08T20:55:15.154004+0000","last_became_active":"2023-12-08T20:54:54.977999+0000","last_became_peered":"2023-12-08T20:54:54.977999+0000","last_unstale":"2023-12-08T20:55:15.154004+0000","last_undegraded":"2023-12-08T20:55:15.154004+0000","last_fullsized":"2023-12-08T20:55:15.154004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.554268+0000","last_change":"2023-12-08T20:55:04.522691+0000","last_active":"2023-12-08T20:55:05.554268+0000","last_peered":"2023-12-08T20:55:05.554268+0000","last_clean":"2023-12-08T20:55:05.554268+0000","last_became_active":"2023-12-08T20:55:04.522190+0000","last_became_peered":"2023-12-08T20:55:04.522190+0000","last_unstale":"2023-12-08T20:55:05.554268+0000","last_undegraded":"2023-12-08T20:55:05.554268+0000","last_fullsized":"2023-12-08T20:55:05.554268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:52.945031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508584+0000","last_change":"2023-12-08T20:54:56.384439+0000","last_active":"2023-12-08T20:55:04.508584+0000","last_peered":"2023-12-08T20:55:04.508584+0000","last_clean":"2023-12-08T20:55:04.508584+0000","last_became_active":"2023-12-08T20:54:56.383561+0000","last_became_peered":"2023-12-08T20:54:56.383561+0000","last_unstale":"2023-12-08T20:55:04.508584+0000","last_undegraded":"2023-12-08T20:55:04.508584+0000","last_fullsized":"2023-12-08T20:55:04.508584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:01.328480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.307220+0000","last_change":"2023-12-08T20:54:54.980625+0000","last_active":"2023-12-08T20:55:04.307220+0000","last_peered":"2023-12-08T20:55:04.307220+0000","last_clean":"2023-12-08T20:55:04.307220+0000","last_became_active":"2023-12-08T20:54:54.980023+0000","last_became_peered":"2023-12-08T20:54:54.980023+0000","last_unstale":"2023-12-08T20:55:04.307220+0000","last_undegraded":"2023-12-08T20:55:04.307220+0000","last_fullsized":"2023-12-08T20:55:04.307220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:44:27.401600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.492065+0000","last_change":"2023-12-08T20:55:04.523658+0000","last_active":"2023-12-08T20:55:05.492065+0000","last_peered":"2023-12-08T20:55:05.492065+0000","last_clean":"2023-12-08T20:55:05.492065+0000","last_became_active":"2023-12-08T20:55:04.522325+0000","last_became_peered":"2023-12-08T20:55:04.522325+0000","last_unstale":"2023-12-08T20:55:05.492065+0000","last_undegraded":"2023-12-08T20:55:05.492065+0000","last_fullsized":"2023-12-08T20:55:05.492065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:32:03.125815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540898+0000","last_change":"2023-12-08T20:54:56.410075+0000","last_active":"2023-12-08T20:55:04.540898+0000","last_peered":"2023-12-08T20:55:04.540898+0000","last_clean":"2023-12-08T20:55:04.540898+0000","last_became_active":"2023-12-08T20:54:56.409539+0000","last_became_peered":"2023-12-08T20:54:56.409539+0000","last_unstale":"2023-12-08T20:55:04.540898+0000","last_undegraded":"2023-12-08T20:55:04.540898+0000","last_fullsized":"2023-12-08T20:55:04.540898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:37:03.173965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504113+0000","last_change":"2023-12-08T20:54:54.936311+0000","last_active":"2023-12-08T20:55:04.504113+0000","last_peered":"2023-12-08T20:55:04.504113+0000","last_clean":"2023-12-08T20:55:04.504113+0000","last_became_active":"2023-12-08T20:54:54.935889+0000","last_became_peered":"2023-12-08T20:54:54.935889+0000","last_unstale":"2023-12-08T20:55:04.504113+0000","last_undegraded":"2023-12-08T20:55:04.504113+0000","last_fullsized":"2023-12-08T20:55:04.504113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:13.785495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.414801+0000","last_change":"2023-12-08T20:55:04.519274+0000","last_active":"2023-12-08T20:55:05.414801+0000","last_peered":"2023-12-08T20:55:05.414801+0000","last_clean":"2023-12-08T20:55:05.414801+0000","last_became_active":"2023-12-08T20:55:04.518048+0000","last_became_peered":"2023-12-08T20:55:04.518048+0000","last_unstale":"2023-12-08T20:55:05.414801+0000","last_undegraded":"2023-12-08T20:55:05.414801+0000","last_fullsized":"2023-12-08T20:55:05.414801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:36:52.411600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499617+0000","last_change":"2023-12-08T20:54:56.376709+0000","last_active":"2023-12-08T20:55:04.499617+0000","last_peered":"2023-12-08T20:55:04.499617+0000","last_clean":"2023-12-08T20:55:04.499617+0000","last_became_active":"2023-12-08T20:54:56.369709+0000","last_became_peered":"2023-12-08T20:54:56.369709+0000","last_unstale":"2023-12-08T20:55:04.499617+0000","last_undegraded":"2023-12-08T20:55:04.499617+0000","last_fullsized":"2023-12-08T20:55:04.499617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456242+0000","last_change":"2023-12-08T20:54:54.980040+0000","last_active":"2023-12-08T20:55:04.456242+0000","last_peered":"2023-12-08T20:55:04.456242+0000","last_clean":"2023-12-08T20:55:04.456242+0000","last_became_active":"2023-12-08T20:54:54.979751+0000","last_became_peered":"2023-12-08T20:54:54.979751+0000","last_unstale":"2023-12-08T20:55:04.456242+0000","last_undegraded":"2023-12-08T20:55:04.456242+0000","last_fullsized":"2023-12-08T20:55:04.456242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:08.789175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553699+0000","last_change":"2023-12-08T20:55:04.513429+0000","last_active":"2023-12-08T20:55:05.553699+0000","last_peered":"2023-12-08T20:55:05.553699+0000","last_clean":"2023-12-08T20:55:05.553699+0000","last_became_active":"2023-12-08T20:55:04.511405+0000","last_became_peered":"2023-12-08T20:55:04.511405+0000","last_unstale":"2023-12-08T20:55:05.553699+0000","last_undegraded":"2023-12-08T20:55:05.553699+0000","last_fullsized":"2023-12-08T20:55:05.553699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:48:08.081679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553779+0000","last_change":"2023-12-08T20:55:04.537067+0000","last_active":"2023-12-08T20:55:05.553779+0000","last_peered":"2023-12-08T20:55:05.553779+0000","last_clean":"2023-12-08T20:55:05.553779+0000","last_became_active":"2023-12-08T20:55:04.536497+0000","last_became_peered":"2023-12-08T20:55:04.536497+0000","last_unstale":"2023-12-08T20:55:05.553779+0000","last_undegraded":"2023-12-08T20:55:05.553779+0000","last_fullsized":"2023-12-08T20:55:05.553779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:49.322641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360960+0000","last_change":"2023-12-08T20:54:56.318249+0000","last_active":"2023-12-08T20:55:04.360960+0000","last_peered":"2023-12-08T20:55:04.360960+0000","last_clean":"2023-12-08T20:55:04.360960+0000","last_became_active":"2023-12-08T20:54:56.317895+0000","last_became_peered":"2023-12-08T20:54:56.317895+0000","last_unstale":"2023-12-08T20:55:04.360960+0000","last_undegraded":"2023-12-08T20:55:04.360960+0000","last_fullsized":"2023-12-08T20:55:04.360960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:47:45.185235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507838+0000","last_change":"2023-12-08T20:54:54.935924+0000","last_active":"2023-12-08T20:55:04.507838+0000","last_peered":"2023-12-08T20:55:04.507838+0000","last_clean":"2023-12-08T20:55:04.507838+0000","last_became_active":"2023-12-08T20:54:54.935578+0000","last_became_peered":"2023-12-08T20:54:54.935578+0000","last_unstale":"2023-12-08T20:55:04.507838+0000","last_undegraded":"2023-12-08T20:55:04.507838+0000","last_fullsized":"2023-12-08T20:55:04.507838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:22.627774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.451614+0000","last_change":"2023-12-08T20:55:04.535940+0000","last_active":"2023-12-08T20:55:05.451614+0000","last_peered":"2023-12-08T20:55:05.451614+0000","last_clean":"2023-12-08T20:55:05.451614+0000","last_became_active":"2023-12-08T20:55:04.535525+0000","last_became_peered":"2023-12-08T20:55:04.535525+0000","last_unstale":"2023-12-08T20:55:05.451614+0000","last_undegraded":"2023-12-08T20:55:05.451614+0000","last_fullsized":"2023-12-08T20:55:05.451614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:30:14.451021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.513649+0000","last_change":"2023-12-08T20:54:56.413484+0000","last_active":"2023-12-08T20:55:04.513649+0000","last_peered":"2023-12-08T20:55:04.513649+0000","last_clean":"2023-12-08T20:55:04.513649+0000","last_became_active":"2023-12-08T20:54:56.412133+0000","last_became_peered":"2023-12-08T20:54:56.412133+0000","last_unstale":"2023-12-08T20:55:04.513649+0000","last_undegraded":"2023-12-08T20:55:04.513649+0000","last_fullsized":"2023-12-08T20:55:04.513649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:41:41.172811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.406565+0000","last_change":"2023-12-08T20:54:54.927237+0000","last_active":"2023-12-08T20:55:04.406565+0000","last_peered":"2023-12-08T20:55:04.406565+0000","last_clean":"2023-12-08T20:55:04.406565+0000","last_became_active":"2023-12-08T20:54:54.926804+0000","last_became_peered":"2023-12-08T20:54:54.926804+0000","last_unstale":"2023-12-08T20:55:04.406565+0000","last_undegraded":"2023-12-08T20:55:04.406565+0000","last_fullsized":"2023-12-08T20:55:04.406565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:30:21.341630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508451+0000","last_change":"2023-12-08T20:54:54.931212+0000","last_active":"2023-12-08T20:55:04.508451+0000","last_peered":"2023-12-08T20:55:04.508451+0000","last_clean":"2023-12-08T20:55:04.508451+0000","last_became_active":"2023-12-08T20:54:54.930324+0000","last_became_peered":"2023-12-08T20:54:54.930324+0000","last_unstale":"2023-12-08T20:55:04.508451+0000","last_undegraded":"2023-12-08T20:55:04.508451+0000","last_fullsized":"2023-12-08T20:55:04.508451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:54.461219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.360041+0000","last_change":"2023-12-08T20:54:56.383879+0000","last_active":"2023-12-08T20:55:04.360041+0000","last_peered":"2023-12-08T20:55:04.360041+0000","last_clean":"2023-12-08T20:55:04.360041+0000","last_became_active":"2023-12-08T20:54:56.383467+0000","last_became_peered":"2023-12-08T20:54:56.383467+0000","last_unstale":"2023-12-08T20:55:04.360041+0000","last_undegraded":"2023-12-08T20:55:04.360041+0000","last_fullsized":"2023-12-08T20:55:04.360041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:59.236467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.553946+0000","last_change":"2023-12-08T20:55:04.541743+0000","last_active":"2023-12-08T20:55:05.553946+0000","last_peered":"2023-12-08T20:55:05.553946+0000","last_clean":"2023-12-08T20:55:05.553946+0000","last_became_active":"2023-12-08T20:55:04.536537+0000","last_became_peered":"2023-12-08T20:55:04.536537+0000","last_unstale":"2023-12-08T20:55:05.553946+0000","last_undegraded":"2023-12-08T20:55:05.553946+0000","last_fullsized":"2023-12-08T20:55:05.553946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:45.443252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.532310+0000","last_change":"2023-12-08T20:54:54.925711+0000","last_active":"2023-12-08T20:55:04.532310+0000","last_peered":"2023-12-08T20:55:04.532310+0000","last_clean":"2023-12-08T20:55:04.532310+0000","last_became_active":"2023-12-08T20:54:54.925229+0000","last_became_peered":"2023-12-08T20:54:54.925229+0000","last_unstale":"2023-12-08T20:55:04.532310+0000","last_undegraded":"2023-12-08T20:55:04.532310+0000","last_fullsized":"2023-12-08T20:55:04.532310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:33:15.472131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456015+0000","last_change":"2023-12-08T20:54:56.404755+0000","last_active":"2023-12-08T20:55:04.456015+0000","last_peered":"2023-12-08T20:55:04.456015+0000","last_clean":"2023-12-08T20:55:04.456015+0000","last_became_active":"2023-12-08T20:54:56.403996+0000","last_became_peered":"2023-12-08T20:54:56.403996+0000","last_unstale":"2023-12-08T20:55:04.456015+0000","last_undegraded":"2023-12-08T20:55:04.456015+0000","last_fullsized":"2023-12-08T20:55:04.456015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-08T20:55:05.416387+0000","last_change":"2023-12-08T20:55:04.523477+0000","last_active":"2023-12-08T20:55:05.416387+0000","last_peered":"2023-12-08T20:55:05.416387+0000","last_clean":"2023-12-08T20:55:05.416387+0000","last_became_active":"2023-12-08T20:55:04.523137+0000","last_became_peered":"2023-12-08T20:55:04.523137+0000","last_unstale":"2023-12-08T20:55:05.416387+0000","last_undegraded":"2023-12-08T20:55:05.416387+0000","last_fullsized":"2023-12-08T20:55:05.416387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499296+0000","last_change":"2023-12-08T20:54:56.379055+0000","last_active":"2023-12-08T20:55:04.499296+0000","last_peered":"2023-12-08T20:55:04.499296+0000","last_clean":"2023-12-08T20:55:04.499296+0000","last_became_active":"2023-12-08T20:54:56.373080+0000","last_became_peered":"2023-12-08T20:54:56.373080+0000","last_unstale":"2023-12-08T20:55:04.499296+0000","last_undegraded":"2023-12-08T20:55:04.499296+0000","last_fullsized":"2023-12-08T20:55:04.499296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.305471+0000","last_change":"2023-12-08T20:54:56.378688+0000","last_active":"2023-12-08T20:55:04.305471+0000","last_peered":"2023-12-08T20:55:04.305471+0000","last_clean":"2023-12-08T20:55:04.305471+0000","last_became_active":"2023-12-08T20:54:56.378154+0000","last_became_peered":"2023-12-08T20:54:56.378154+0000","last_unstale":"2023-12-08T20:55:04.305471+0000","last_undegraded":"2023-12-08T20:55:04.305471+0000","last_fullsized":"2023-12-08T20:55:04.305471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:22:06.625769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508260+0000","last_change":"2023-12-08T20:54:56.410526+0000","last_active":"2023-12-08T20:55:04.508260+0000","last_peered":"2023-12-08T20:55:04.508260+0000","last_clean":"2023-12-08T20:55:04.508260+0000","last_became_active":"2023-12-08T20:54:56.409863+0000","last_became_peered":"2023-12-08T20:54:56.409863+0000","last_unstale":"2023-12-08T20:55:04.508260+0000","last_undegraded":"2023-12-08T20:55:04.508260+0000","last_fullsized":"2023-12-08T20:55:04.508260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:10.542611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.525819+0000","last_change":"2023-12-08T20:54:56.408750+0000","last_active":"2023-12-08T20:55:04.525819+0000","last_peered":"2023-12-08T20:55:04.525819+0000","last_clean":"2023-12-08T20:55:04.525819+0000","last_became_active":"2023-12-08T20:54:56.408205+0000","last_became_peered":"2023-12-08T20:54:56.408205+0000","last_unstale":"2023-12-08T20:55:04.525819+0000","last_undegraded":"2023-12-08T20:55:04.525819+0000","last_fullsized":"2023-12-08T20:55:04.525819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:55.750494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.413106+0000","last_change":"2023-12-08T20:54:56.386660+0000","last_active":"2023-12-08T20:55:04.413106+0000","last_peered":"2023-12-08T20:55:04.413106+0000","last_clean":"2023-12-08T20:55:04.413106+0000","last_became_active":"2023-12-08T20:54:56.386344+0000","last_became_peered":"2023-12-08T20:54:56.386344+0000","last_unstale":"2023-12-08T20:55:04.413106+0000","last_undegraded":"2023-12-08T20:55:04.413106+0000","last_fullsized":"2023-12-08T20:55:04.413106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:33:27.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.408612+0000","last_change":"2023-12-08T20:54:56.367640+0000","last_active":"2023-12-08T20:55:04.408612+0000","last_peered":"2023-12-08T20:55:04.408612+0000","last_clean":"2023-12-08T20:55:04.408612+0000","last_became_active":"2023-12-08T20:54:56.366967+0000","last_became_peered":"2023-12-08T20:54:56.366967+0000","last_unstale":"2023-12-08T20:55:04.408612+0000","last_undegraded":"2023-12-08T20:55:04.408612+0000","last_fullsized":"2023-12-08T20:55:04.408612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:22:24.171129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499446+0000","last_change":"2023-12-08T20:54:56.376663+0000","last_active":"2023-12-08T20:55:04.499446+0000","last_peered":"2023-12-08T20:55:04.499446+0000","last_clean":"2023-12-08T20:55:04.499446+0000","last_became_active":"2023-12-08T20:54:56.371954+0000","last_became_peered":"2023-12-08T20:54:56.371954+0000","last_unstale":"2023-12-08T20:55:04.499446+0000","last_undegraded":"2023-12-08T20:55:04.499446+0000","last_fullsized":"2023-12-08T20:55:04.499446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540616+0000","last_change":"2023-12-08T20:54:56.410398+0000","last_active":"2023-12-08T20:55:04.540616+0000","last_peered":"2023-12-08T20:55:04.540616+0000","last_clean":"2023-12-08T20:55:04.540616+0000","last_became_active":"2023-12-08T20:54:56.409462+0000","last_became_peered":"2023-12-08T20:54:56.409462+0000","last_unstale":"2023-12-08T20:55:04.540616+0000","last_undegraded":"2023-12-08T20:55:04.540616+0000","last_fullsized":"2023-12-08T20:55:04.540616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:07:04.340773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507752+0000","last_change":"2023-12-08T20:54:56.415800+0000","last_active":"2023-12-08T20:55:04.507752+0000","last_peered":"2023-12-08T20:55:04.507752+0000","last_clean":"2023-12-08T20:55:04.507752+0000","last_became_active":"2023-12-08T20:54:56.415176+0000","last_became_peered":"2023-12-08T20:54:56.415176+0000","last_unstale":"2023-12-08T20:55:04.507752+0000","last_undegraded":"2023-12-08T20:55:04.507752+0000","last_fullsized":"2023-12-08T20:55:04.507752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:24:27.173941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.524613+0000","last_change":"2023-12-08T20:54:56.401521+0000","last_active":"2023-12-08T20:55:04.524613+0000","last_peered":"2023-12-08T20:55:04.524613+0000","last_clean":"2023-12-08T20:55:04.524613+0000","last_became_active":"2023-12-08T20:54:56.400980+0000","last_became_peered":"2023-12-08T20:54:56.400980+0000","last_unstale":"2023-12-08T20:55:04.524613+0000","last_undegraded":"2023-12-08T20:55:04.524613+0000","last_fullsized":"2023-12-08T20:55:04.524613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:42.093754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.455672+0000","last_change":"2023-12-08T20:54:56.387218+0000","last_active":"2023-12-08T20:55:04.455672+0000","last_peered":"2023-12-08T20:55:04.455672+0000","last_clean":"2023-12-08T20:55:04.455672+0000","last_became_active":"2023-12-08T20:54:56.386413+0000","last_became_peered":"2023-12-08T20:54:56.386413+0000","last_unstale":"2023-12-08T20:55:04.455672+0000","last_undegraded":"2023-12-08T20:55:04.455672+0000","last_fullsized":"2023-12-08T20:55:04.455672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.359808+0000","last_change":"2023-12-08T20:54:56.371962+0000","last_active":"2023-12-08T20:55:04.359808+0000","last_peered":"2023-12-08T20:55:04.359808+0000","last_clean":"2023-12-08T20:55:04.359808+0000","last_became_active":"2023-12-08T20:54:56.371456+0000","last_became_peered":"2023-12-08T20:54:56.371456+0000","last_unstale":"2023-12-08T20:55:04.359808+0000","last_undegraded":"2023-12-08T20:55:04.359808+0000","last_fullsized":"2023-12-08T20:55:04.359808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:01.725223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.505002+0000","last_change":"2023-12-08T20:54:56.381311+0000","last_active":"2023-12-08T20:55:04.505002+0000","last_peered":"2023-12-08T20:55:04.505002+0000","last_clean":"2023-12-08T20:55:04.505002+0000","last_became_active":"2023-12-08T20:54:56.380860+0000","last_became_peered":"2023-12-08T20:54:56.380860+0000","last_unstale":"2023-12-08T20:55:04.505002+0000","last_undegraded":"2023-12-08T20:55:04.505002+0000","last_fullsized":"2023-12-08T20:55:04.505002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:11:11.173329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.508899+0000","last_change":"2023-12-08T20:54:56.261370+0000","last_active":"2023-12-08T20:55:04.508899+0000","last_peered":"2023-12-08T20:55:04.508899+0000","last_clean":"2023-12-08T20:55:04.508899+0000","last_became_active":"2023-12-08T20:54:56.260387+0000","last_became_peered":"2023-12-08T20:54:56.260387+0000","last_unstale":"2023-12-08T20:55:04.508899+0000","last_undegraded":"2023-12-08T20:55:04.508899+0000","last_fullsized":"2023-12-08T20:55:04.508899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:17:07.046357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.306216+0000","last_change":"2023-12-08T20:54:56.388280+0000","last_active":"2023-12-08T20:55:04.306216+0000","last_peered":"2023-12-08T20:55:04.306216+0000","last_clean":"2023-12-08T20:55:04.306216+0000","last_became_active":"2023-12-08T20:54:56.387774+0000","last_became_peered":"2023-12-08T20:54:56.387774+0000","last_unstale":"2023-12-08T20:55:04.306216+0000","last_undegraded":"2023-12-08T20:55:04.306216+0000","last_fullsized":"2023-12-08T20:55:04.306216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:15:20.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.509158+0000","last_change":"2023-12-08T20:54:56.378804+0000","last_active":"2023-12-08T20:55:04.509158+0000","last_peered":"2023-12-08T20:55:04.509158+0000","last_clean":"2023-12-08T20:55:04.509158+0000","last_became_active":"2023-12-08T20:54:56.377029+0000","last_became_peered":"2023-12-08T20:54:56.377029+0000","last_unstale":"2023-12-08T20:55:04.509158+0000","last_undegraded":"2023-12-08T20:55:04.509158+0000","last_fullsized":"2023-12-08T20:55:04.509158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:55:29.247824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.507664+0000","last_change":"2023-12-08T20:54:56.372118+0000","last_active":"2023-12-08T20:55:04.507664+0000","last_peered":"2023-12-08T20:55:04.507664+0000","last_clean":"2023-12-08T20:55:04.507664+0000","last_became_active":"2023-12-08T20:54:56.370707+0000","last_became_peered":"2023-12-08T20:54:56.370707+0000","last_unstale":"2023-12-08T20:55:04.507664+0000","last_undegraded":"2023-12-08T20:55:04.507664+0000","last_fullsized":"2023-12-08T20:55:04.507664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:35.994091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.524392+0000","last_change":"2023-12-08T20:54:56.405033+0000","last_active":"2023-12-08T20:55:04.524392+0000","last_peered":"2023-12-08T20:55:04.524392+0000","last_clean":"2023-12-08T20:55:04.524392+0000","last_became_active":"2023-12-08T20:54:56.401544+0000","last_became_peered":"2023-12-08T20:54:56.401544+0000","last_unstale":"2023-12-08T20:55:04.524392+0000","last_undegraded":"2023-12-08T20:55:04.524392+0000","last_fullsized":"2023-12-08T20:55:04.524392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:59.303019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.406433+0000","last_change":"2023-12-08T20:54:56.366037+0000","last_active":"2023-12-08T20:55:04.406433+0000","last_peered":"2023-12-08T20:55:04.406433+0000","last_clean":"2023-12-08T20:55:04.406433+0000","last_became_active":"2023-12-08T20:54:56.365432+0000","last_became_peered":"2023-12-08T20:54:56.365432+0000","last_unstale":"2023-12-08T20:55:04.406433+0000","last_undegraded":"2023-12-08T20:55:04.406433+0000","last_fullsized":"2023-12-08T20:55:04.406433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:48:49.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.407208+0000","last_change":"2023-12-08T20:54:56.393022+0000","last_active":"2023-12-08T20:55:04.407208+0000","last_peered":"2023-12-08T20:55:04.407208+0000","last_clean":"2023-12-08T20:55:04.407208+0000","last_became_active":"2023-12-08T20:54:56.392408+0000","last_became_peered":"2023-12-08T20:54:56.392408+0000","last_unstale":"2023-12-08T20:55:04.407208+0000","last_undegraded":"2023-12-08T20:55:04.407208+0000","last_fullsized":"2023-12-08T20:55:04.407208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:30:22.435898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504911+0000","last_change":"2023-12-08T20:54:56.380654+0000","last_active":"2023-12-08T20:55:04.504911+0000","last_peered":"2023-12-08T20:55:04.504911+0000","last_clean":"2023-12-08T20:55:04.504911+0000","last_became_active":"2023-12-08T20:54:56.380137+0000","last_became_peered":"2023-12-08T20:54:56.380137+0000","last_unstale":"2023-12-08T20:55:04.504911+0000","last_undegraded":"2023-12-08T20:55:04.504911+0000","last_fullsized":"2023-12-08T20:55:04.504911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:47:59.833913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504032+0000","last_change":"2023-12-08T20:54:56.392997+0000","last_active":"2023-12-08T20:55:04.504032+0000","last_peered":"2023-12-08T20:55:04.504032+0000","last_clean":"2023-12-08T20:55:04.504032+0000","last_became_active":"2023-12-08T20:54:56.391299+0000","last_became_peered":"2023-12-08T20:54:56.391299+0000","last_unstale":"2023-12-08T20:55:04.504032+0000","last_undegraded":"2023-12-08T20:55:04.504032+0000","last_fullsized":"2023-12-08T20:55:04.504032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:37.195485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503945+0000","last_change":"2023-12-08T20:54:56.393461+0000","last_active":"2023-12-08T20:55:04.503945+0000","last_peered":"2023-12-08T20:55:04.503945+0000","last_clean":"2023-12-08T20:55:04.503945+0000","last_became_active":"2023-12-08T20:54:56.392708+0000","last_became_peered":"2023-12-08T20:54:56.392708+0000","last_unstale":"2023-12-08T20:55:04.503945+0000","last_undegraded":"2023-12-08T20:55:04.503945+0000","last_fullsized":"2023-12-08T20:55:04.503945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:44.697264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.456232+0000","last_change":"2023-12-08T20:54:56.319183+0000","last_active":"2023-12-08T20:55:04.456232+0000","last_peered":"2023-12-08T20:55:04.456232+0000","last_clean":"2023-12-08T20:55:04.456232+0000","last_became_active":"2023-12-08T20:54:56.318400+0000","last_became_peered":"2023-12-08T20:54:56.318400+0000","last_unstale":"2023-12-08T20:55:04.456232+0000","last_undegraded":"2023-12-08T20:55:04.456232+0000","last_fullsized":"2023-12-08T20:55:04.456232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.512685+0000","last_change":"2023-12-08T20:54:56.414028+0000","last_active":"2023-12-08T20:55:04.512685+0000","last_peered":"2023-12-08T20:55:04.512685+0000","last_clean":"2023-12-08T20:55:04.512685+0000","last_became_active":"2023-12-08T20:54:56.413220+0000","last_became_peered":"2023-12-08T20:54:56.413220+0000","last_unstale":"2023-12-08T20:55:04.512685+0000","last_undegraded":"2023-12-08T20:55:04.512685+0000","last_fullsized":"2023-12-08T20:55:04.512685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:23.917049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504035+0000","last_change":"2023-12-08T20:54:56.366203+0000","last_active":"2023-12-08T20:55:04.504035+0000","last_peered":"2023-12-08T20:55:04.504035+0000","last_clean":"2023-12-08T20:55:04.504035+0000","last_became_active":"2023-12-08T20:54:56.365448+0000","last_became_peered":"2023-12-08T20:54:56.365448+0000","last_unstale":"2023-12-08T20:55:04.504035+0000","last_undegraded":"2023-12-08T20:55:04.504035+0000","last_fullsized":"2023-12-08T20:55:04.504035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:10.405742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499135+0000","last_change":"2023-12-08T20:54:56.373847+0000","last_active":"2023-12-08T20:55:04.499135+0000","last_peered":"2023-12-08T20:55:04.499135+0000","last_clean":"2023-12-08T20:55:04.499135+0000","last_became_active":"2023-12-08T20:54:56.369574+0000","last_became_peered":"2023-12-08T20:54:56.369574+0000","last_unstale":"2023-12-08T20:55:04.499135+0000","last_undegraded":"2023-12-08T20:55:04.499135+0000","last_fullsized":"2023-12-08T20:55:04.499135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:10.078450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.503926+0000","last_change":"2023-12-08T20:54:56.411972+0000","last_active":"2023-12-08T20:55:04.503926+0000","last_peered":"2023-12-08T20:55:04.503926+0000","last_clean":"2023-12-08T20:55:04.503926+0000","last_became_active":"2023-12-08T20:54:56.411339+0000","last_became_peered":"2023-12-08T20:54:56.411339+0000","last_unstale":"2023-12-08T20:55:04.503926+0000","last_undegraded":"2023-12-08T20:55:04.503926+0000","last_fullsized":"2023-12-08T20:55:04.503926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:41.074875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.499247+0000","last_change":"2023-12-08T20:54:56.370763+0000","last_active":"2023-12-08T20:55:04.499247+0000","last_peered":"2023-12-08T20:55:04.499247+0000","last_clean":"2023-12-08T20:55:04.499247+0000","last_became_active":"2023-12-08T20:54:56.369650+0000","last_became_peered":"2023-12-08T20:54:56.369650+0000","last_unstale":"2023-12-08T20:55:04.499247+0000","last_undegraded":"2023-12-08T20:55:04.499247+0000","last_fullsized":"2023-12-08T20:55:04.499247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.540578+0000","last_change":"2023-12-08T20:54:56.409124+0000","last_active":"2023-12-08T20:55:04.540578+0000","last_peered":"2023-12-08T20:55:04.540578+0000","last_clean":"2023-12-08T20:55:04.540578+0000","last_became_active":"2023-12-08T20:54:56.408861+0000","last_became_peered":"2023-12-08T20:54:56.408861+0000","last_unstale":"2023-12-08T20:55:04.540578+0000","last_undegraded":"2023-12-08T20:55:04.540578+0000","last_fullsized":"2023-12-08T20:55:04.540578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:40:00.277639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.541600+0000","last_change":"2023-12-08T20:54:56.407010+0000","last_active":"2023-12-08T20:55:04.541600+0000","last_peered":"2023-12-08T20:55:04.541600+0000","last_clean":"2023-12-08T20:55:04.541600+0000","last_became_active":"2023-12-08T20:54:56.404697+0000","last_became_peered":"2023-12-08T20:54:56.404697+0000","last_unstale":"2023-12-08T20:55:04.541600+0000","last_undegraded":"2023-12-08T20:55:04.541600+0000","last_fullsized":"2023-12-08T20:55:04.541600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:58:49.474462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-08T20:55:04.504231+0000","last_change":"2023-12-08T20:54:56.378873+0000","last_active":"2023-12-08T20:55:04.504231+0000","last_peered":"2023-12-08T20:55:04.504231+0000","last_clean":"2023-12-08T20:55:04.504231+0000","last_became_active":"2023-12-08T20:54:56.377835+0000","last_became_peered":"2023-12-08T20:54:56.377835+0000","last_unstale":"2023-12-08T20:55:04.504231+0000","last_undegraded":"2023-12-08T20:55:04.504231+0000","last_fullsized":"2023-12-08T20:55:04.504231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:54:57.439693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":708223,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.876}]},{"osd":2,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.94899999999999995}]},{"osd":3,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.0660000000000001}]},{"osd":4,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.03},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.145},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.92400000000000004}]},{"osd":7,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.2170000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":118345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.628}]},{"osd":1,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.67100000000000004}]},{"osd":2,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.97299999999999998}]},{"osd":4,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.89700000000000002}]},{"osd":5,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.238}]},{"osd":6,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.298},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.167}]},{"osd":7,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.214},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.123}]}]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":121602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.36199999999999999}]},{"osd":1,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.46800000000000003}]},{"osd":3,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.62},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Dec 8 20:55:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.60599999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":364544,"data_stored":708201,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.45400000000000001}]},{"osd":4,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.73899999999999999}]},{"osd":5,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.496},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Dec 8 20:55:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.77300000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":303104,"data_stored":117819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.497}]},{"osd":4,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.73799999999999999}]},{"osd":5,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.0409999999999999}]},{"osd":7,"last update":"Fri Dec 8 20:55:14 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":0.78100000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":117887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.875}]},{"osd":3,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Dec 8 20:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.998}]},{"osd":5,"last update":"Fri Dec 8 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.135},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2549999999999999}]},{"osd":6,"last update":"Fri Dec 8 20:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.431}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":117763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.2589999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.82099999999999995}]},{"osd":3,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.3859999999999999}]},{"osd":4,"last update":"Fri Dec 8 20:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Dec 8 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.86899999999999999}]},{"osd":7,"last update":"Fri Dec 8 20:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.0980000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":122274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.71799999999999997}]},{"osd":1,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.753},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Fri Dec 8 20:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.0469999999999999}]},{"osd":6,"last update":"Fri Dec 8 20:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Dec 8 20:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.99199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T20:55:50.020 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-08T20:55:50.020 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-08T20:55:50.020 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-08T20:55:50.020 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-08T20:55:50.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.182+0000 7fa740e97640 1 Processor -- start 2023-12-08T20:55:50.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.182+0000 7fa740e97640 1 -- start start 2023-12-08T20:55:50.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.182+0000 7fa740e97640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa73c15ce00 0x7fa73c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.182+0000 7fa740e97640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa73c0c6790 0x7fa73c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.182+0000 7fa740e97640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c0c3950 con 0x7fa73c06ba90 2023-12-08T20:55:50.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.182+0000 7fa740e97640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c15dbb0 con 0x7fa73c15ce00 2023-12-08T20:55:50.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.182+0000 7fa740e97640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c15d8d0 con 0x7fa73c0c6790 2023-12-08T20:55:50.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.186+0000 7fa739d9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa73c0c6790 0x7fa73c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:50.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.186+0000 7fa73a59c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa73c15ce00 0x7fa73c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:50.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.186+0000 7fa739d9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa73c0c6790 0x7fa73c071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:44312/0 (socket says 172.21.15.53:44312) 2023-12-08T20:55:50.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.186+0000 7fa739d9b640 1 -- 172.21.15.53:0/1708945233 learned_addr learned my addr 172.21.15.53:0/1708945233 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:50.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.190+0000 7fa739d9b640 1 -- 172.21.15.53:0/1708945233 >> v2:172.21.15.146:3300/0 conn(0x7fa73c15ce00 msgr2=0x7fa73c15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:50.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.190+0000 7fa739d9b640 1 --2- 172.21.15.53:0/1708945233 >> v2:172.21.15.146:3300/0 conn(0x7fa73c15ce00 0x7fa73c15d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.190+0000 7fa739d9b640 1 -- 172.21.15.53:0/1708945233 >> v1:172.21.15.146:6789/0 conn(0x7fa73c06ba90 legacy=0x7fa73c1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:50.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.190+0000 7fa739d9b640 1 -- 172.21.15.53:0/1708945233 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0c7a40 con 0x7fa73c0c6790 2023-12-08T20:55:50.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.198+0000 7fa739d9b640 1 --2- 172.21.15.53:0/1708945233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa73c0c6790 0x7fa73c071e40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa724009870 tx=0x7fa72401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2996f69045cfa395 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:50.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa73959a640 1 -- 172.21.15.53:0/1708945233 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7240a8a30 con 0x7fa73c0c6790 2023-12-08T20:55:50.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa73959a640 1 -- 172.21.15.53:0/1708945233 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7240a8b90 con 0x7fa73c0c6790 2023-12-08T20:55:50.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa73959a640 1 -- 172.21.15.53:0/1708945233 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7240b0440 con 0x7fa73c0c6790 2023-12-08T20:55:50.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 -- 172.21.15.53:0/1708945233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa73c0c6790 msgr2=0x7fa73c071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:50.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 --2- 172.21.15.53:0/1708945233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa73c0c6790 0x7fa73c071e40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa724009870 tx=0x7fa72401ed30 comp rx=0 tx=0).stop 2023-12-08T20:55:50.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 -- 172.21.15.53:0/1708945233 shutdown_connections 2023-12-08T20:55:50.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 --2- 172.21.15.53:0/1708945233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa73c0c6790 0x7fa73c071e40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 --2- 172.21.15.53:0/1708945233 >> v2:172.21.15.146:3300/0 conn(0x7fa73c15ce00 0x7fa73c15d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 -- 172.21.15.53:0/1708945233 >> 172.21.15.53:0/1708945233 conn(0x7fa73c0cbb50 msgr2=0x7fa73c06f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:50.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 -- 172.21.15.53:0/1708945233 shutdown_connections 2023-12-08T20:55:50.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 -- 172.21.15.53:0/1708945233 wait complete. 2023-12-08T20:55:50.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 Processor -- start 2023-12-08T20:55:50.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 -- start start 2023-12-08T20:55:50.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa73c06ba90 0x7fa73c14a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa73c15ce00 0x7fa73c1ef090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa73c0c44d0 0x7fa73c147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0bc9a0 con 0x7fa73c0c44d0 2023-12-08T20:55:50.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c15b480 con 0x7fa73c15ce00 2023-12-08T20:55:50.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa740e97640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c15b760 con 0x7fa73c06ba90 2023-12-08T20:55:50.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.206+0000 7fa73ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa73c0c44d0 0x7fa73c147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:50.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.210+0000 7fa739d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa73c15ce00 0x7fa73c1ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:50.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.210+0000 7fa73ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa73c0c44d0 0x7fa73c147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56746/0 (socket says 172.21.15.53:56746) 2023-12-08T20:55:50.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.210+0000 7fa73a59c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa73c06ba90 0x7fa73c14a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:50.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.210+0000 7fa73ad9d640 1 -- 172.21.15.53:0/1897131057 learned_addr learned my addr 172.21.15.53:0/1897131057 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:50.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.214+0000 7fa73ad9d640 1 -- 172.21.15.53:0/1897131057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa73c06ba90 msgr2=0x7fa73c14a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:50.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.214+0000 7fa73ad9d640 1 --2- 172.21.15.53:0/1897131057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa73c06ba90 0x7fa73c14a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.214+0000 7fa73ad9d640 1 -- 172.21.15.53:0/1897131057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa73c15ce00 msgr2=0x7fa73c1ef090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:50.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.214+0000 7fa73ad9d640 1 --2- 172.21.15.53:0/1897131057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa73c15ce00 0x7fa73c1ef090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.214+0000 7fa73ad9d640 1 -- 172.21.15.53:0/1897131057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7240094d0 con 0x7fa73c0c44d0 2023-12-08T20:55:50.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.214+0000 7fa73ad9d640 1 --2- 172.21.15.53:0/1897131057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa73c0c44d0 0x7fa73c147e50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00c430 tx=0x7fa72c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:50.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.222+0000 7fa732ffd640 1 -- 172.21.15.53:0/1897131057 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c005220 con 0x7fa73c0c44d0 2023-12-08T20:55:50.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.222+0000 7fa732ffd640 1 -- 172.21.15.53:0/1897131057 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c005380 con 0x7fa73c0c44d0 2023-12-08T20:55:50.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.222+0000 7fa732ffd640 1 -- 172.21.15.53:0/1897131057 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c007270 con 0x7fa73c0c44d0 2023-12-08T20:55:50.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.222+0000 7fa740e97640 1 -- 172.21.15.53:0/1897131057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c15ba40 con 0x7fa73c0c44d0 2023-12-08T20:55:50.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.222+0000 7fa740e97640 1 -- 172.21.15.53:0/1897131057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c0ca870 con 0x7fa73c0c44d0 2023-12-08T20:55:50.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.222+0000 7fa740e97640 1 -- 172.21.15.53:0/1897131057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c074190 con 0x7fa73c0c44d0 2023-12-08T20:55:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.242+0000 7fa732ffd640 1 -- 172.21.15.53:0/1897131057 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa72c0073d0 con 0x7fa73c0c44d0 2023-12-08T20:55:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.242+0000 7fa732ffd640 1 --2- 172.21.15.53:0/1897131057 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa71c0664c0 0x7fa71c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.242+0000 7fa73a59c640 1 --2- 172.21.15.53:0/1897131057 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa71c0664c0 0x7fa71c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:50.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.246+0000 7fa73a59c640 1 --2- 172.21.15.53:0/1897131057 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa71c0664c0 0x7fa71c068980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa734011340 tx=0x7fa73400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:50.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.246+0000 7fa732ffd640 1 -- 172.21.15.53:0/1897131057 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa72c007680 con 0x7fa73c0c44d0 2023-12-08T20:55:50.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.554+0000 7fa732ffd640 1 -- 172.21.15.53:0/1897131057 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa72c050ca0 con 0x7fa73c0c44d0 2023-12-08T20:55:50.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.766+0000 7fa740e97640 1 -- 172.21.15.53:0/1897131057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa73c14e540 con 0x7fa73c0c44d0 2023-12-08T20:55:50.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa732ffd640 1 -- 172.21.15.53:0/1897131057 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa72c0542c0 con 0x7fa73c0c44d0 2023-12-08T20:55:50.781 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:50.781 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-08T20:55:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa740e97640 1 -- 172.21.15.53:0/1897131057 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa71c0664c0 msgr2=0x7fa71c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa740e97640 1 --2- 172.21.15.53:0/1897131057 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa71c0664c0 0x7fa71c068980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa734011340 tx=0x7fa73400b040 comp rx=0 tx=0).stop 2023-12-08T20:55:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa740e97640 1 -- 172.21.15.53:0/1897131057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa73c0c44d0 msgr2=0x7fa73c147e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa740e97640 1 --2- 172.21.15.53:0/1897131057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa73c0c44d0 0x7fa73c147e50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00c430 tx=0x7fa72c00c8f0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa740e97640 1 -- 172.21.15.53:0/1897131057 shutdown_connections 2023-12-08T20:55:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa740e97640 1 --2- 172.21.15.53:0/1897131057 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa71c0664c0 0x7fa71c068980 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa740e97640 1 --2- 172.21.15.53:0/1897131057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa73c0c44d0 0x7fa73c147e50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa740e97640 1 --2- 172.21.15.53:0/1897131057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa73c15ce00 0x7fa73c1ef090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa740e97640 1 --2- 172.21.15.53:0/1897131057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa73c06ba90 0x7fa73c14a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa740e97640 1 -- 172.21.15.53:0/1897131057 >> 172.21.15.53:0/1897131057 conn(0x7fa73c0cbb50 msgr2=0x7fa73c06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa740e97640 1 -- 172.21.15.53:0/1897131057 shutdown_connections 2023-12-08T20:55:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.782+0000 7fa740e97640 1 -- 172.21.15.53:0/1897131057 wait complete. 2023-12-08T20:55:50.801 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-08T20:55:50.801 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:55:50.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.930+0000 7fbceb82b640 1 Processor -- start 2023-12-08T20:55:50.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.930+0000 7fbceb82b640 1 -- start start 2023-12-08T20:55:50.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.930+0000 7fbceb82b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbce4156150 0x7fbce40c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.930+0000 7fbceb82b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce413eca0 con 0x7fbce40c50d0 2023-12-08T20:55:50.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.930+0000 7fbceb82b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce40c6f00 con 0x7fbce40c7670 2023-12-08T20:55:50.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.930+0000 7fbceb82b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce40c2ac0 con 0x7fbce4156150 2023-12-08T20:55:50.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.930+0000 7fbce95c7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbce40c50d0 0x7fbce40c5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53534/0 (socket says 172.21.15.53:53534) 2023-12-08T20:55:50.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.930+0000 7fbce95c7640 1 -- 172.21.15.53:0/3772293544 learned_addr learned my addr 172.21.15.53:0/3772293544 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:50.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.930+0000 7fbce8dc6640 1 --2- 172.21.15.53:0/3772293544 >> v2:172.21.15.146:3300/0 conn(0x7fbce4156150 0x7fbce40c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:50.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.934+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945296031 0 0) 0x7fbce413eca0 con 0x7fbce40c50d0 2023-12-08T20:55:50.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.934+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd0003530 con 0x7fbce40c50d0 2023-12-08T20:55:50.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2761545402 0 0) 0x7fbcd0003530 con 0x7fbce40c50d0 2023-12-08T20:55:50.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 >> v2:172.21.15.146:3300/0 conn(0x7fbce4156150 msgr2=0x7fbce40c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 --2- 172.21.15.53:0/3772293544 >> v2:172.21.15.146:3300/0 conn(0x7fbce4156150 0x7fbce40c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 >> v1:172.21.15.146:6789/0 conn(0x7fbce40c7670 legacy=0x7fbce4160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4061280 con 0x7fbce40c50d0 2023-12-08T20:55:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 149952835 0 0) 0x7fbce0001680 con 0x7fbce40c50d0 2023-12-08T20:55:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 >> v1:172.21.15.53:6789/0 conn(0x7fbce40c50d0 legacy=0x7fbce40c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 --2- 172.21.15.53:0/3772293544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcd00039d0 0x7fbcd0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 --2- 172.21.15.53:0/3772293544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 0x7fbcd0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 --2- 172.21.15.53:0/3772293544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd00052b0 0x7fbcd000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd000c1c0 con 0x7fbcd00047d0 2023-12-08T20:55:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd000c330 con 0x7fbcd00052b0 2023-12-08T20:55:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.938+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd000c4f0 con 0x7fbcd00039d0 2023-12-08T20:55:50.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.942+0000 7fbce8dc6640 1 --2- 172.21.15.53:0/3772293544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 0x7fbcd0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:50.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.946+0000 7fbce8dc6640 1 -- 172.21.15.53:0/3772293544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcd00039d0 msgr2=0x7fbcd0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:50.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.946+0000 7fbce8dc6640 1 --2- 172.21.15.53:0/3772293544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcd00039d0 0x7fbcd0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.946+0000 7fbce8dc6640 1 -- 172.21.15.53:0/3772293544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd00052b0 msgr2=0x7fbcd000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:50.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.946+0000 7fbce8dc6640 1 --2- 172.21.15.53:0/3772293544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd00052b0 0x7fbcd000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.946+0000 7fbce8dc6640 1 -- 172.21.15.53:0/3772293544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd0003530 con 0x7fbcd00047d0 2023-12-08T20:55:50.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.946+0000 7fbce9dc8640 1 -- 172.21.15.53:0/3772293544 reap_dead start 2023-12-08T20:55:50.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.950+0000 7fbce8dc6640 1 --2- 172.21.15.53:0/3772293544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 0x7fbcd0004c50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4006fd0 tx=0x7fbcd401c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafcf1c51cd912a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:50.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.954+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40aa620 con 0x7fbcd00047d0 2023-12-08T20:55:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.954+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd40aa780 con 0x7fbcd00047d0 2023-12-08T20:55:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.954+0000 7fbcdbfff640 1 -- 172.21.15.53:0/3772293544 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40aab30 con 0x7fbcd00047d0 2023-12-08T20:55:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 -- 172.21.15.53:0/3772293544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 msgr2=0x7fbcd0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 --2- 172.21.15.53:0/3772293544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 0x7fbcd0004c50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4006fd0 tx=0x7fbcd401c570 comp rx=0 tx=0).stop 2023-12-08T20:55:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 -- 172.21.15.53:0/3772293544 shutdown_connections 2023-12-08T20:55:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 --2- 172.21.15.53:0/3772293544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 0x7fbcd0004c50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 -- 172.21.15.53:0/3772293544 >> 172.21.15.53:0/3772293544 conn(0x7fbce40cb5c0 msgr2=0x7fbce40cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 -- 172.21.15.53:0/3772293544 shutdown_connections 2023-12-08T20:55:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 -- 172.21.15.53:0/3772293544 wait complete. 2023-12-08T20:55:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 Processor -- start 2023-12-08T20:55:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 -- start start 2023-12-08T20:55:50.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 0x7fbce40ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce4153790 0x7fbce4158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4159e60 0x7fbce4158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:50.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4153470 con 0x7fbcd00047d0 2023-12-08T20:55:50.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4152ff0 con 0x7fbce4159e60 2023-12-08T20:55:50.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbceb82b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4152a30 con 0x7fbce4153790 2023-12-08T20:55:50.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbce95c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 0x7fbce40ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:50.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbce95c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 0x7fbce40ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56778/0 (socket says 172.21.15.53:56778) 2023-12-08T20:55:50.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.958+0000 7fbce95c7640 1 -- 172.21.15.53:0/943016984 learned_addr learned my addr 172.21.15.53:0/943016984 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:50.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.962+0000 7fbce95c7640 1 -- 172.21.15.53:0/943016984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce4153790 msgr2=0x7fbce4158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:50.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.962+0000 7fbce95c7640 1 --2- 172.21.15.53:0/943016984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce4153790 0x7fbce4158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.962+0000 7fbce95c7640 1 -- 172.21.15.53:0/943016984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4159e60 msgr2=0x7fbce4158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:50.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.962+0000 7fbce95c7640 1 --2- 172.21.15.53:0/943016984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4159e60 0x7fbce4158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:50.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.962+0000 7fbce95c7640 1 -- 172.21.15.53:0/943016984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4152d10 con 0x7fbcd00047d0 2023-12-08T20:55:50.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.966+0000 7fbce95c7640 1 --2- 172.21.15.53:0/943016984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 0x7fbce40ca770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbce000c780 tx=0x7fbce000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:50.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.970+0000 7fbcd9ffb640 1 -- 172.21.15.53:0/943016984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00074e0 con 0x7fbcd00047d0 2023-12-08T20:55:50.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.970+0000 7fbcd9ffb640 1 -- 172.21.15.53:0/943016984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce000ce90 con 0x7fbcd00047d0 2023-12-08T20:55:50.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.970+0000 7fbcd9ffb640 1 -- 172.21.15.53:0/943016984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0004a10 con 0x7fbcd00047d0 2023-12-08T20:55:50.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.970+0000 7fbceb82b640 1 -- 172.21.15.53:0/943016984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce4158140 con 0x7fbcd00047d0 2023-12-08T20:55:50.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.970+0000 7fbceb82b640 1 -- 172.21.15.53:0/943016984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce415a3a0 con 0x7fbcd00047d0 2023-12-08T20:55:50.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:50.970+0000 7fbceb82b640 1 -- 172.21.15.53:0/943016984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce4074190 con 0x7fbcd00047d0 2023-12-08T20:55:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.270+0000 7fbcd9ffb640 1 -- 172.21.15.53:0/943016984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbce0004b70 con 0x7fbcd00047d0 2023-12-08T20:55:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.270+0000 7fbcd9ffb640 1 --2- 172.21.15.53:0/943016984 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbcc80664f0 0x7fbcc80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.274+0000 7fbce8dc6640 1 --2- 172.21.15.53:0/943016984 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbcc80664f0 0x7fbcc80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.274+0000 7fbce8dc6640 1 --2- 172.21.15.53:0/943016984 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbcc80664f0 0x7fbcc80689b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40ae000 tx=0x7fbcd4004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:51.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.306+0000 7fbcd9ffb640 1 -- 172.21.15.53:0/943016984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbce0004e20 con 0x7fbcd00047d0 2023-12-08T20:55:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.306+0000 7fbcd9ffb640 1 -- 172.21.15.53:0/943016984 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbce00513d0 con 0x7fbcd00047d0 2023-12-08T20:55:51.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.478+0000 7fbceb82b640 1 -- 172.21.15.53:0/943016984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbce40c45f0 con 0x7fbcd00047d0 2023-12-08T20:55:51.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.586+0000 7fbcd9ffb640 1 -- 172.21.15.53:0/943016984 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fbce0022070 con 0x7fbcd00047d0 2023-12-08T20:55:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:51.588 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:05.168215+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:55:51.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.590+0000 7fbceb82b640 1 -- 172.21.15.53:0/943016984 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbcc80664f0 msgr2=0x7fbcc80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.590+0000 7fbceb82b640 1 --2- 172.21.15.53:0/943016984 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbcc80664f0 0x7fbcc80689b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40ae000 tx=0x7fbcd4004740 comp rx=0 tx=0).stop 2023-12-08T20:55:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.590+0000 7fbceb82b640 1 -- 172.21.15.53:0/943016984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 msgr2=0x7fbce40ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.590+0000 7fbceb82b640 1 --2- 172.21.15.53:0/943016984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 0x7fbce40ca770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbce000c780 tx=0x7fbce000cc40 comp rx=0 tx=0).stop 2023-12-08T20:55:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.590+0000 7fbceb82b640 1 -- 172.21.15.53:0/943016984 shutdown_connections 2023-12-08T20:55:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.590+0000 7fbceb82b640 1 --2- 172.21.15.53:0/943016984 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbcc80664f0 0x7fbcc80689b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.590+0000 7fbceb82b640 1 --2- 172.21.15.53:0/943016984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4159e60 0x7fbce4158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.590+0000 7fbceb82b640 1 --2- 172.21.15.53:0/943016984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce4153790 0x7fbce4158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.590+0000 7fbceb82b640 1 --2- 172.21.15.53:0/943016984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcd00047d0 0x7fbce40ca770 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.590+0000 7fbceb82b640 1 -- 172.21.15.53:0/943016984 >> 172.21.15.53:0/943016984 conn(0x7fbce40cb5c0 msgr2=0x7fbce40c7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.590+0000 7fbceb82b640 1 -- 172.21.15.53:0/943016984 shutdown_connections 2023-12-08T20:55:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.590+0000 7fbceb82b640 1 -- 172.21.15.53:0/943016984 wait complete. 2023-12-08T20:55:51.613 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T20:54:13.707275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T20:54:52.929484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T20:54:54.529440+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T20:55:01.908380+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T20:55:51.614 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T20:55:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.742+0000 7f5eab4ec640 1 Processor -- start 2023-12-08T20:55:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.742+0000 7f5eab4ec640 1 -- start start 2023-12-08T20:55:51.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.746+0000 7f5eab4ec640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ea40c77a0 0x7f5ea4162e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:51.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.746+0000 7f5eab4ec640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea40c6c00 con 0x7f5ea41518f0 2023-12-08T20:55:51.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.746+0000 7f5eab4ec640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea40c41b0 con 0x7f5ea40c94b0 2023-12-08T20:55:51.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.746+0000 7f5eab4ec640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea40c3920 con 0x7f5ea40c77a0 2023-12-08T20:55:51.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.746+0000 7f5ea9a89640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ea40c77a0 0x7f5ea4162e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:51.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.746+0000 7f5ea9288640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5ea41518f0 0x7f5ea406a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59810/0 (socket says 172.21.15.53:59810) 2023-12-08T20:55:51.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.746+0000 7f5ea9288640 1 -- 172.21.15.53:0/2324493936 learned_addr learned my addr 172.21.15.53:0/2324493936 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:51.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.750+0000 7f5ea9a89640 1 -- 172.21.15.53:0/2324493936 >> v1:172.21.15.146:6789/0 conn(0x7f5ea40c94b0 legacy=0x7f5ea40c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:51.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.750+0000 7f5ea9a89640 1 -- 172.21.15.53:0/2324493936 >> v1:172.21.15.53:6789/0 conn(0x7f5ea41518f0 legacy=0x7f5ea406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:51.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.750+0000 7f5ea9a89640 1 -- 172.21.15.53:0/2324493936 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4151cd0 con 0x7f5ea40c77a0 2023-12-08T20:55:51.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.754+0000 7f5ea9a89640 1 --2- 172.21.15.53:0/2324493936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ea40c77a0 0x7f5ea4162e50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009d90 tx=0x7f5e9c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb22ca8205b2706f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.758+0000 7f5e9bfff640 1 -- 172.21.15.53:0/2324493936 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c0a5940 con 0x7f5ea40c77a0 2023-12-08T20:55:51.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.758+0000 7f5e9bfff640 1 -- 172.21.15.53:0/2324493936 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c0a5aa0 con 0x7f5ea40c77a0 2023-12-08T20:55:51.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.758+0000 7f5e9bfff640 1 -- 172.21.15.53:0/2324493936 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c0a5e30 con 0x7f5ea40c77a0 2023-12-08T20:55:51.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 -- 172.21.15.53:0/2324493936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ea40c77a0 msgr2=0x7f5ea4162e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:51.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 --2- 172.21.15.53:0/2324493936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ea40c77a0 0x7f5ea4162e50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009d90 tx=0x7f5e9c01c880 comp rx=0 tx=0).stop 2023-12-08T20:55:51.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 -- 172.21.15.53:0/2324493936 shutdown_connections 2023-12-08T20:55:51.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 --2- 172.21.15.53:0/2324493936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ea40c77a0 0x7f5ea4162e50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:51.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 -- 172.21.15.53:0/2324493936 >> 172.21.15.53:0/2324493936 conn(0x7f5ea40c8990 msgr2=0x7f5ea40c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:51.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 -- 172.21.15.53:0/2324493936 shutdown_connections 2023-12-08T20:55:51.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 -- 172.21.15.53:0/2324493936 wait complete. 2023-12-08T20:55:51.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 Processor -- start 2023-12-08T20:55:51.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 -- start start 2023-12-08T20:55:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ea40c77a0 0x7f5ea4144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ea40c94b0 0x7f5ea41f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ea41518f0 0x7f5ea4143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea41f33f0 con 0x7f5ea40c77a0 2023-12-08T20:55:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4155b40 con 0x7f5ea41518f0 2023-12-08T20:55:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5eab4ec640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4155e10 con 0x7f5ea40c94b0 2023-12-08T20:55:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5ea9288640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ea40c77a0 0x7f5ea4144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5ea9288640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ea40c77a0 0x7f5ea4144a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59236/0 (socket says 172.21.15.53:59236) 2023-12-08T20:55:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.762+0000 7f5ea9288640 1 -- 172.21.15.53:0/4154713044 learned_addr learned my addr 172.21.15.53:0/4154713044 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:51.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.766+0000 7f5ea9288640 1 -- 172.21.15.53:0/4154713044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ea40c94b0 msgr2=0x7f5ea41f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:51.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.766+0000 7f5ea9288640 1 --2- 172.21.15.53:0/4154713044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ea40c94b0 0x7f5ea41f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:51.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.766+0000 7f5ea9288640 1 -- 172.21.15.53:0/4154713044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ea41518f0 msgr2=0x7f5ea4143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:51.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.766+0000 7f5ea9288640 1 --2- 172.21.15.53:0/4154713044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ea41518f0 0x7f5ea4143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:51.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.766+0000 7f5ea9288640 1 -- 172.21.15.53:0/4154713044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c009a70 con 0x7f5ea40c77a0 2023-12-08T20:55:51.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.770+0000 7f5ea9288640 1 --2- 172.21.15.53:0/4154713044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ea40c77a0 0x7f5ea4144a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400c370 tx=0x7f5e9400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:51.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.774+0000 7f5e99ffb640 1 -- 172.21.15.53:0/4154713044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94005cf0 con 0x7f5ea40c77a0 2023-12-08T20:55:51.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.774+0000 7f5e99ffb640 1 -- 172.21.15.53:0/4154713044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e94005e50 con 0x7f5ea40c77a0 2023-12-08T20:55:51.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.774+0000 7f5e99ffb640 1 -- 172.21.15.53:0/4154713044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e940072d0 con 0x7f5ea40c77a0 2023-12-08T20:55:51.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.774+0000 7f5eab4ec640 1 -- 172.21.15.53:0/4154713044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea41560f0 con 0x7f5ea40c77a0 2023-12-08T20:55:51.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.774+0000 7f5eab4ec640 1 -- 172.21.15.53:0/4154713044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea41f3690 con 0x7f5ea40c77a0 2023-12-08T20:55:51.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.774+0000 7f5eab4ec640 1 -- 172.21.15.53:0/4154713044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea40677c0 con 0x7f5ea40c77a0 2023-12-08T20:55:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.794+0000 7f5e99ffb640 1 -- 172.21.15.53:0/4154713044 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5e94007430 con 0x7f5ea40c77a0 2023-12-08T20:55:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.798+0000 7f5e99ffb640 1 --2- 172.21.15.53:0/4154713044 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5e880664f0 0x7f5e880689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.798+0000 7f5ea8a87640 1 --2- 172.21.15.53:0/4154713044 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5e880664f0 0x7f5e880689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:51.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.798+0000 7f5ea8a87640 1 --2- 172.21.15.53:0/4154713044 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5e880664f0 0x7f5e880689b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0007fd0 tx=0x7f5ea00079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:51.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:51.802+0000 7f5e99ffb640 1 -- 172.21.15.53:0/4154713044 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5e94054910 con 0x7f5ea40c77a0 2023-12-08T20:55:52.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.086+0000 7f5e99ffb640 1 -- 172.21.15.53:0/4154713044 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5e94050c50 con 0x7f5ea40c77a0 2023-12-08T20:55:52.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.270+0000 7f5eab4ec640 1 -- 172.21.15.53:0/4154713044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ea4074190 con 0x7f5ea40c77a0 2023-12-08T20:55:52.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.278+0000 7f5e99ffb640 1 -- 172.21.15.53:0/4154713044 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e940170a0 con 0x7f5ea40c77a0 2023-12-08T20:55:52.278 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-12-08T20:55:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.278+0000 7f5eab4ec640 1 -- 172.21.15.53:0/4154713044 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5e880664f0 msgr2=0x7f5e880689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.278+0000 7f5eab4ec640 1 --2- 172.21.15.53:0/4154713044 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5e880664f0 0x7f5e880689b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0007fd0 tx=0x7f5ea00079a0 comp rx=0 tx=0).stop 2023-12-08T20:55:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.278+0000 7f5eab4ec640 1 -- 172.21.15.53:0/4154713044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ea40c77a0 msgr2=0x7f5ea4144a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.278+0000 7f5eab4ec640 1 --2- 172.21.15.53:0/4154713044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ea40c77a0 0x7f5ea4144a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400c370 tx=0x7f5e9400c830 comp rx=0 tx=0).stop 2023-12-08T20:55:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.278+0000 7f5eab4ec640 1 -- 172.21.15.53:0/4154713044 shutdown_connections 2023-12-08T20:55:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.278+0000 7f5eab4ec640 1 --2- 172.21.15.53:0/4154713044 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5e880664f0 0x7f5e880689b0 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0007fd0 tx=0x7f5ea00079a0 comp rx=0 tx=0).stop 2023-12-08T20:55:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.278+0000 7f5eab4ec640 1 --2- 172.21.15.53:0/4154713044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ea41518f0 0x7f5ea4143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.278+0000 7f5eab4ec640 1 --2- 172.21.15.53:0/4154713044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ea40c94b0 0x7f5ea41f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.278+0000 7f5eab4ec640 1 --2- 172.21.15.53:0/4154713044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ea40c77a0 0x7f5ea4144a70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.278+0000 7f5eab4ec640 1 -- 172.21.15.53:0/4154713044 >> 172.21.15.53:0/4154713044 conn(0x7f5ea40c8990 msgr2=0x7f5ea40cabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.282+0000 7f5eab4ec640 1 -- 172.21.15.53:0/4154713044 shutdown_connections 2023-12-08T20:55:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.282+0000 7f5eab4ec640 1 -- 172.21.15.53:0/4154713044 wait complete. 2023-12-08T20:55:52.298 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T20:55:52.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.430+0000 7fc27e89e640 1 Processor -- start 2023-12-08T20:55:52.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.434+0000 7fc27e89e640 1 -- start start 2023-12-08T20:55:52.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.434+0000 7fc27e89e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc278071140 0x7fc278157290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:52.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.434+0000 7fc27e89e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc278157e90 con 0x7fc27806f110 2023-12-08T20:55:52.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.434+0000 7fc27e89e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc278158170 con 0x7fc27806ed30 2023-12-08T20:55:52.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.434+0000 7fc27e89e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780c6000 con 0x7fc278071140 2023-12-08T20:55:52.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.434+0000 7fc2777fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc27806f110 0x7fc27806d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59816/0 (socket says 172.21.15.53:59816) 2023-12-08T20:55:52.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.434+0000 7fc2777fe640 1 -- 172.21.15.53:0/1127792385 learned_addr learned my addr 172.21.15.53:0/1127792385 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:52.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.434+0000 7fc27ce3b640 1 --2- 172.21.15.53:0/1127792385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc278071140 0x7fc278157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:52.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.438+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759838165 0 0) 0x7fc278157e90 con 0x7fc27806f110 2023-12-08T20:55:52.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.438+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc264003530 con 0x7fc27806f110 2023-12-08T20:55:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.438+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1815443529 0 0) 0x7fc264003530 con 0x7fc27806f110 2023-12-08T20:55:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.438+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc278071140 msgr2=0x7fc278157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.438+0000 7fc276ffd640 1 --2- 172.21.15.53:0/1127792385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc278071140 0x7fc278157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.438+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 >> v1:172.21.15.146:6789/0 conn(0x7fc27806ed30 legacy=0x7fc2780c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.442+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27815a920 con 0x7fc27806f110 2023-12-08T20:55:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.442+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 149952835 0 0) 0x7fc260001a00 con 0x7fc27806f110 2023-12-08T20:55:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.442+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 >> v1:172.21.15.53:6789/0 conn(0x7fc27806f110 legacy=0x7fc27806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.442+0000 7fc276ffd640 1 --2- 172.21.15.53:0/1127792385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc278071140 0x7fc2640039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.442+0000 7fc276ffd640 1 --2- 172.21.15.53:0/1127792385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc264003f80 0x7fc2640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.442+0000 7fc276ffd640 1 --2- 172.21.15.53:0/1127792385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc264004d10 0x7fc264005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.442+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780c6000 con 0x7fc264003f80 2023-12-08T20:55:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.442+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26400bb60 con 0x7fc264004d10 2023-12-08T20:55:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.442+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26400bd20 con 0x7fc278071140 2023-12-08T20:55:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.446+0000 7fc2777fe640 1 --2- 172.21.15.53:0/1127792385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc264003f80 0x7fc2640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.446+0000 7fc27ce3b640 1 --2- 172.21.15.53:0/1127792385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc264004d10 0x7fc264005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:52.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.446+0000 7fc2777fe640 1 -- 172.21.15.53:0/1127792385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc278071140 msgr2=0x7fc2640039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:52.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.446+0000 7fc2777fe640 1 --2- 172.21.15.53:0/1127792385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc278071140 0x7fc2640039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:52.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.446+0000 7fc2777fe640 1 -- 172.21.15.53:0/1127792385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc264004d10 msgr2=0x7fc264005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:52.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.446+0000 7fc2777fe640 1 --2- 172.21.15.53:0/1127792385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc264004d10 0x7fc264005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:52.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.446+0000 7fc2777fe640 1 -- 172.21.15.53:0/1127792385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc264003530 con 0x7fc264003f80 2023-12-08T20:55:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.450+0000 7fc2777fe640 1 --2- 172.21.15.53:0/1127792385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc264003f80 0x7fc2640047d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc27806f520 tx=0x7fc26001d180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfdd4367af9a6ce server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:52.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.458+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2600ad630 con 0x7fc264003f80 2023-12-08T20:55:52.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.458+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2600a8070 con 0x7fc264003f80 2023-12-08T20:55:52.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.458+0000 7fc276ffd640 1 -- 172.21.15.53:0/1127792385 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2600ada90 con 0x7fc264003f80 2023-12-08T20:55:52.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.458+0000 7fc27e89e640 1 -- 172.21.15.53:0/1127792385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc264003f80 msgr2=0x7fc2640047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:52.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.458+0000 7fc27e89e640 1 --2- 172.21.15.53:0/1127792385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc264003f80 0x7fc2640047d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc27806f520 tx=0x7fc26001d180 comp rx=0 tx=0).stop 2023-12-08T20:55:52.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.458+0000 7fc27ce3b640 1 -- 172.21.15.53:0/1127792385 reap_dead start 2023-12-08T20:55:52.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.458+0000 7fc27e89e640 1 -- 172.21.15.53:0/1127792385 shutdown_connections 2023-12-08T20:55:52.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.458+0000 7fc27e89e640 1 -- 172.21.15.53:0/1127792385 >> 172.21.15.53:0/1127792385 conn(0x7fc2780caef0 msgr2=0x7fc2780cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:52.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.458+0000 7fc27e89e640 1 -- 172.21.15.53:0/1127792385 shutdown_connections 2023-12-08T20:55:52.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.458+0000 7fc27e89e640 1 -- 172.21.15.53:0/1127792385 wait complete. 2023-12-08T20:55:52.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc27e89e640 1 Processor -- start 2023-12-08T20:55:52.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc27e89e640 1 -- start start 2023-12-08T20:55:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc27e89e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc264003f80 0x7fc278155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc27e89e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc278155100 0x7fc2780c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc27e89e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc278071d80 0x7fc2781521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc27e89e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2781f0a80 con 0x7fc278155100 2023-12-08T20:55:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc27e89e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2781547b0 con 0x7fc264003f80 2023-12-08T20:55:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc27e89e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2781560c0 con 0x7fc278071d80 2023-12-08T20:55:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc2777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc278155100 0x7fc2780c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc2777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc278155100 0x7fc2780c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59264/0 (socket says 172.21.15.53:59264) 2023-12-08T20:55:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc27ce3b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc278071d80 0x7fc2781521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc2777fe640 1 -- 172.21.15.53:0/269233067 learned_addr learned my addr 172.21.15.53:0/269233067 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.462+0000 7fc277fff640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc264003f80 0x7fc278155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.466+0000 7fc2777fe640 1 -- 172.21.15.53:0/269233067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc278071d80 msgr2=0x7fc2781521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.466+0000 7fc2777fe640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc278071d80 0x7fc2781521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.466+0000 7fc2777fe640 1 -- 172.21.15.53:0/269233067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc264003f80 msgr2=0x7fc278155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.466+0000 7fc2777fe640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc264003f80 0x7fc278155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.466+0000 7fc2777fe640 1 -- 172.21.15.53:0/269233067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2781f0150 con 0x7fc278155100 2023-12-08T20:55:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.470+0000 7fc2777fe640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc278155100 0x7fc2780c42c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc26001cfb0 tx=0x7fc264005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.474+0000 7fc274ff9640 1 -- 172.21.15.53:0/269233067 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260004d70 con 0x7fc278155100 2023-12-08T20:55:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.474+0000 7fc274ff9640 1 -- 172.21.15.53:0/269233067 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2600ad430 con 0x7fc278155100 2023-12-08T20:55:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.474+0000 7fc274ff9640 1 -- 172.21.15.53:0/269233067 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2600ad7c0 con 0x7fc278155100 2023-12-08T20:55:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.474+0000 7fc27e89e640 1 -- 172.21.15.53:0/269233067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2781f0430 con 0x7fc278155100 2023-12-08T20:55:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.474+0000 7fc27e89e640 1 -- 172.21.15.53:0/269233067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2781f0f10 con 0x7fc278155100 2023-12-08T20:55:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.474+0000 7fc27e89e640 1 -- 172.21.15.53:0/269233067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2781f0c30 con 0x7fc278155100 2023-12-08T20:55:52.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.774+0000 7fc274ff9640 1 -- 172.21.15.53:0/269233067 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2600aa030 con 0x7fc278155100 2023-12-08T20:55:52.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.774+0000 7fc274ff9640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc258066470 0x7fc258068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:52.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.774+0000 7fc277fff640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc258066470 0x7fc258068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:52.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.774+0000 7fc277fff640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc258066470 0x7fc258068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc268007fd0 tx=0x7fc268009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:52.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.806+0000 7fc274ff9640 1 -- 172.21.15.53:0/269233067 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc2600ef280 con 0x7fc278155100 2023-12-08T20:55:52.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.806+0000 7fc274ff9640 1 -- 172.21.15.53:0/269233067 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2600eb5c0 con 0x7fc278155100 2023-12-08T20:55:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.978+0000 7fc27e89e640 1 -- 172.21.15.53:0/269233067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2781f0c30 con 0x7fc278155100 2023-12-08T20:55:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.994+0000 7fc274ff9640 1 -- 172.21.15.53:0/269233067 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc2600bc020 con 0x7fc278155100 2023-12-08T20:55:52.993 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-12-08T20:55:53.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.998+0000 7fc27e89e640 1 -- 172.21.15.53:0/269233067 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc258066470 msgr2=0x7fc258068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:53.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.998+0000 7fc27e89e640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc258066470 0x7fc258068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc268007fd0 tx=0x7fc268009040 comp rx=0 tx=0).stop 2023-12-08T20:55:53.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.998+0000 7fc27e89e640 1 -- 172.21.15.53:0/269233067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc278155100 msgr2=0x7fc2780c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:53.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.998+0000 7fc27e89e640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc278155100 0x7fc2780c42c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc26001cfb0 tx=0x7fc264005800 comp rx=0 tx=0).stop 2023-12-08T20:55:53.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.998+0000 7fc27e89e640 1 -- 172.21.15.53:0/269233067 shutdown_connections 2023-12-08T20:55:53.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.998+0000 7fc27e89e640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc258066470 0x7fc258068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.998+0000 7fc27e89e640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc278071d80 0x7fc2781521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.998+0000 7fc27e89e640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc278155100 0x7fc2780c42c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.998+0000 7fc27e89e640 1 --2- 172.21.15.53:0/269233067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc264003f80 0x7fc278155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.998+0000 7fc27e89e640 1 -- 172.21.15.53:0/269233067 >> 172.21.15.53:0/269233067 conn(0x7fc2780caef0 msgr2=0x7fc27806cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:53.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.998+0000 7fc27e89e640 1 -- 172.21.15.53:0/269233067 shutdown_connections 2023-12-08T20:55:53.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:52.998+0000 7fc27e89e640 1 -- 172.21.15.53:0/269233067 wait complete. 2023-12-08T20:55:53.015 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T20:55:53.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.146+0000 7f3f89f1e640 1 Processor -- start 2023-12-08T20:55:53.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.146+0000 7f3f89f1e640 1 -- start start 2023-12-08T20:55:53.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.146+0000 7f3f89f1e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f84153760 0x7f3f84061a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:53.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.146+0000 7f3f89f1e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f840ca680 0x7f3f8406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:53.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.146+0000 7f3f89f1e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f840c9870 con 0x7f3f84153b40 2023-12-08T20:55:53.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.146+0000 7f3f89f1e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f840cb6a0 con 0x7f3f840ca680 2023-12-08T20:55:53.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.146+0000 7f3f89f1e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f840cabe0 con 0x7f3f84153760 2023-12-08T20:55:53.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.146+0000 7f3f837fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f84153760 0x7f3f84061a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.150+0000 7f3f837fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f84153760 0x7f3f84061a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:58292/0 (socket says 172.21.15.53:58292) 2023-12-08T20:55:53.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.150+0000 7f3f837fe640 1 -- 172.21.15.53:0/4277823707 learned_addr learned my addr 172.21.15.53:0/4277823707 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:53.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.150+0000 7f3f83fff640 1 --2- 172.21.15.53:0/4277823707 >> v2:172.21.15.53:3300/0 conn(0x7f3f840ca680 0x7f3f8406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:53.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.154+0000 7f3f83fff640 1 -- 172.21.15.53:0/4277823707 >> v2:172.21.15.146:3300/0 conn(0x7f3f84153760 msgr2=0x7f3f84061a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.154+0000 7f3f83fff640 1 --2- 172.21.15.53:0/4277823707 >> v2:172.21.15.146:3300/0 conn(0x7f3f84153760 0x7f3f84061a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.154+0000 7f3f83fff640 1 -- 172.21.15.53:0/4277823707 >> v1:172.21.15.146:6789/0 conn(0x7f3f84153b40 legacy=0x7f3f840cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.154+0000 7f3f83fff640 1 -- 172.21.15.53:0/4277823707 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8415d670 con 0x7f3f840ca680 2023-12-08T20:55:53.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.158+0000 7f3f83fff640 1 --2- 172.21.15.53:0/4277823707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f840ca680 0x7f3f8406bce0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3f740097c0 tx=0x7f3f7401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1771e2fe0f6944 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:53.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.162+0000 7f3f827fc640 1 -- 172.21.15.53:0/4277823707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740a88f0 con 0x7f3f840ca680 2023-12-08T20:55:53.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.162+0000 7f3f827fc640 1 -- 172.21.15.53:0/4277823707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f740a8a50 con 0x7f3f840ca680 2023-12-08T20:55:53.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.162+0000 7f3f827fc640 1 -- 172.21.15.53:0/4277823707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740a8de0 con 0x7f3f840ca680 2023-12-08T20:55:53.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.162+0000 7f3f89f1e640 1 -- 172.21.15.53:0/4277823707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f840ca680 msgr2=0x7f3f8406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:53.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.162+0000 7f3f89f1e640 1 --2- 172.21.15.53:0/4277823707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f840ca680 0x7f3f8406bce0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3f740097c0 tx=0x7f3f7401ebf0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.162+0000 7f3f89f1e640 1 -- 172.21.15.53:0/4277823707 shutdown_connections 2023-12-08T20:55:53.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.162+0000 7f3f89f1e640 1 --2- 172.21.15.53:0/4277823707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f840ca680 0x7f3f8406bce0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.162+0000 7f3f89f1e640 1 --2- 172.21.15.53:0/4277823707 >> v2:172.21.15.146:3300/0 conn(0x7f3f84153760 0x7f3f84061a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.162+0000 7f3f89f1e640 1 -- 172.21.15.53:0/4277823707 >> 172.21.15.53:0/4277823707 conn(0x7f3f8408b5c0 msgr2=0x7f3f84060fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:53.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.162+0000 7f3f89f1e640 1 -- 172.21.15.53:0/4277823707 shutdown_connections 2023-12-08T20:55:53.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.162+0000 7f3f89f1e640 1 -- 172.21.15.53:0/4277823707 wait complete. 2023-12-08T20:55:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.166+0000 7f3f89f1e640 1 Processor -- start 2023-12-08T20:55:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.166+0000 7f3f89f1e640 1 -- start start 2023-12-08T20:55:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.166+0000 7f3f89f1e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f840ca680 0x7f3f8415bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:53.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.166+0000 7f3f89f1e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f84153760 0x7f3f840cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:53.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.166+0000 7f3f89f1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f840cd210 0x7f3f841436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:53.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.166+0000 7f3f89f1e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f841ef0a0 con 0x7f3f840cd210 2023-12-08T20:55:53.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.166+0000 7f3f89f1e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f84156740 con 0x7f3f84153760 2023-12-08T20:55:53.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.166+0000 7f3f89f1e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f841556a0 con 0x7f3f840ca680 2023-12-08T20:55:53.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.166+0000 7f3f837fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f840ca680 0x7f3f8415bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:53.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.166+0000 7f3f83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f840cd210 0x7f3f841436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:53.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.166+0000 7f3f83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f840cd210 0x7f3f841436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59278/0 (socket says 172.21.15.53:59278) 2023-12-08T20:55:53.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.166+0000 7f3f83fff640 1 -- 172.21.15.53:0/331722779 learned_addr learned my addr 172.21.15.53:0/331722779 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:53.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.170+0000 7f3f83fff640 1 -- 172.21.15.53:0/331722779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f840ca680 msgr2=0x7f3f8415bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:53.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.170+0000 7f3f83fff640 1 --2- 172.21.15.53:0/331722779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f840ca680 0x7f3f8415bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.170+0000 7f3f83fff640 1 -- 172.21.15.53:0/331722779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f84153760 msgr2=0x7f3f840cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:53.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.170+0000 7f3f83fff640 1 --2- 172.21.15.53:0/331722779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f84153760 0x7f3f840cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.170+0000 7f3f83fff640 1 -- 172.21.15.53:0/331722779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f74009420 con 0x7f3f840cd210 2023-12-08T20:55:53.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.174+0000 7f3f83fff640 1 --2- 172.21.15.53:0/331722779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f840cd210 0x7f3f841436b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3f7401d2a0 tx=0x7f3f7401b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:53.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.178+0000 7f3f6bfff640 1 -- 172.21.15.53:0/331722779 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740b0850 con 0x7f3f840cd210 2023-12-08T20:55:53.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.178+0000 7f3f6bfff640 1 -- 172.21.15.53:0/331722779 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f740b09b0 con 0x7f3f840cd210 2023-12-08T20:55:53.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.178+0000 7f3f89f1e640 1 -- 172.21.15.53:0/331722779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f84155980 con 0x7f3f840cd210 2023-12-08T20:55:53.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.178+0000 7f3f6bfff640 1 -- 172.21.15.53:0/331722779 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740b0d60 con 0x7f3f840cd210 2023-12-08T20:55:53.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.178+0000 7f3f89f1e640 1 -- 172.21.15.53:0/331722779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f84155f40 con 0x7f3f840cd210 2023-12-08T20:55:53.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.182+0000 7f3f89f1e640 1 -- 172.21.15.53:0/331722779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8414a160 con 0x7f3f840cd210 2023-12-08T20:55:53.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.202+0000 7f3f6bfff640 1 -- 172.21.15.53:0/331722779 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f740b7040 con 0x7f3f840cd210 2023-12-08T20:55:53.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.202+0000 7f3f6bfff640 1 --2- 172.21.15.53:0/331722779 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3f70066470 0x7f3f70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:53.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.202+0000 7f3f837fe640 1 --2- 172.21.15.53:0/331722779 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3f70066470 0x7f3f70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:53.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.202+0000 7f3f837fe640 1 --2- 172.21.15.53:0/331722779 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3f70066470 0x7f3f70068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0113e0 tx=0x7f3f7c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:53.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.522+0000 7f3f6bfff640 1 -- 172.21.15.53:0/331722779 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f740f3560 con 0x7f3f840cd210 2023-12-08T20:55:53.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.522+0000 7f3f6bfff640 1 -- 172.21.15.53:0/331722779 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f740ef1a0 con 0x7f3f840cd210 2023-12-08T20:55:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.730+0000 7f3f89f1e640 1 -- 172.21.15.53:0/331722779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f8414a160 con 0x7f3f840cd210 2023-12-08T20:55:53.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f6bfff640 1 -- 172.21.15.53:0/331722779 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f740b5070 con 0x7f3f840cd210 2023-12-08T20:55:53.768 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-12-08T20:55:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f89f1e640 1 -- 172.21.15.53:0/331722779 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3f70066470 msgr2=0x7f3f70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f89f1e640 1 --2- 172.21.15.53:0/331722779 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3f70066470 0x7f3f70068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0113e0 tx=0x7f3f7c00b040 comp rx=0 tx=0).stop 2023-12-08T20:55:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f89f1e640 1 -- 172.21.15.53:0/331722779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f840cd210 msgr2=0x7f3f841436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f89f1e640 1 --2- 172.21.15.53:0/331722779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f840cd210 0x7f3f841436b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3f7401d2a0 tx=0x7f3f7401b990 comp rx=0 tx=0).stop 2023-12-08T20:55:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f89f1e640 1 -- 172.21.15.53:0/331722779 shutdown_connections 2023-12-08T20:55:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f89f1e640 1 --2- 172.21.15.53:0/331722779 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3f70066470 0x7f3f70068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f89f1e640 1 --2- 172.21.15.53:0/331722779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f840cd210 0x7f3f841436b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f89f1e640 1 --2- 172.21.15.53:0/331722779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f84153760 0x7f3f840cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f89f1e640 1 --2- 172.21.15.53:0/331722779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f840ca680 0x7f3f8415bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f89f1e640 1 -- 172.21.15.53:0/331722779 >> 172.21.15.53:0/331722779 conn(0x7f3f8408b5c0 msgr2=0x7f3f84073900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f89f1e640 1 -- 172.21.15.53:0/331722779 shutdown_connections 2023-12-08T20:55:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.770+0000 7f3f89f1e640 1 -- 172.21.15.53:0/331722779 wait complete. 2023-12-08T20:55:53.791 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T20:55:53.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.926+0000 7f7747a7c640 1 Processor -- start 2023-12-08T20:55:53.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.926+0000 7f7747a7c640 1 -- start start 2023-12-08T20:55:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.926+0000 7f7747a7c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7740151770 0x7f77400ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.926+0000 7f7747a7c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f774015b400 0x7f77400b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.926+0000 7f7747a7c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77400c9fd0 con 0x7f77400c8e60 2023-12-08T20:55:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.926+0000 7f7747a7c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77400b0920 con 0x7f774015b400 2023-12-08T20:55:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.926+0000 7f7747a7c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77400cd9b0 con 0x7f7740151770 2023-12-08T20:55:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.926+0000 7f7745017640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f774015b400 0x7f77400b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.926+0000 7f7745818640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7740151770 0x7f77400ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.926+0000 7f7746019640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f77400c8e60 0x7f77400cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59830/0 (socket says 172.21.15.53:59830) 2023-12-08T20:55:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.926+0000 7f7746019640 1 -- 172.21.15.53:0/2387734550 learned_addr learned my addr 172.21.15.53:0/2387734550 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:53.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.934+0000 7f7744816640 1 -- 172.21.15.53:0/2387734550 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949896218 0 0) 0x7f77400c9fd0 con 0x7f77400c8e60 2023-12-08T20:55:53.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.934+0000 7f7744816640 1 -- 172.21.15.53:0/2387734550 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f772c003530 con 0x7f77400c8e60 2023-12-08T20:55:53.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.934+0000 7f7745818640 1 -- 172.21.15.53:0/2387734550 >> v2:172.21.15.53:3300/0 conn(0x7f774015b400 msgr2=0x7f77400b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:53.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.934+0000 7f7745818640 1 --2- 172.21.15.53:0/2387734550 >> v2:172.21.15.53:3300/0 conn(0x7f774015b400 0x7f77400b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.934+0000 7f7745818640 1 -- 172.21.15.53:0/2387734550 >> v1:172.21.15.53:6789/0 conn(0x7f77400c8e60 legacy=0x7f77400cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:53.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.934+0000 7f7745818640 1 -- 172.21.15.53:0/2387734550 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774015b920 con 0x7f7740151770 2023-12-08T20:55:53.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.938+0000 7f7745818640 1 --2- 172.21.15.53:0/2387734550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7740151770 0x7f77400ca460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f773c0097c0 tx=0x7f773c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a29ee7ee556d8a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:53.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.950+0000 7f7744816640 1 -- 172.21.15.53:0/2387734550 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c0ab650 con 0x7f7740151770 2023-12-08T20:55:53.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.950+0000 7f7744816640 1 -- 172.21.15.53:0/2387734550 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c0ab7b0 con 0x7f7740151770 2023-12-08T20:55:53.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.950+0000 7f7744816640 1 -- 172.21.15.53:0/2387734550 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c0abb40 con 0x7f7740151770 2023-12-08T20:55:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.950+0000 7f7747a7c640 1 -- 172.21.15.53:0/2387734550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7740151770 msgr2=0x7f77400ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.950+0000 7f7747a7c640 1 --2- 172.21.15.53:0/2387734550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7740151770 0x7f77400ca460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f773c0097c0 tx=0x7f773c01c450 comp rx=0 tx=0).stop 2023-12-08T20:55:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.950+0000 7f7747a7c640 1 -- 172.21.15.53:0/2387734550 shutdown_connections 2023-12-08T20:55:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.950+0000 7f7747a7c640 1 --2- 172.21.15.53:0/2387734550 >> v2:172.21.15.53:3300/0 conn(0x7f774015b400 0x7f77400b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.950+0000 7f7747a7c640 1 --2- 172.21.15.53:0/2387734550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7740151770 0x7f77400ca460 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.950+0000 7f7747a7c640 1 -- 172.21.15.53:0/2387734550 >> 172.21.15.53:0/2387734550 conn(0x7f7740070c20 msgr2=0x7f7740071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.950+0000 7f7747a7c640 1 -- 172.21.15.53:0/2387734550 shutdown_connections 2023-12-08T20:55:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.950+0000 7f7747a7c640 1 -- 172.21.15.53:0/2387734550 wait complete. 2023-12-08T20:55:53.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.954+0000 7f7747a7c640 1 Processor -- start 2023-12-08T20:55:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.954+0000 7f7747a7c640 1 -- start start 2023-12-08T20:55:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.954+0000 7f7747a7c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77400c8e60 0x7f77400cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.954+0000 7f7747a7c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7740151770 0x7f77401523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.954+0000 7f7747a7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f774015b400 0x7f7740152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.954+0000 7f7747a7c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7740154950 con 0x7f774015b400 2023-12-08T20:55:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.954+0000 7f7747a7c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7740154b60 con 0x7f7740151770 2023-12-08T20:55:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.954+0000 7f7747a7c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7740159ae0 con 0x7f77400c8e60 2023-12-08T20:55:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.954+0000 7f7746019640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f774015b400 0x7f7740152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:53.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.954+0000 7f7746019640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f774015b400 0x7f7740152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59294/0 (socket says 172.21.15.53:59294) 2023-12-08T20:55:53.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.954+0000 7f7746019640 1 -- 172.21.15.53:0/3130498650 learned_addr learned my addr 172.21.15.53:0/3130498650 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:53.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.954+0000 7f7745017640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7740151770 0x7f77401523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:53.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.958+0000 7f7745818640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77400c8e60 0x7f77400cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:53.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.958+0000 7f7746019640 1 -- 172.21.15.53:0/3130498650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77400c8e60 msgr2=0x7f77400cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:53.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.958+0000 7f7746019640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77400c8e60 0x7f77400cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.958+0000 7f7746019640 1 -- 172.21.15.53:0/3130498650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7740151770 msgr2=0x7f77401523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:53.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.958+0000 7f7746019640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7740151770 0x7f77401523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:53.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.958+0000 7f7746019640 1 -- 172.21.15.53:0/3130498650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c009420 con 0x7f774015b400 2023-12-08T20:55:53.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.962+0000 7f7746019640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f774015b400 0x7f7740152920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f773800ca70 tx=0x7f773800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:53.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.966+0000 7f77367fc640 1 -- 172.21.15.53:0/3130498650 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773800abd0 con 0x7f774015b400 2023-12-08T20:55:53.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.966+0000 7f77367fc640 1 -- 172.21.15.53:0/3130498650 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773800ad30 con 0x7f774015b400 2023-12-08T20:55:53.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.966+0000 7f77367fc640 1 -- 172.21.15.53:0/3130498650 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738012600 con 0x7f774015b400 2023-12-08T20:55:53.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.966+0000 7f7747a7c640 1 -- 172.21.15.53:0/3130498650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7740159dc0 con 0x7f774015b400 2023-12-08T20:55:53.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.966+0000 7f7747a7c640 1 -- 172.21.15.53:0/3130498650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7740151ec0 con 0x7f774015b400 2023-12-08T20:55:53.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.966+0000 7f7747a7c640 1 -- 172.21.15.53:0/3130498650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77401520b0 con 0x7f774015b400 2023-12-08T20:55:53.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.998+0000 7f77367fc640 1 -- 172.21.15.53:0/3130498650 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7738007070 con 0x7f774015b400 2023-12-08T20:55:53.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.998+0000 7f77367fc640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f77240664f0 0x7f77240689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:53.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.998+0000 7f7745818640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f77240664f0 0x7f77240689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:53.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:53.998+0000 7f7745818640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f77240664f0 0x7f77240689b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f773c0af000 tx=0x7f773c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:54.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.294+0000 7f77367fc640 1 -- 172.21.15.53:0/3130498650 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7738055350 con 0x7f774015b400 2023-12-08T20:55:54.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.294+0000 7f77367fc640 1 -- 172.21.15.53:0/3130498650 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7738051690 con 0x7f774015b400 2023-12-08T20:55:54.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.454+0000 7f7747a7c640 1 -- 172.21.15.53:0/3130498650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7740074190 con 0x7f774015b400 2023-12-08T20:55:54.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.462+0000 7f77367fc640 1 -- 172.21.15.53:0/3130498650 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7738054cb0 con 0x7f774015b400 2023-12-08T20:55:54.463 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-12-08T20:55:54.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.466+0000 7f7747a7c640 1 -- 172.21.15.53:0/3130498650 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f77240664f0 msgr2=0x7f77240689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:54.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.466+0000 7f7747a7c640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f77240664f0 0x7f77240689b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f773c0af000 tx=0x7f773c0a7000 comp rx=0 tx=0).stop 2023-12-08T20:55:54.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.466+0000 7f7747a7c640 1 -- 172.21.15.53:0/3130498650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f774015b400 msgr2=0x7f7740152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:54.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.466+0000 7f7747a7c640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f774015b400 0x7f7740152920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f773800ca70 tx=0x7f773800cf30 comp rx=0 tx=0).stop 2023-12-08T20:55:54.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.466+0000 7f7747a7c640 1 -- 172.21.15.53:0/3130498650 shutdown_connections 2023-12-08T20:55:54.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.466+0000 7f7747a7c640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f77240664f0 0x7f77240689b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:54.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.466+0000 7f7747a7c640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f774015b400 0x7f7740152920 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:54.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.466+0000 7f7747a7c640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7740151770 0x7f77401523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:54.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.466+0000 7f7747a7c640 1 --2- 172.21.15.53:0/3130498650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77400c8e60 0x7f77400cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:54.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.466+0000 7f7747a7c640 1 -- 172.21.15.53:0/3130498650 >> 172.21.15.53:0/3130498650 conn(0x7f7740070c20 msgr2=0x7f7740150b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:54.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.466+0000 7f7747a7c640 1 -- 172.21.15.53:0/3130498650 shutdown_connections 2023-12-08T20:55:54.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.466+0000 7f7747a7c640 1 -- 172.21.15.53:0/3130498650 wait complete. 2023-12-08T20:55:54.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T20:55:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.610+0000 7f758f4f2640 1 Processor -- start 2023-12-08T20:55:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.610+0000 7f758f4f2640 1 -- start start 2023-12-08T20:55:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.610+0000 7f758f4f2640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f758806abf0 0x7f758806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.610+0000 7f758f4f2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758815d3e0 con 0x7f758806a810 2023-12-08T20:55:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.610+0000 7f758f4f2640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75880c2ba0 con 0x7f758815d870 2023-12-08T20:55:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.610+0000 7f758f4f2640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75880c1260 con 0x7f758806abf0 2023-12-08T20:55:54.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.618+0000 7f758da8f640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f758815d870 0x7f7588153520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.53:39720/0 (socket says 172.21.15.53:39720) 2023-12-08T20:55:54.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.618+0000 7f758da8f640 1 -- 172.21.15.53:0/2345081561 learned_addr learned my addr 172.21.15.53:0/2345081561 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:54.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.618+0000 7f758ca8d640 1 --2- 172.21.15.53:0/2345081561 >> v2:172.21.15.146:3300/0 conn(0x7f758806abf0 0x7f758806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:54.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.630+0000 7f758ca8d640 1 -- 172.21.15.53:0/2345081561 >> v1:172.21.15.146:6789/0 conn(0x7f758815d870 legacy=0x7f7588153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:54.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.630+0000 7f758ca8d640 1 -- 172.21.15.53:0/2345081561 >> v1:172.21.15.53:6789/0 conn(0x7f758806a810 legacy=0x7f758806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:54.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.630+0000 7f758ca8d640 1 -- 172.21.15.53:0/2345081561 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75880c2e80 con 0x7f758806abf0 2023-12-08T20:55:54.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.638+0000 7f758ca8d640 1 --2- 172.21.15.53:0/2345081561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758806abf0 0x7f758806b120 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f75780097c0 tx=0x7f757801ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecd68f4fc15ee08d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:54.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.746+0000 7f757ffff640 1 -- 172.21.15.53:0/2345081561 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75780a8930 con 0x7f758806abf0 2023-12-08T20:55:54.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.746+0000 7f757ffff640 1 -- 172.21.15.53:0/2345081561 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75780a8a90 con 0x7f758806abf0 2023-12-08T20:55:54.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.746+0000 7f757ffff640 1 -- 172.21.15.53:0/2345081561 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75780a8e20 con 0x7f758806abf0 2023-12-08T20:55:54.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.746+0000 7f758f4f2640 1 -- 172.21.15.53:0/2345081561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758806abf0 msgr2=0x7f758806b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:54.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.746+0000 7f758f4f2640 1 --2- 172.21.15.53:0/2345081561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758806abf0 0x7f758806b120 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f75780097c0 tx=0x7f757801ec30 comp rx=0 tx=0).stop 2023-12-08T20:55:54.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.746+0000 7f758f4f2640 1 -- 172.21.15.53:0/2345081561 shutdown_connections 2023-12-08T20:55:54.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.746+0000 7f758f4f2640 1 --2- 172.21.15.53:0/2345081561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758806abf0 0x7f758806b120 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:54.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.746+0000 7f758f4f2640 1 -- 172.21.15.53:0/2345081561 >> 172.21.15.53:0/2345081561 conn(0x7f75880c8990 msgr2=0x7f75880c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:54.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.746+0000 7f758f4f2640 1 -- 172.21.15.53:0/2345081561 shutdown_connections 2023-12-08T20:55:54.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.746+0000 7f758f4f2640 1 -- 172.21.15.53:0/2345081561 wait complete. 2023-12-08T20:55:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.750+0000 7f758f4f2640 1 Processor -- start 2023-12-08T20:55:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.750+0000 7f758f4f2640 1 -- start start 2023-12-08T20:55:54.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.754+0000 7f758f4f2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f758806a810 0x7f7588149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:54.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.754+0000 7f758f4f2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f758806abf0 0x7f75880ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:54.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.754+0000 7f758f4f2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758815d870 0x7f75880cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:54.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.754+0000 7f758f4f2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75881f2400 con 0x7f758806a810 2023-12-08T20:55:54.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.754+0000 7f758f4f2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75881521c0 con 0x7f758815d870 2023-12-08T20:55:54.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.754+0000 7f758f4f2640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75881f26a0 con 0x7f758806abf0 2023-12-08T20:55:54.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.754+0000 7f758d28e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f758806a810 0x7f7588149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:54.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.754+0000 7f758ca8d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f758806abf0 0x7f75880ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:54.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.754+0000 7f758d28e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f758806a810 0x7f7588149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59296/0 (socket says 172.21.15.53:59296) 2023-12-08T20:55:54.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.754+0000 7f758d28e640 1 -- 172.21.15.53:0/4068540826 learned_addr learned my addr 172.21.15.53:0/4068540826 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:54.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.762+0000 7f758d28e640 1 -- 172.21.15.53:0/4068540826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f758806abf0 msgr2=0x7f75880ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:54.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.762+0000 7f758d28e640 1 --2- 172.21.15.53:0/4068540826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f758806abf0 0x7f75880ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:54.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.762+0000 7f758d28e640 1 -- 172.21.15.53:0/4068540826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758815d870 msgr2=0x7f75880cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:54.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.762+0000 7f758d28e640 1 --2- 172.21.15.53:0/4068540826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758815d870 0x7f75880cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:54.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.762+0000 7f758d28e640 1 -- 172.21.15.53:0/4068540826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7578009420 con 0x7f758806a810 2023-12-08T20:55:54.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.762+0000 7f758d28e640 1 --2- 172.21.15.53:0/4068540826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f758806a810 0x7f7588149870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f758400c490 tx=0x7f7584001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.766+0000 7f757dffb640 1 -- 172.21.15.53:0/4068540826 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584003600 con 0x7f758806a810 2023-12-08T20:55:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.766+0000 7f757dffb640 1 -- 172.21.15.53:0/4068540826 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7584003780 con 0x7f758806a810 2023-12-08T20:55:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.766+0000 7f757dffb640 1 -- 172.21.15.53:0/4068540826 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584003b70 con 0x7f758806a810 2023-12-08T20:55:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.766+0000 7f758f4f2640 1 -- 172.21.15.53:0/4068540826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75881f2980 con 0x7f758806a810 2023-12-08T20:55:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.766+0000 7f758f4f2640 1 -- 172.21.15.53:0/4068540826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75881f2f40 con 0x7f758806a810 2023-12-08T20:55:54.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:54.770+0000 7f758f4f2640 1 -- 172.21.15.53:0/4068540826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75880714e0 con 0x7f758806a810 2023-12-08T20:55:55.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.202+0000 7f757dffb640 1 -- 172.21.15.53:0/4068540826 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7584003cd0 con 0x7f758806a810 2023-12-08T20:55:55.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.202+0000 7f757dffb640 1 --2- 172.21.15.53:0/4068540826 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f756c0664c0 0x7f756c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:55.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.202+0000 7f758ca8d640 1 --2- 172.21.15.53:0/4068540826 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f756c0664c0 0x7f756c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:55.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.202+0000 7f758ca8d640 1 --2- 172.21.15.53:0/4068540826 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f756c0664c0 0x7f756c068980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f75780b2000 tx=0x7f7578008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.242+0000 7f757dffb640 1 -- 172.21.15.53:0/4068540826 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7584054ab0 con 0x7f758806a810 2023-12-08T20:55:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.246+0000 7f757dffb640 1 -- 172.21.15.53:0/4068540826 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7584050df0 con 0x7f758806a810 2023-12-08T20:55:55.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.446+0000 7f758f4f2640 1 -- 172.21.15.53:0/4068540826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75880c98f0 con 0x7f758806a810 2023-12-08T20:55:55.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f757dffb640 1 -- 172.21.15.53:0/4068540826 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6501 (secure 0 0 0) 0x7f7584017070 con 0x7f758806a810 2023-12-08T20:55:55.481 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:55.481 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6838/3541484412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3541484412},{"type":"v1","addr":"172.21.15.53:6838","nonce":3541484412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/2329639389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6837","nonce":2329639389},{"type":"v1","addr":"172.21.15.53:6839","nonce":2329639389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3938297948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3938297948},{"type":"v1","addr":"172.21.15.146:6833","nonce":3938297948}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2026540331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2026540331},{"type":"v1","addr":"172.21.15.146:6836","nonce":2026540331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/4236922545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4236922545},{"type":"v1","addr":"172.21.15.146:6837","nonce":4236922545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T20:54:56.254252+0000","modified":"2023-12-08T20:55:37.903706+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6835/3454931938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3454931938},{"type":"v1","addr":"172.21.15.53:6835","nonce":3454931938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T20:55:55.481 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 10 2023-12-08T20:55:55.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f758f4f2640 1 -- 172.21.15.53:0/4068540826 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f756c0664c0 msgr2=0x7f756c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:55.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f758f4f2640 1 --2- 172.21.15.53:0/4068540826 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f756c0664c0 0x7f756c068980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f75780b2000 tx=0x7f7578008040 comp rx=0 tx=0).stop 2023-12-08T20:55:55.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f758f4f2640 1 -- 172.21.15.53:0/4068540826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f758806a810 msgr2=0x7f7588149870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:55.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f758f4f2640 1 --2- 172.21.15.53:0/4068540826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f758806a810 0x7f7588149870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f758400c490 tx=0x7f7584001e80 comp rx=0 tx=0).stop 2023-12-08T20:55:55.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f758f4f2640 1 -- 172.21.15.53:0/4068540826 shutdown_connections 2023-12-08T20:55:55.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f758f4f2640 1 --2- 172.21.15.53:0/4068540826 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f756c0664c0 0x7f756c068980 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:55.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f758f4f2640 1 --2- 172.21.15.53:0/4068540826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758815d870 0x7f75880cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:55.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f758f4f2640 1 --2- 172.21.15.53:0/4068540826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f758806abf0 0x7f75880ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:55.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f758f4f2640 1 --2- 172.21.15.53:0/4068540826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f758806a810 0x7f7588149870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:55.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f758f4f2640 1 -- 172.21.15.53:0/4068540826 >> 172.21.15.53:0/4068540826 conn(0x7f75880c8990 msgr2=0x7f758815b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:55.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f758f4f2640 1 -- 172.21.15.53:0/4068540826 shutdown_connections 2023-12-08T20:55:55.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.482+0000 7f758f4f2640 1 -- 172.21.15.53:0/4068540826 wait complete. 2023-12-08T20:55:55.504 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:55:55.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.618+0000 7f5abd975640 1 Processor -- start 2023-12-08T20:55:55.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.618+0000 7f5abd975640 1 -- start start 2023-12-08T20:55:55.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.622+0000 7f5abd975640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ab80c1cf0 0x7f5ab815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:55.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.622+0000 7f5abd975640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ab80c6410 0x7f5ab806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:55.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.622+0000 7f5abd975640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab80c01a0 con 0x7f5ab80c1910 2023-12-08T20:55:55.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.622+0000 7f5abd975640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab806f3a0 con 0x7f5ab80c6410 2023-12-08T20:55:55.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.622+0000 7f5abd975640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab806ede0 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.622+0000 7f5aaffff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ab80c1cf0 0x7f5ab815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:55.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.622+0000 7f5aaffff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ab80c1cf0 0x7f5ab815a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:47354/0 (socket says 172.21.15.53:47354) 2023-12-08T20:55:55.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.622+0000 7f5aaffff640 1 -- 172.21.15.53:0/1590514638 learned_addr learned my addr 172.21.15.53:0/1590514638 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:55.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.630+0000 7f5ab77fe640 1 --2- 172.21.15.53:0/1590514638 >> v2:172.21.15.53:3300/0 conn(0x7f5ab80c6410 0x7f5ab806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:55.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.630+0000 7f5aaffff640 1 -- 172.21.15.53:0/1590514638 >> v2:172.21.15.53:3300/0 conn(0x7f5ab80c6410 msgr2=0x7f5ab806e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:55.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.630+0000 7f5aaffff640 1 --2- 172.21.15.53:0/1590514638 >> v2:172.21.15.53:3300/0 conn(0x7f5ab80c6410 0x7f5ab806e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:55.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.630+0000 7f5aaffff640 1 -- 172.21.15.53:0/1590514638 >> v1:172.21.15.53:6789/0 conn(0x7f5ab80c1910 legacy=0x7f5ab814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:55.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.630+0000 7f5aaffff640 1 -- 172.21.15.53:0/1590514638 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab806f0c0 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.634+0000 7f5aaffff640 1 --2- 172.21.15.53:0/1590514638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ab80c1cf0 0x7f5ab815a440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009870 tx=0x7f5aa001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa966cabc919e83e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.642+0000 7f5ab67fc640 1 -- 172.21.15.53:0/1590514638 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa00aa5f0 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.642+0000 7f5ab67fc640 1 -- 172.21.15.53:0/1590514638 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa00aa750 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.642+0000 7f5ab67fc640 1 -- 172.21.15.53:0/1590514638 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa00aaae0 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.642+0000 7f5abd975640 1 -- 172.21.15.53:0/1590514638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ab80c1cf0 msgr2=0x7f5ab815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:55.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.642+0000 7f5abd975640 1 --2- 172.21.15.53:0/1590514638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ab80c1cf0 0x7f5ab815a440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009870 tx=0x7f5aa001c4d0 comp rx=0 tx=0).stop 2023-12-08T20:55:55.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 -- 172.21.15.53:0/1590514638 shutdown_connections 2023-12-08T20:55:55.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 --2- 172.21.15.53:0/1590514638 >> v2:172.21.15.53:3300/0 conn(0x7f5ab80c6410 0x7f5ab806e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:55.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 --2- 172.21.15.53:0/1590514638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ab80c1cf0 0x7f5ab815a440 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:55.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 -- 172.21.15.53:0/1590514638 >> 172.21.15.53:0/1590514638 conn(0x7f5ab80caef0 msgr2=0x7f5ab80cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:55.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 -- 172.21.15.53:0/1590514638 shutdown_connections 2023-12-08T20:55:55.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 -- 172.21.15.53:0/1590514638 wait complete. 2023-12-08T20:55:55.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 Processor -- start 2023-12-08T20:55:55.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 -- start start 2023-12-08T20:55:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ab80c1910 0x7f5ab81f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab80c1cf0 0x7f5ab8143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab80c6410 0x7f5ab81490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80c4300 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab815a440 con 0x7f5ab80c6410 2023-12-08T20:55:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5abd975640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab815a700 con 0x7f5ab80c1910 2023-12-08T20:55:55.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5aaffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab80c1cf0 0x7f5ab8143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:55.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5aaffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab80c1cf0 0x7f5ab8143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59310/0 (socket says 172.21.15.53:59310) 2023-12-08T20:55:55.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5aaffff640 1 -- 172.21.15.53:0/3619244197 learned_addr learned my addr 172.21.15.53:0/3619244197 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:55.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.646+0000 7f5ab77fe640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab80c6410 0x7f5ab81490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:55.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.650+0000 7f5ab6ffd640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ab80c1910 0x7f5ab81f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:55.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.650+0000 7f5aaffff640 1 -- 172.21.15.53:0/3619244197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ab80c1910 msgr2=0x7f5ab81f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:55.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.650+0000 7f5aaffff640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ab80c1910 0x7f5ab81f0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:55.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.650+0000 7f5aaffff640 1 -- 172.21.15.53:0/3619244197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab80c6410 msgr2=0x7f5ab81490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:55.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.650+0000 7f5aaffff640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab80c6410 0x7f5ab81490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:55.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.650+0000 7f5aaffff640 1 -- 172.21.15.53:0/3619244197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa00094d0 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.654+0000 7f5aaffff640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab80c1cf0 0x7f5ab8143260 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00ac040 tx=0x7f5aa001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:55.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.658+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/3619244197 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa00b3800 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.658+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/3619244197 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa00b3980 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.658+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/3619244197 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa00b3d30 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.658+0000 7f5abd975640 1 -- 172.21.15.53:0/3619244197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab815a9e0 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.658+0000 7f5abd975640 1 -- 172.21.15.53:0/3619244197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab815afa0 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.658+0000 7f5abd975640 1 -- 172.21.15.53:0/3619244197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab8161470 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.682+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/3619244197 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5aa00c7420 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.682+0000 7f5ab4ff9640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5a980664c0 0x7f5a98068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:55.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.682+0000 7f5ab6ffd640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5a980664c0 0x7f5a98068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:55.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.682+0000 7f5ab6ffd640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5a980664c0 0x7f5a98068980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8007fd0 tx=0x7f5aa8007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.686+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/3619244197 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5aa00a7070 con 0x7f5ab80c1cf0 2023-12-08T20:55:55.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:55.978+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/3619244197 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5aa00ebdc0 con 0x7f5ab80c1cf0 2023-12-08T20:55:56.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.154+0000 7f5abd975640 1 -- 172.21.15.53:0/3619244197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ab80675b0 con 0x7f5ab80c1cf0 2023-12-08T20:55:56.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.298+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/3619244197 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f5aa00aa5b0 con 0x7f5ab80c1cf0 2023-12-08T20:55:56.298 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:55:56.298 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:05.168215+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:55:56.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.302+0000 7f5abd975640 1 -- 172.21.15.53:0/3619244197 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5a980664c0 msgr2=0x7f5a98068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:56.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.302+0000 7f5abd975640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5a980664c0 0x7f5a98068980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8007fd0 tx=0x7f5aa8007e40 comp rx=0 tx=0).stop 2023-12-08T20:55:56.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.302+0000 7f5abd975640 1 -- 172.21.15.53:0/3619244197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab80c1cf0 msgr2=0x7f5ab8143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:56.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.302+0000 7f5abd975640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab80c1cf0 0x7f5ab8143260 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00ac040 tx=0x7f5aa001ad10 comp rx=0 tx=0).stop 2023-12-08T20:55:56.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.302+0000 7f5abd975640 1 -- 172.21.15.53:0/3619244197 shutdown_connections 2023-12-08T20:55:56.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.302+0000 7f5abd975640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5a980664c0 0x7f5a98068980 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:56.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.302+0000 7f5abd975640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab80c6410 0x7f5ab81490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:56.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.302+0000 7f5abd975640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab80c1cf0 0x7f5ab8143260 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:56.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.302+0000 7f5abd975640 1 --2- 172.21.15.53:0/3619244197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ab80c1910 0x7f5ab81f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:56.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.302+0000 7f5abd975640 1 -- 172.21.15.53:0/3619244197 >> 172.21.15.53:0/3619244197 conn(0x7f5ab80caef0 msgr2=0x7f5ab814b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:56.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.302+0000 7f5abd975640 1 -- 172.21.15.53:0/3619244197 shutdown_connections 2023-12-08T20:55:56.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.302+0000 7f5abd975640 1 -- 172.21.15.53:0/3619244197 wait complete. 2023-12-08T20:55:56.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T20:54:13.707275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T20:54:52.929484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T20:54:54.529440+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T20:55:01.908380+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T20:55:56.329 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T20:55:56.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.458+0000 7fe8e8340640 1 Processor -- start 2023-12-08T20:55:56.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.458+0000 7fe8e8340640 1 -- start start 2023-12-08T20:55:56.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.462+0000 7fe8e8340640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8e0072770 0x7fe8e006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:56.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.462+0000 7fe8e8340640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e0160ea0 0x7fe8e006ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:56.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.462+0000 7fe8e8340640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e015dc00 con 0x7fe8e0157a50 2023-12-08T20:55:56.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.462+0000 7fe8e8340640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e0071a80 con 0x7fe8e0072770 2023-12-08T20:55:56.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.462+0000 7fe8e8340640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00c58f0 con 0x7fe8e0160ea0 2023-12-08T20:55:56.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.462+0000 7fe8e60dc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe8e0157a50 0x7fe8e015e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59876/0 (socket says 172.21.15.53:59876) 2023-12-08T20:55:56.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.462+0000 7fe8e60dc640 1 -- 172.21.15.53:0/1527185591 learned_addr learned my addr 172.21.15.53:0/1527185591 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:56.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.466+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880589161 0 0) 0x7fe8e015dc00 con 0x7fe8e0157a50 2023-12-08T20:55:56.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.466+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8cc003530 con 0x7fe8e0157a50 2023-12-08T20:55:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2694087729 0 0) 0x7fe8cc003530 con 0x7fe8e0157a50 2023-12-08T20:55:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e0160ea0 msgr2=0x7fe8e006ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 --2- 172.21.15.53:0/1527185591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e0160ea0 0x7fe8e006ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 >> v2:172.21.15.146:3300/0 conn(0x7fe8e0072770 msgr2=0x7fe8e006e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 --2- 172.21.15.53:0/1527185591 >> v2:172.21.15.146:3300/0 conn(0x7fe8e0072770 0x7fe8e006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e015d8b0 con 0x7fe8e0157a50 2023-12-08T20:55:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 149952835 0 0) 0x7fe8d0001680 con 0x7fe8e0157a50 2023-12-08T20:55:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 >> v1:172.21.15.53:6789/0 conn(0x7fe8e0157a50 legacy=0x7fe8e015e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 --2- 172.21.15.53:0/1527185591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e0160ea0 0x7fe8cc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 --2- 172.21.15.53:0/1527185591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc0040e0 0x7fe8cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 --2- 172.21.15.53:0/1527185591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc004e30 0x7fe8cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e0071a80 con 0x7fe8cc0040e0 2023-12-08T20:55:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00c58f0 con 0x7fe8cc004e30 2023-12-08T20:55:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.470+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc005640 con 0x7fe8e0160ea0 2023-12-08T20:55:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.474+0000 7fe8e58db640 1 --2- 172.21.15.53:0/1527185591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc0040e0 0x7fe8cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.478+0000 7fe8e58db640 1 -- 172.21.15.53:0/1527185591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e0160ea0 msgr2=0x7fe8cc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.478+0000 7fe8e58db640 1 --2- 172.21.15.53:0/1527185591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e0160ea0 0x7fe8cc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.478+0000 7fe8e58db640 1 -- 172.21.15.53:0/1527185591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc004e30 msgr2=0x7fe8cc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.478+0000 7fe8e58db640 1 --2- 172.21.15.53:0/1527185591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc004e30 0x7fe8cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.478+0000 7fe8e58db640 1 -- 172.21.15.53:0/1527185591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc003530 con 0x7fe8cc0040e0 2023-12-08T20:55:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.482+0000 7fe8e58db640 1 --2- 172.21.15.53:0/1527185591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc0040e0 0x7fe8cc0047d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009890 tx=0x7fe8dc01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e50ca40bafe537 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.486+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0ab600 con 0x7fe8cc0040e0 2023-12-08T20:55:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.486+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc0a7050 con 0x7fe8cc0040e0 2023-12-08T20:55:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.486+0000 7fe8e50da640 1 -- 172.21.15.53:0/1527185591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0aba00 con 0x7fe8cc0040e0 2023-12-08T20:55:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 -- 172.21.15.53:0/1527185591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc0040e0 msgr2=0x7fe8cc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 --2- 172.21.15.53:0/1527185591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc0040e0 0x7fe8cc0047d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009890 tx=0x7fe8dc01c340 comp rx=0 tx=0).stop 2023-12-08T20:55:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e68dd640 1 -- 172.21.15.53:0/1527185591 reap_dead start 2023-12-08T20:55:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 -- 172.21.15.53:0/1527185591 shutdown_connections 2023-12-08T20:55:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 -- 172.21.15.53:0/1527185591 >> 172.21.15.53:0/1527185591 conn(0x7fe8e00caef0 msgr2=0x7fe8e00cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 -- 172.21.15.53:0/1527185591 shutdown_connections 2023-12-08T20:55:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 -- 172.21.15.53:0/1527185591 wait complete. 2023-12-08T20:55:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 Processor -- start 2023-12-08T20:55:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 -- start start 2023-12-08T20:55:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc0040e0 0x7fe8e01e9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8e015b790 0x7fe8e01f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e01f6f50 0x7fe8e0149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00718a0 con 0x7fe8e015b790 2023-12-08T20:55:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e01f73d0 con 0x7fe8cc0040e0 2023-12-08T20:55:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.490+0000 7fe8e8340640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e014eb30 con 0x7fe8e01f6f50 2023-12-08T20:55:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.494+0000 7fe8e58db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8e015b790 0x7fe8e01f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.494+0000 7fe8e58db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8e015b790 0x7fe8e01f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59328/0 (socket says 172.21.15.53:59328) 2023-12-08T20:55:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.494+0000 7fe8e58db640 1 -- 172.21.15.53:0/1586387708 learned_addr learned my addr 172.21.15.53:0/1586387708 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.498+0000 7fe8e58db640 1 -- 172.21.15.53:0/1586387708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e01f6f50 msgr2=0x7fe8e0149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.498+0000 7fe8e58db640 1 --2- 172.21.15.53:0/1586387708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e01f6f50 0x7fe8e0149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.498+0000 7fe8e58db640 1 -- 172.21.15.53:0/1586387708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc0040e0 msgr2=0x7fe8e01e9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.498+0000 7fe8e58db640 1 --2- 172.21.15.53:0/1586387708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc0040e0 0x7fe8e01e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.498+0000 7fe8e58db640 1 -- 172.21.15.53:0/1586387708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e01f37b0 con 0x7fe8e015b790 2023-12-08T20:55:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.498+0000 7fe8e58db640 1 --2- 172.21.15.53:0/1586387708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8e015b790 0x7fe8e01f6a10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc000c10 tx=0x7fe8cc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.502+0000 7fe8d6ffd640 1 -- 172.21.15.53:0/1586387708 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc003dc0 con 0x7fe8e015b790 2023-12-08T20:55:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.502+0000 7fe8d6ffd640 1 -- 172.21.15.53:0/1586387708 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc0b5410 con 0x7fe8e015b790 2023-12-08T20:55:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.502+0000 7fe8d6ffd640 1 -- 172.21.15.53:0/1586387708 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0b57a0 con 0x7fe8e015b790 2023-12-08T20:55:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.502+0000 7fe8e8340640 1 -- 172.21.15.53:0/1586387708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e01f3a90 con 0x7fe8e015b790 2023-12-08T20:55:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.502+0000 7fe8e8340640 1 -- 172.21.15.53:0/1586387708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e01f4050 con 0x7fe8e015b790 2023-12-08T20:55:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.506+0000 7fe8e8340640 1 -- 172.21.15.53:0/1586387708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e00675b0 con 0x7fe8e015b790 2023-12-08T20:55:56.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.526+0000 7fe8d6ffd640 1 -- 172.21.15.53:0/1586387708 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe8dc0b2050 con 0x7fe8e015b790 2023-12-08T20:55:56.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.526+0000 7fe8d6ffd640 1 --2- 172.21.15.53:0/1586387708 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe8c40664c0 0x7fe8c4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:56.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.526+0000 7fe8e60dc640 1 --2- 172.21.15.53:0/1586387708 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe8c40664c0 0x7fe8c4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:56.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.530+0000 7fe8e60dc640 1 --2- 172.21.15.53:0/1586387708 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe8c40664c0 0x7fe8c4068980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00079c0 tx=0x7fe8d0001610 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:56.624 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:55:56.626 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:55:56.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.830+0000 7fe8d6ffd640 1 -- 172.21.15.53:0/1586387708 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8dc0f00b0 con 0x7fe8e015b790 2023-12-08T20:55:56.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.830+0000 7fe8d6ffd640 1 -- 172.21.15.53:0/1586387708 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8dc0ebcf0 con 0x7fe8e015b790 2023-12-08T20:55:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:56.994+0000 7fe8e8340640 1 -- 172.21.15.53:0/1586387708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8e0072340 con 0x7fe8e015b790 2023-12-08T20:55:57.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8d6ffd640 1 -- 172.21.15.53:0/1586387708 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8dc0b0070 con 0x7fe8e015b790 2023-12-08T20:55:57.001 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-12-08T20:55:57.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8e8340640 1 -- 172.21.15.53:0/1586387708 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe8c40664c0 msgr2=0x7fe8c4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:57.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8e8340640 1 --2- 172.21.15.53:0/1586387708 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe8c40664c0 0x7fe8c4068980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00079c0 tx=0x7fe8d0001610 comp rx=0 tx=0).stop 2023-12-08T20:55:57.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8e8340640 1 -- 172.21.15.53:0/1586387708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8e015b790 msgr2=0x7fe8e01f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:57.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8e8340640 1 --2- 172.21.15.53:0/1586387708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8e015b790 0x7fe8e01f6a10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc000c10 tx=0x7fe8cc005800 comp rx=0 tx=0).stop 2023-12-08T20:55:57.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8e8340640 1 -- 172.21.15.53:0/1586387708 shutdown_connections 2023-12-08T20:55:57.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8e8340640 1 --2- 172.21.15.53:0/1586387708 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe8c40664c0 0x7fe8c4068980 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8e8340640 1 --2- 172.21.15.53:0/1586387708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e01f6f50 0x7fe8e0149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8e8340640 1 --2- 172.21.15.53:0/1586387708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8e015b790 0x7fe8e01f6a10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8e8340640 1 --2- 172.21.15.53:0/1586387708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc0040e0 0x7fe8e01e9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8e8340640 1 -- 172.21.15.53:0/1586387708 >> 172.21.15.53:0/1586387708 conn(0x7fe8e00caef0 msgr2=0x7fe8e015df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:57.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8e8340640 1 -- 172.21.15.53:0/1586387708 shutdown_connections 2023-12-08T20:55:57.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.002+0000 7fe8e8340640 1 -- 172.21.15.53:0/1586387708 wait complete. 2023-12-08T20:55:57.020 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T20:55:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.154+0000 7f21ab8cf640 1 Processor -- start 2023-12-08T20:55:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.154+0000 7f21ab8cf640 1 -- start start 2023-12-08T20:55:57.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.154+0000 7f21ab8cf640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21a4150840 0x7f21a406e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:57.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.154+0000 7f21ab8cf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a415a350 con 0x7f21a40c1110 2023-12-08T20:55:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.154+0000 7f21ab8cf640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a40c2330 con 0x7f21a40b1c80 2023-12-08T20:55:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.154+0000 7f21ab8cf640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a415a860 con 0x7f21a4150840 2023-12-08T20:55:57.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.194+0000 7f21a966b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f21a40c1110 0x7f21a40c14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59886/0 (socket says 172.21.15.53:59886) 2023-12-08T20:55:57.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.194+0000 7f21a966b640 1 -- 172.21.15.53:0/1769591196 learned_addr learned my addr 172.21.15.53:0/1769591196 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:57.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.202+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138285902 0 0) 0x7f21a415a350 con 0x7f21a40c1110 2023-12-08T20:55:57.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.202+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2190005740 con 0x7f21a40c1110 2023-12-08T20:55:57.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1057393162 0 0) 0x7f2190005740 con 0x7f21a40c1110 2023-12-08T20:55:57.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21a4150840 msgr2=0x7f21a406e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:57.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 --2- 172.21.15.53:0/1769591196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21a4150840 0x7f21a406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 >> v1:172.21.15.146:6789/0 conn(0x7f21a40b1c80 legacy=0x7f21a4150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:57.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a40c1c00 con 0x7f21a40c1110 2023-12-08T20:55:57.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 149952835 0 0) 0x7f21a0001680 con 0x7f21a40c1110 2023-12-08T20:55:57.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 >> v1:172.21.15.53:6789/0 conn(0x7f21a40c1110 legacy=0x7f21a40c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:57.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 --2- 172.21.15.53:0/1769591196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2190005bc0 0x7f2190005fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:57.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 --2- 172.21.15.53:0/1769591196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21a4150840 0x7f21900069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:57.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 --2- 172.21.15.53:0/1769591196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2190007040 0x7f219000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:57.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a415a860 con 0x7f2190005bc0 2023-12-08T20:55:57.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21900076f0 con 0x7f2190007040 2023-12-08T20:55:57.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.210+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21900078b0 con 0x7f21a4150840 2023-12-08T20:55:57.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.214+0000 7f21a966b640 1 --2- 172.21.15.53:0/1769591196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2190005bc0 0x7f2190005fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:57.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.222+0000 7f21a966b640 1 -- 172.21.15.53:0/1769591196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21a4150840 msgr2=0x7f21900069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:57.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.222+0000 7f21a966b640 1 --2- 172.21.15.53:0/1769591196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21a4150840 0x7f21900069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.222+0000 7f21a966b640 1 -- 172.21.15.53:0/1769591196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2190007040 msgr2=0x7f219000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:57.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.222+0000 7f21a966b640 1 --2- 172.21.15.53:0/1769591196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2190007040 0x7f219000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.222+0000 7f21a966b640 1 -- 172.21.15.53:0/1769591196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2190005740 con 0x7f2190005bc0 2023-12-08T20:55:57.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.226+0000 7f21a966b640 1 --2- 172.21.15.53:0/1769591196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2190005bc0 0x7f2190005fc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f21a000c110 tx=0x7f21a001cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98d296e7f04e4ac server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:57.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.234+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a00058e0 con 0x7f2190005bc0 2023-12-08T20:55:57.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.234+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a0005a40 con 0x7f2190005bc0 2023-12-08T20:55:57.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.234+0000 7f219bfff640 1 -- 172.21.15.53:0/1769591196 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0005df0 con 0x7f2190005bc0 2023-12-08T20:55:57.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.234+0000 7f21ab8cf640 1 -- 172.21.15.53:0/1769591196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2190005bc0 msgr2=0x7f2190005fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:57.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.234+0000 7f21ab8cf640 1 --2- 172.21.15.53:0/1769591196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2190005bc0 0x7f2190005fc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f21a000c110 tx=0x7f21a001cb30 comp rx=0 tx=0).stop 2023-12-08T20:55:57.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.234+0000 7f21a9e6c640 1 -- 172.21.15.53:0/1769591196 reap_dead start 2023-12-08T20:55:57.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.234+0000 7f21ab8cf640 1 -- 172.21.15.53:0/1769591196 shutdown_connections 2023-12-08T20:55:57.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.234+0000 7f21ab8cf640 1 -- 172.21.15.53:0/1769591196 >> 172.21.15.53:0/1769591196 conn(0x7f21a40c8990 msgr2=0x7f21a40c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:57.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.234+0000 7f21ab8cf640 1 -- 172.21.15.53:0/1769591196 shutdown_connections 2023-12-08T20:55:57.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.234+0000 7f21ab8cf640 1 -- 172.21.15.53:0/1769591196 wait complete. 2023-12-08T20:55:57.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.234+0000 7f21ab8cf640 1 Processor -- start 2023-12-08T20:55:57.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.234+0000 7f21ab8cf640 1 -- start start 2023-12-08T20:55:57.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.238+0000 7f21ab8cf640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2190005bc0 0x7f21a4152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:57.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.238+0000 7f21ab8cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21a4147d70 0x7f21a41eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:57.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.238+0000 7f21ab8cf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21a40c69e0 0x7f21a4145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:57.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.238+0000 7f21ab8cf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4153f30 con 0x7f21a4147d70 2023-12-08T20:55:57.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.238+0000 7f21ab8cf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40c5320 con 0x7f21a40c69e0 2023-12-08T20:55:57.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.238+0000 7f21ab8cf640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40c6430 con 0x7f2190005bc0 2023-12-08T20:55:57.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.238+0000 7f21a8e6a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21a4147d70 0x7f21a41eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:57.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.238+0000 7f21a8e6a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21a4147d70 0x7f21a41eeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59338/0 (socket says 172.21.15.53:59338) 2023-12-08T20:55:57.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.238+0000 7f21a8e6a640 1 -- 172.21.15.53:0/3259530019 learned_addr learned my addr 172.21.15.53:0/3259530019 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:57.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.238+0000 7f21a9e6c640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21a40c69e0 0x7f21a4145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:57.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.242+0000 7f21a8e6a640 1 -- 172.21.15.53:0/3259530019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2190005bc0 msgr2=0x7f21a4152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:57.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.242+0000 7f21a8e6a640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2190005bc0 0x7f21a4152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.242+0000 7f21a8e6a640 1 -- 172.21.15.53:0/3259530019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21a40c69e0 msgr2=0x7f21a4145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:57.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.242+0000 7f21a8e6a640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21a40c69e0 0x7f21a4145f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.242+0000 7f21a8e6a640 1 -- 172.21.15.53:0/3259530019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a41524a0 con 0x7f21a4147d70 2023-12-08T20:55:57.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.246+0000 7f21a8e6a640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21a4147d70 0x7f21a41eeda0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f219400c440 tx=0x7f219400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.270+0000 7f2199ffb640 1 -- 172.21.15.53:0/3259530019 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194005480 con 0x7f21a4147d70 2023-12-08T20:55:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.270+0000 7f2199ffb640 1 -- 172.21.15.53:0/3259530019 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2194003600 con 0x7f21a4147d70 2023-12-08T20:55:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.270+0000 7f21ab8cf640 1 -- 172.21.15.53:0/3259530019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a41539b0 con 0x7f21a4147d70 2023-12-08T20:55:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.270+0000 7f2199ffb640 1 -- 172.21.15.53:0/3259530019 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194003990 con 0x7f21a4147d70 2023-12-08T20:55:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.270+0000 7f21ab8cf640 1 -- 172.21.15.53:0/3259530019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a4151e50 con 0x7f21a4147d70 2023-12-08T20:55:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.274+0000 7f21ab8cf640 1 -- 172.21.15.53:0/3259530019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a4151cb0 con 0x7f21a4147d70 2023-12-08T20:55:57.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.578+0000 7f2199ffb640 1 -- 172.21.15.53:0/3259530019 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f219401b3b0 con 0x7f21a4147d70 2023-12-08T20:55:57.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.578+0000 7f2199ffb640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f21880664c0 0x7f2188068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:57.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.578+0000 7f21a966b640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f21880664c0 0x7f2188068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.582+0000 7f21a966b640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f21880664c0 0x7f2188068980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21a00aa000 tx=0x7f21a406f150 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:57.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.618+0000 7f2199ffb640 1 -- 172.21.15.53:0/3259530019 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2194054600 con 0x7f21a4147d70 2023-12-08T20:55:57.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.618+0000 7f2199ffb640 1 -- 172.21.15.53:0/3259530019 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2194050940 con 0x7f21a4147d70 2023-12-08T20:55:57.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.826+0000 7f21ab8cf640 1 -- 172.21.15.53:0/3259530019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21a4151cb0 con 0x7f21a4147d70 2023-12-08T20:55:57.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f2199ffb640 1 -- 172.21.15.53:0/3259530019 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21a4151cb0 con 0x7f21a4147d70 2023-12-08T20:55:57.841 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-12-08T20:55:57.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f21ab8cf640 1 -- 172.21.15.53:0/3259530019 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f21880664c0 msgr2=0x7f2188068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:57.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f21ab8cf640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f21880664c0 0x7f2188068980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21a00aa000 tx=0x7f21a406f150 comp rx=0 tx=0).stop 2023-12-08T20:55:57.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f21ab8cf640 1 -- 172.21.15.53:0/3259530019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21a4147d70 msgr2=0x7f21a41eeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:57.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f21ab8cf640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21a4147d70 0x7f21a41eeda0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f219400c440 tx=0x7f219400c900 comp rx=0 tx=0).stop 2023-12-08T20:55:57.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f21ab8cf640 1 -- 172.21.15.53:0/3259530019 shutdown_connections 2023-12-08T20:55:57.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f21ab8cf640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f21880664c0 0x7f2188068980 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f21ab8cf640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21a40c69e0 0x7f21a4145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f21ab8cf640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21a4147d70 0x7f21a41eeda0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f21ab8cf640 1 --2- 172.21.15.53:0/3259530019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2190005bc0 0x7f21a4152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:57.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f21ab8cf640 1 -- 172.21.15.53:0/3259530019 >> 172.21.15.53:0/3259530019 conn(0x7f21a40c8990 msgr2=0x7f21a41500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:57.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f21ab8cf640 1 -- 172.21.15.53:0/3259530019 shutdown_connections 2023-12-08T20:55:57.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.842+0000 7f21ab8cf640 1 -- 172.21.15.53:0/3259530019 wait complete. 2023-12-08T20:55:57.863 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T20:55:57.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.994+0000 7f9b490da640 1 Processor -- start 2023-12-08T20:55:57.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.994+0000 7f9b490da640 1 -- start start 2023-12-08T20:55:57.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.994+0000 7f9b490da640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b440c9160 0x7f9b440c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:57.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.994+0000 7f9b490da640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b440c98a0 con 0x7f9b440c81c0 2023-12-08T20:55:57.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.994+0000 7f9b490da640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b44159790 con 0x7f9b441539d0 2023-12-08T20:55:57.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.994+0000 7f9b490da640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4406bdd0 con 0x7f9b440c9160 2023-12-08T20:55:57.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.994+0000 7f9b4359e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9b440c81c0 0x7f9b44159c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59888/0 (socket says 172.21.15.53:59888) 2023-12-08T20:55:57.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.994+0000 7f9b4359e640 1 -- 172.21.15.53:0/1087277806 learned_addr learned my addr 172.21.15.53:0/1087277806 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:55:57.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.994+0000 7f9b4259c640 1 --2- 172.21.15.53:0/1087277806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b440c9160 0x7f9b440c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:57.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.998+0000 7f9b41d9b640 1 -- 172.21.15.53:0/1087277806 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809021091 0 0) 0x7f9b440c98a0 con 0x7f9b440c81c0 2023-12-08T20:55:57.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:57.998+0000 7f9b41d9b640 1 -- 172.21.15.53:0/1087277806 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b2c003530 con 0x7f9b440c81c0 2023-12-08T20:55:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.002+0000 7f9b4259c640 1 -- 172.21.15.53:0/1087277806 >> v1:172.21.15.146:6789/0 conn(0x7f9b441539d0 legacy=0x7f9b4406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.002+0000 7f9b4259c640 1 -- 172.21.15.53:0/1087277806 >> v1:172.21.15.53:6789/0 conn(0x7f9b440c81c0 legacy=0x7f9b44159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.002+0000 7f9b4259c640 1 -- 172.21.15.53:0/1087277806 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b44153db0 con 0x7f9b440c9160 2023-12-08T20:55:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.006+0000 7f9b4259c640 1 --2- 172.21.15.53:0/1087277806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b440c9160 0x7f9b440c7c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b380097f0 tx=0x7f9b3801ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a96980a6f557603d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:58.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b41d9b640 1 -- 172.21.15.53:0/1087277806 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b380a89b0 con 0x7f9b440c9160 2023-12-08T20:55:58.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b41d9b640 1 -- 172.21.15.53:0/1087277806 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b380a8b10 con 0x7f9b440c9160 2023-12-08T20:55:58.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b41d9b640 1 -- 172.21.15.53:0/1087277806 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b380a8ea0 con 0x7f9b440c9160 2023-12-08T20:55:58.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 -- 172.21.15.53:0/1087277806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b440c9160 msgr2=0x7f9b440c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:58.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 --2- 172.21.15.53:0/1087277806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b440c9160 0x7f9b440c7c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b380097f0 tx=0x7f9b3801ecb0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 -- 172.21.15.53:0/1087277806 shutdown_connections 2023-12-08T20:55:58.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 --2- 172.21.15.53:0/1087277806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b440c9160 0x7f9b440c7c80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 -- 172.21.15.53:0/1087277806 >> 172.21.15.53:0/1087277806 conn(0x7f9b44070b20 msgr2=0x7f9b44070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:58.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 -- 172.21.15.53:0/1087277806 shutdown_connections 2023-12-08T20:55:58.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 -- 172.21.15.53:0/1087277806 wait complete. 2023-12-08T20:55:58.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 Processor -- start 2023-12-08T20:55:58.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 -- start start 2023-12-08T20:55:58.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b440c81c0 0x7f9b441560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:58.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b440c9160 0x7f9b441588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:58.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b441539d0 0x7f9b441ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:58.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441eefc0 con 0x7f9b440c9160 2023-12-08T20:55:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44156630 con 0x7f9b440c81c0 2023-12-08T20:55:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b490da640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44156ce0 con 0x7f9b441539d0 2023-12-08T20:55:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.018+0000 7f9b4259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b440c9160 0x7f9b441588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.022+0000 7f9b4259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b440c9160 0x7f9b441588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59344/0 (socket says 172.21.15.53:59344) 2023-12-08T20:55:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.022+0000 7f9b4259c640 1 -- 172.21.15.53:0/2448372364 learned_addr learned my addr 172.21.15.53:0/2448372364 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:58.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.022+0000 7f9b42d9d640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b440c81c0 0x7f9b441560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:58.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.022+0000 7f9b4359e640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b441539d0 0x7f9b441ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:58.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.026+0000 7f9b4259c640 1 -- 172.21.15.53:0/2448372364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b441539d0 msgr2=0x7f9b441ef3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:58.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.026+0000 7f9b4259c640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b441539d0 0x7f9b441ef3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.026+0000 7f9b4259c640 1 -- 172.21.15.53:0/2448372364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b440c81c0 msgr2=0x7f9b441560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:58.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.026+0000 7f9b4259c640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b440c81c0 0x7f9b441560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.026+0000 7f9b4259c640 1 -- 172.21.15.53:0/2448372364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b38009420 con 0x7f9b440c9160 2023-12-08T20:55:58.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.026+0000 7f9b4259c640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b440c9160 0x7f9b441588b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9b3801b8c0 tx=0x7f9b3801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.030+0000 7f9b2b7fe640 1 -- 172.21.15.53:0/2448372364 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b380b0e30 con 0x7f9b440c9160 2023-12-08T20:55:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.030+0000 7f9b2b7fe640 1 -- 172.21.15.53:0/2448372364 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b380b9410 con 0x7f9b440c9160 2023-12-08T20:55:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.030+0000 7f9b2b7fe640 1 -- 172.21.15.53:0/2448372364 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b380b97c0 con 0x7f9b440c9160 2023-12-08T20:55:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.030+0000 7f9b490da640 1 -- 172.21.15.53:0/2448372364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b44154070 con 0x7f9b440c9160 2023-12-08T20:55:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.030+0000 7f9b490da640 1 -- 172.21.15.53:0/2448372364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b441545c0 con 0x7f9b440c9160 2023-12-08T20:55:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.034+0000 7f9b490da640 1 -- 172.21.15.53:0/2448372364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b44074190 con 0x7f9b440c9160 2023-12-08T20:55:58.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.330+0000 7f9b2b7fe640 1 -- 172.21.15.53:0/2448372364 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9b380b7040 con 0x7f9b440c9160 2023-12-08T20:55:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.334+0000 7f9b2b7fe640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9b300664c0 0x7f9b30068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.334+0000 7f9b42d9d640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9b300664c0 0x7f9b30068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.334+0000 7f9b42d9d640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9b300664c0 0x7f9b30068980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9b34007fd0 tx=0x7f9b34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:58.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.374+0000 7f9b2b7fe640 1 -- 172.21.15.53:0/2448372364 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9b380f3670 con 0x7f9b440c9160 2023-12-08T20:55:58.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.378+0000 7f9b2b7fe640 1 -- 172.21.15.53:0/2448372364 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b380ef9b0 con 0x7f9b440c9160 2023-12-08T20:55:58.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.554+0000 7f9b490da640 1 -- 172.21.15.53:0/2448372364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b44150970 con 0x7f9b440c9160 2023-12-08T20:55:58.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.658+0000 7f9b2b7fe640 1 -- 172.21.15.53:0/2448372364 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b380b5030 con 0x7f9b440c9160 2023-12-08T20:55:58.659 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-12-08T20:55:58.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.662+0000 7f9b490da640 1 -- 172.21.15.53:0/2448372364 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9b300664c0 msgr2=0x7f9b30068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:58.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.662+0000 7f9b490da640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9b300664c0 0x7f9b30068980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9b34007fd0 tx=0x7f9b34009040 comp rx=0 tx=0).stop 2023-12-08T20:55:58.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.662+0000 7f9b490da640 1 -- 172.21.15.53:0/2448372364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b440c9160 msgr2=0x7f9b441588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:58.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.662+0000 7f9b490da640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b440c9160 0x7f9b441588b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9b3801b8c0 tx=0x7f9b3801ba50 comp rx=0 tx=0).stop 2023-12-08T20:55:58.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.662+0000 7f9b490da640 1 -- 172.21.15.53:0/2448372364 shutdown_connections 2023-12-08T20:55:58.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.662+0000 7f9b490da640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f9b300664c0 0x7f9b30068980 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.662+0000 7f9b490da640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b441539d0 0x7f9b441ef3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.662+0000 7f9b490da640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b440c9160 0x7f9b441588b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.662+0000 7f9b490da640 1 --2- 172.21.15.53:0/2448372364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b440c81c0 0x7f9b441560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.662+0000 7f9b490da640 1 -- 172.21.15.53:0/2448372364 >> 172.21.15.53:0/2448372364 conn(0x7f9b44070b20 msgr2=0x7f9b44159b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:58.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.662+0000 7f9b490da640 1 -- 172.21.15.53:0/2448372364 shutdown_connections 2023-12-08T20:55:58.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.662+0000 7f9b490da640 1 -- 172.21.15.53:0/2448372364 wait complete. 2023-12-08T20:55:58.687 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T20:55:58.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.830+0000 7f2d32910640 1 Processor -- start 2023-12-08T20:55:58.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.830+0000 7f2d32910640 1 -- start start 2023-12-08T20:55:58.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.830+0000 7f2d32910640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d2c0c7910 0x7f2d2c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:58.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.830+0000 7f2d32910640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d2c153810 0x7f2d2c0cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:58.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.830+0000 7f2d32910640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2c06c760 con 0x7f2d2c153430 2023-12-08T20:55:58.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.830+0000 7f2d32910640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c06f8e0 con 0x7f2d2c0c7910 2023-12-08T20:55:58.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.830+0000 7f2d32910640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c06b6c0 con 0x7f2d2c153810 2023-12-08T20:55:58.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.830+0000 7f2d2b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d2c0c7910 0x7f2d2c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:58.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.830+0000 7f2d2b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d2c0c7910 0x7f2d2c0cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59350/0 (socket says 172.21.15.53:59350) 2023-12-08T20:55:58.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.830+0000 7f2d2b7fe640 1 -- 172.21.15.53:0/211391269 learned_addr learned my addr 172.21.15.53:0/211391269 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.834+0000 7f2d2b7fe640 1 -- 172.21.15.53:0/211391269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d2c153810 msgr2=0x7f2d2c0cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.834+0000 7f2d2b7fe640 1 --2- 172.21.15.53:0/211391269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d2c153810 0x7f2d2c0cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.834+0000 7f2d2b7fe640 1 -- 172.21.15.53:0/211391269 >> v1:172.21.15.146:6789/0 conn(0x7f2d2c153430 legacy=0x7f2d2c159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.834+0000 7f2d2b7fe640 1 -- 172.21.15.53:0/211391269 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c06b9a0 con 0x7f2d2c0c7910 2023-12-08T20:55:58.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.838+0000 7f2d2b7fe640 1 --2- 172.21.15.53:0/211391269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2c0c7910 0x7f2d2c0cd0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0ccd70 tx=0x7f2d2001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abed1fc889d18700 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:58.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d2affd640 1 -- 172.21.15.53:0/211391269 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200a8990 con 0x7f2d2c0c7910 2023-12-08T20:55:58.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d2affd640 1 -- 172.21.15.53:0/211391269 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d200a8af0 con 0x7f2d2c0c7910 2023-12-08T20:55:58.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d2affd640 1 -- 172.21.15.53:0/211391269 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200a8e80 con 0x7f2d2c0c7910 2023-12-08T20:55:58.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d32910640 1 -- 172.21.15.53:0/211391269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2c0c7910 msgr2=0x7f2d2c0cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:58.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d32910640 1 --2- 172.21.15.53:0/211391269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2c0c7910 0x7f2d2c0cd0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0ccd70 tx=0x7f2d2001ecd0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d32910640 1 -- 172.21.15.53:0/211391269 shutdown_connections 2023-12-08T20:55:58.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d32910640 1 --2- 172.21.15.53:0/211391269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d2c153810 0x7f2d2c0cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d32910640 1 --2- 172.21.15.53:0/211391269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2c0c7910 0x7f2d2c0cd0c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d32910640 1 -- 172.21.15.53:0/211391269 >> 172.21.15.53:0/211391269 conn(0x7f2d2c0611a0 msgr2=0x7f2d2c0615b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:58.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d32910640 1 -- 172.21.15.53:0/211391269 shutdown_connections 2023-12-08T20:55:58.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d32910640 1 -- 172.21.15.53:0/211391269 wait complete. 2023-12-08T20:55:58.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d32910640 1 Processor -- start 2023-12-08T20:55:58.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.842+0000 7f2d32910640 1 -- start start 2023-12-08T20:55:58.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.846+0000 7f2d32910640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2c0c7910 0x7f2d2c142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:58.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.846+0000 7f2d32910640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d2c153430 0x7f2d2c070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:58.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.846+0000 7f2d32910640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d2c153810 0x7f2d2c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:58.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.846+0000 7f2d32910640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c1efb90 con 0x7f2d2c0c7910 2023-12-08T20:55:58.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.846+0000 7f2d32910640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0b1b60 con 0x7f2d2c153810 2023-12-08T20:55:58.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.846+0000 7f2d32910640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c1eec90 con 0x7f2d2c153430 2023-12-08T20:55:58.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.846+0000 7f2d2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2c0c7910 0x7f2d2c142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:58.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.846+0000 7f2d2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2c0c7910 0x7f2d2c142bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59360/0 (socket says 172.21.15.53:59360) 2023-12-08T20:55:58.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.846+0000 7f2d2bfff640 1 -- 172.21.15.53:0/357248128 learned_addr learned my addr 172.21.15.53:0/357248128 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:58.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.850+0000 7f2d2bfff640 1 -- 172.21.15.53:0/357248128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d2c153430 msgr2=0x7f2d2c070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:58.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.850+0000 7f2d2bfff640 1 --2- 172.21.15.53:0/357248128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d2c153430 0x7f2d2c070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.850+0000 7f2d2bfff640 1 -- 172.21.15.53:0/357248128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d2c153810 msgr2=0x7f2d2c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:58.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.850+0000 7f2d2bfff640 1 --2- 172.21.15.53:0/357248128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d2c153810 0x7f2d2c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:58.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.850+0000 7f2d2bfff640 1 -- 172.21.15.53:0/357248128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d200094d0 con 0x7f2d2c0c7910 2023-12-08T20:55:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.850+0000 7f2d2bfff640 1 --2- 172.21.15.53:0/357248128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2c0c7910 0x7f2d2c142bc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00c490 tx=0x7f2d1c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.854+0000 7f2d28ff9640 1 -- 172.21.15.53:0/357248128 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c003600 con 0x7f2d2c0c7910 2023-12-08T20:55:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.854+0000 7f2d28ff9640 1 -- 172.21.15.53:0/357248128 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c003780 con 0x7f2d2c0c7910 2023-12-08T20:55:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.854+0000 7f2d28ff9640 1 -- 172.21.15.53:0/357248128 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c003b70 con 0x7f2d2c0c7910 2023-12-08T20:55:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.854+0000 7f2d32910640 1 -- 172.21.15.53:0/357248128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c143100 con 0x7f2d2c0c7910 2023-12-08T20:55:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.854+0000 7f2d32910640 1 -- 172.21.15.53:0/357248128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c1eef10 con 0x7f2d2c0c7910 2023-12-08T20:55:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.858+0000 7f2d32910640 1 -- 172.21.15.53:0/357248128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c074190 con 0x7f2d2c0c7910 2023-12-08T20:55:58.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.878+0000 7f2d28ff9640 1 -- 172.21.15.53:0/357248128 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2d1c003cd0 con 0x7f2d2c0c7910 2023-12-08T20:55:58.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.878+0000 7f2d28ff9640 1 --2- 172.21.15.53:0/357248128 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2d180664c0 0x7f2d18068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:58.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.878+0000 7f2d2b7fe640 1 --2- 172.21.15.53:0/357248128 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2d180664c0 0x7f2d18068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:58.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.878+0000 7f2d2b7fe640 1 --2- 172.21.15.53:0/357248128 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2d180664c0 0x7f2d18068980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d200b2000 tx=0x7f2d20004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:58.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:58.882+0000 7f2d28ff9640 1 -- 172.21.15.53:0/357248128 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f2d1c055200 con 0x7f2d2c0c7910 2023-12-08T20:55:59.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.170+0000 7f2d28ff9640 1 -- 172.21.15.53:0/357248128 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d1c050e40 con 0x7f2d2c0c7910 2023-12-08T20:55:59.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.346+0000 7f2d32910640 1 -- 172.21.15.53:0/357248128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2d2c1513c0 con 0x7f2d2c0c7910 2023-12-08T20:55:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d28ff9640 1 -- 172.21.15.53:0/357248128 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2d1c017070 con 0x7f2d2c0c7910 2023-12-08T20:55:59.356 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-12-08T20:55:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d32910640 1 -- 172.21.15.53:0/357248128 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2d180664c0 msgr2=0x7f2d18068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d32910640 1 --2- 172.21.15.53:0/357248128 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2d180664c0 0x7f2d18068980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d200b2000 tx=0x7f2d20004740 comp rx=0 tx=0).stop 2023-12-08T20:55:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d32910640 1 -- 172.21.15.53:0/357248128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2c0c7910 msgr2=0x7f2d2c142bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d32910640 1 --2- 172.21.15.53:0/357248128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2c0c7910 0x7f2d2c142bc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00c490 tx=0x7f2d1c001e80 comp rx=0 tx=0).stop 2023-12-08T20:55:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d32910640 1 -- 172.21.15.53:0/357248128 shutdown_connections 2023-12-08T20:55:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d32910640 1 --2- 172.21.15.53:0/357248128 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2d180664c0 0x7f2d18068980 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d32910640 1 --2- 172.21.15.53:0/357248128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d2c153810 0x7f2d2c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d32910640 1 --2- 172.21.15.53:0/357248128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d2c153430 0x7f2d2c070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d32910640 1 --2- 172.21.15.53:0/357248128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2c0c7910 0x7f2d2c142bc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d32910640 1 -- 172.21.15.53:0/357248128 >> 172.21.15.53:0/357248128 conn(0x7f2d2c0611a0 msgr2=0x7f2d2c0cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d32910640 1 -- 172.21.15.53:0/357248128 shutdown_connections 2023-12-08T20:55:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.358+0000 7f2d32910640 1 -- 172.21.15.53:0/357248128 wait complete. 2023-12-08T20:55:59.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T20:55:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.506+0000 7fb18c411640 1 Processor -- start 2023-12-08T20:55:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.506+0000 7fb18c411640 1 -- start start 2023-12-08T20:55:59.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.506+0000 7fb18c411640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb1840718f0 0x7fb18406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:59.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.506+0000 7fb18c411640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1840726a0 0x7fb184153410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:59.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.506+0000 7fb18c411640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1840c77a0 con 0x7fb1840c67d0 2023-12-08T20:55:59.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.506+0000 7fb18c411640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1840616f0 con 0x7fb1840718f0 2023-12-08T20:55:59.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.506+0000 7fb18c411640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18415a250 con 0x7fb1840726a0 2023-12-08T20:55:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.506+0000 7fb18a1ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb1840718f0 0x7fb18406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.506+0000 7fb18a1ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb1840718f0 0x7fb18406a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59376/0 (socket says 172.21.15.53:59376) 2023-12-08T20:55:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.506+0000 7fb18a1ad640 1 -- 172.21.15.53:0/2393003089 learned_addr learned my addr 172.21.15.53:0/2393003089 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:59.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.514+0000 7fb18a1ad640 1 -- 172.21.15.53:0/2393003089 >> v2:172.21.15.146:3300/0 conn(0x7fb1840726a0 msgr2=0x7fb184153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:55:59.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.514+0000 7fb18a1ad640 1 --2- 172.21.15.53:0/2393003089 >> v2:172.21.15.146:3300/0 conn(0x7fb1840726a0 0x7fb184153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:59.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.514+0000 7fb18a1ad640 1 -- 172.21.15.53:0/2393003089 >> v1:172.21.15.53:6789/0 conn(0x7fb1840c67d0 legacy=0x7fb184071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:59.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.514+0000 7fb18a1ad640 1 -- 172.21.15.53:0/2393003089 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18415a530 con 0x7fb1840718f0 2023-12-08T20:55:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.518+0000 7fb18a1ad640 1 --2- 172.21.15.53:0/2393003089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840718f0 0x7fb18406a5b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb18406e720 tx=0x7fb18001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894f51edc7dc8f8a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.522+0000 7fb1891ab640 1 -- 172.21.15.53:0/2393003089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1800a89f0 con 0x7fb1840718f0 2023-12-08T20:55:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.522+0000 7fb1891ab640 1 -- 172.21.15.53:0/2393003089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1800a8b50 con 0x7fb1840718f0 2023-12-08T20:55:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.522+0000 7fb1891ab640 1 -- 172.21.15.53:0/2393003089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1800b0440 con 0x7fb1840718f0 2023-12-08T20:55:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 -- 172.21.15.53:0/2393003089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840718f0 msgr2=0x7fb18406a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 --2- 172.21.15.53:0/2393003089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840718f0 0x7fb18406a5b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb18406e720 tx=0x7fb18001ecf0 comp rx=0 tx=0).stop 2023-12-08T20:55:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 -- 172.21.15.53:0/2393003089 shutdown_connections 2023-12-08T20:55:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 --2- 172.21.15.53:0/2393003089 >> v2:172.21.15.146:3300/0 conn(0x7fb1840726a0 0x7fb184153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 --2- 172.21.15.53:0/2393003089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840718f0 0x7fb18406a5b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 -- 172.21.15.53:0/2393003089 >> 172.21.15.53:0/2393003089 conn(0x7fb1840c7f70 msgr2=0x7fb1840c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:55:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 -- 172.21.15.53:0/2393003089 shutdown_connections 2023-12-08T20:55:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 -- 172.21.15.53:0/2393003089 wait complete. 2023-12-08T20:55:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 Processor -- start 2023-12-08T20:55:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 -- start start 2023-12-08T20:55:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1840718f0 0x7fb184159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1840726a0 0x7fb184146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840c67d0 0x7fb1841552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1841f3080 con 0x7fb1840c67d0 2023-12-08T20:55:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb184146940 con 0x7fb1840718f0 2023-12-08T20:55:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18c411640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb184147190 con 0x7fb1840726a0 2023-12-08T20:55:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb1899ac640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1840726a0 0x7fb184146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.526+0000 7fb18a1ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1840718f0 0x7fb184159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.530+0000 7fb1899ac640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1840726a0 0x7fb184146400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:47460/0 (socket says 172.21.15.53:47460) 2023-12-08T20:55:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.530+0000 7fb1899ac640 1 -- 172.21.15.53:0/2121433865 learned_addr learned my addr 172.21.15.53:0/2121433865 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:55:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.538+0000 7fb1899ac640 1 -- 172.21.15.53:0/2121433865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1840718f0 msgr2=0x7fb184159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.538+0000 7fb1899ac640 1 --2- 172.21.15.53:0/2121433865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1840718f0 0x7fb184159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.538+0000 7fb1899ac640 1 -- 172.21.15.53:0/2121433865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840c67d0 msgr2=0x7fb1841552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:55:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.538+0000 7fb1899ac640 1 --2- 172.21.15.53:0/2121433865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840c67d0 0x7fb1841552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:55:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.538+0000 7fb1899ac640 1 -- 172.21.15.53:0/2121433865 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1800094d0 con 0x7fb1840726a0 2023-12-08T20:55:59.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.546+0000 7fb1899ac640 1 --2- 172.21.15.53:0/2121433865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1840726a0 0x7fb184146400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb17400c450 tx=0x7fb17400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:59.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.554+0000 7fb17affd640 1 -- 172.21.15.53:0/2121433865 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740052d0 con 0x7fb1840726a0 2023-12-08T20:55:59.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.554+0000 7fb17affd640 1 -- 172.21.15.53:0/2121433865 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb174005430 con 0x7fb1840726a0 2023-12-08T20:55:59.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.554+0000 7fb17affd640 1 -- 172.21.15.53:0/2121433865 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174007260 con 0x7fb1840726a0 2023-12-08T20:55:59.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.554+0000 7fb18c411640 1 -- 172.21.15.53:0/2121433865 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb184154d90 con 0x7fb1840726a0 2023-12-08T20:55:59.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.554+0000 7fb18c411640 1 -- 172.21.15.53:0/2121433865 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1841f34a0 con 0x7fb1840726a0 2023-12-08T20:55:59.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.554+0000 7fb18c411640 1 -- 172.21.15.53:0/2121433865 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1841f31c0 con 0x7fb1840726a0 2023-12-08T20:55:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.894+0000 7fb17affd640 1 -- 172.21.15.53:0/2121433865 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1740073c0 con 0x7fb1840726a0 2023-12-08T20:55:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.894+0000 7fb17affd640 1 --2- 172.21.15.53:0/2121433865 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb1680664a0 0x7fb168068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:55:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.894+0000 7fb18a1ad640 1 --2- 172.21.15.53:0/2121433865 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb1680664a0 0x7fb168068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:55:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.894+0000 7fb18a1ad640 1 --2- 172.21.15.53:0/2121433865 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb1680664a0 0x7fb168068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1800b2000 tx=0x7fb1800aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:55:59.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.902+0000 7fb17affd640 1 -- 172.21.15.53:0/2121433865 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fb174055b40 con 0x7fb1840726a0 2023-12-08T20:55:59.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:55:59.930+0000 7fb17affd640 1 -- 172.21.15.53:0/2121433865 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb174051780 con 0x7fb1840726a0 2023-12-08T20:56:00.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.166+0000 7fb18c411640 1 -- 172.21.15.53:0/2121433865 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1841f31c0 con 0x7fb1840726a0 2023-12-08T20:56:00.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.458+0000 7fb17affd640 1 -- 172.21.15.53:0/2121433865 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6501 (secure 0 0 0) 0x7fb1841f31c0 con 0x7fb1840726a0 2023-12-08T20:56:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:56:00.458 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6838/3541484412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3541484412},{"type":"v1","addr":"172.21.15.53:6838","nonce":3541484412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/2329639389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6837","nonce":2329639389},{"type":"v1","addr":"172.21.15.53:6839","nonce":2329639389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3938297948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3938297948},{"type":"v1","addr":"172.21.15.146:6833","nonce":3938297948}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2026540331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2026540331},{"type":"v1","addr":"172.21.15.146:6836","nonce":2026540331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/4236922545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4236922545},{"type":"v1","addr":"172.21.15.146:6837","nonce":4236922545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T20:54:56.254252+0000","modified":"2023-12-08T20:55:37.903706+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6835/3454931938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3454931938},{"type":"v1","addr":"172.21.15.53:6835","nonce":3454931938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T20:56:00.458 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 10 2023-12-08T20:56:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.462+0000 7fb18c411640 1 -- 172.21.15.53:0/2121433865 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb1680664a0 msgr2=0x7fb168068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.462+0000 7fb18c411640 1 --2- 172.21.15.53:0/2121433865 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb1680664a0 0x7fb168068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1800b2000 tx=0x7fb1800aa070 comp rx=0 tx=0).stop 2023-12-08T20:56:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.462+0000 7fb18c411640 1 -- 172.21.15.53:0/2121433865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1840726a0 msgr2=0x7fb184146400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.462+0000 7fb18c411640 1 --2- 172.21.15.53:0/2121433865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1840726a0 0x7fb184146400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb17400c450 tx=0x7fb17400c910 comp rx=0 tx=0).stop 2023-12-08T20:56:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.462+0000 7fb18c411640 1 -- 172.21.15.53:0/2121433865 shutdown_connections 2023-12-08T20:56:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.462+0000 7fb18c411640 1 --2- 172.21.15.53:0/2121433865 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb1680664a0 0x7fb168068960 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.462+0000 7fb18c411640 1 --2- 172.21.15.53:0/2121433865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840c67d0 0x7fb1841552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.462+0000 7fb18c411640 1 --2- 172.21.15.53:0/2121433865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1840726a0 0x7fb184146400 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.462+0000 7fb18c411640 1 --2- 172.21.15.53:0/2121433865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1840718f0 0x7fb184159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.462+0000 7fb18c411640 1 -- 172.21.15.53:0/2121433865 >> 172.21.15.53:0/2121433865 conn(0x7fb1840c7f70 msgr2=0x7fb18406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.462+0000 7fb18c411640 1 -- 172.21.15.53:0/2121433865 shutdown_connections 2023-12-08T20:56:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.462+0000 7fb18c411640 1 -- 172.21.15.53:0/2121433865 wait complete. 2023-12-08T20:56:00.487 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:56:00.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.618+0000 7fdbf2ab2640 1 Processor -- start 2023-12-08T20:56:00.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.618+0000 7fdbf2ab2640 1 -- start start 2023-12-08T20:56:00.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.622+0000 7fdbf2ab2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbec06ed30 0x7fdbec0c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:00.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.622+0000 7fdbf2ab2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdbec06f110 0x7fdbec06d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:00.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.622+0000 7fdbf2ab2640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbec157e90 con 0x7fdbec071140 2023-12-08T20:56:00.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.622+0000 7fdbf2ab2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbec158170 con 0x7fdbec06f110 2023-12-08T20:56:00.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.622+0000 7fdbf2ab2640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec15a920 con 0x7fdbec06ed30 2023-12-08T20:56:00.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.622+0000 7fdbebfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdbec06f110 0x7fdbec06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:00.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.622+0000 7fdbebfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdbec06f110 0x7fdbec06d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59388/0 (socket says 172.21.15.53:59388) 2023-12-08T20:56:00.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.622+0000 7fdbebfff640 1 -- 172.21.15.53:0/2617690020 learned_addr learned my addr 172.21.15.53:0/2617690020 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:56:00.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.622+0000 7fdbf084e640 1 --2- 172.21.15.53:0/2617690020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbec06ed30 0x7fdbec0c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:00.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.626+0000 7fdbebfff640 1 -- 172.21.15.53:0/2617690020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbec06ed30 msgr2=0x7fdbec0c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:56:00.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.626+0000 7fdbebfff640 1 --2- 172.21.15.53:0/2617690020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbec06ed30 0x7fdbec0c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:00.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.626+0000 7fdbebfff640 1 -- 172.21.15.53:0/2617690020 >> v1:172.21.15.146:6789/0 conn(0x7fdbec071140 legacy=0x7fdbec157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:00.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.626+0000 7fdbebfff640 1 -- 172.21.15.53:0/2617690020 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec15ac00 con 0x7fdbec06f110 2023-12-08T20:56:00.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.630+0000 7fdbebfff640 1 --2- 172.21.15.53:0/2617690020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbec06f110 0x7fdbec06d810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009870 tx=0x7fdbe001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d884099fa71b16d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:00.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/2617690020 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00a8a30 con 0x7fdbec06f110 2023-12-08T20:56:00.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/2617690020 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe00a8b90 con 0x7fdbec06f110 2023-12-08T20:56:00.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/2617690020 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00b0440 con 0x7fdbec06f110 2023-12-08T20:56:00.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/2617690020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbec06f110 msgr2=0x7fdbec06d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:00.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbf2ab2640 1 --2- 172.21.15.53:0/2617690020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbec06f110 0x7fdbec06d810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009870 tx=0x7fdbe001ed30 comp rx=0 tx=0).stop 2023-12-08T20:56:00.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/2617690020 shutdown_connections 2023-12-08T20:56:00.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbf2ab2640 1 --2- 172.21.15.53:0/2617690020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbec06f110 0x7fdbec06d810 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:00.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbf2ab2640 1 --2- 172.21.15.53:0/2617690020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbec06ed30 0x7fdbec0c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:00.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/2617690020 >> 172.21.15.53:0/2617690020 conn(0x7fdbec0caef0 msgr2=0x7fdbec0cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:00.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/2617690020 shutdown_connections 2023-12-08T20:56:00.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/2617690020 wait complete. 2023-12-08T20:56:00.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbf2ab2640 1 Processor -- start 2023-12-08T20:56:00.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.634+0000 7fdbf2ab2640 1 -- start start 2023-12-08T20:56:00.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.638+0000 7fdbf2ab2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbec06ed30 0x7fdbec138db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:00.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.638+0000 7fdbf2ab2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbec06f110 0x7fdbec152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:00.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.638+0000 7fdbf2ab2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbec071140 0x7fdbec153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:00.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.638+0000 7fdbf2ab2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec1eea60 con 0x7fdbec06ed30 2023-12-08T20:56:00.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.638+0000 7fdbf2ab2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec1392f0 con 0x7fdbec06f110 2023-12-08T20:56:00.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.638+0000 7fdbf2ab2640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec15a730 con 0x7fdbec071140 2023-12-08T20:56:00.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.638+0000 7fdbf084e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbec06ed30 0x7fdbec138db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:00.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.638+0000 7fdbf084e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbec06ed30 0x7fdbec138db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59390/0 (socket says 172.21.15.53:59390) 2023-12-08T20:56:00.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.638+0000 7fdbf084e640 1 -- 172.21.15.53:0/3655032227 learned_addr learned my addr 172.21.15.53:0/3655032227 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:56:00.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.638+0000 7fdbebfff640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbec06f110 0x7fdbec152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:00.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.638+0000 7fdbf104f640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbec071140 0x7fdbec153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.642+0000 7fdbf084e640 1 -- 172.21.15.53:0/3655032227 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbec071140 msgr2=0x7fdbec153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.642+0000 7fdbf084e640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbec071140 0x7fdbec153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.642+0000 7fdbf084e640 1 -- 172.21.15.53:0/3655032227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbec06f110 msgr2=0x7fdbec152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.642+0000 7fdbf084e640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbec06f110 0x7fdbec152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.642+0000 7fdbf084e640 1 -- 172.21.15.53:0/3655032227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe00094d0 con 0x7fdbec06ed30 2023-12-08T20:56:00.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.646+0000 7fdbf084e640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbec06ed30 0x7fdbec138db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00e960 tx=0x7fdbdc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:00.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.650+0000 7fdbe97fa640 1 -- 172.21.15.53:0/3655032227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc009690 con 0x7fdbec06ed30 2023-12-08T20:56:00.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.650+0000 7fdbe97fa640 1 -- 172.21.15.53:0/3655032227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc00ca00 con 0x7fdbec06ed30 2023-12-08T20:56:00.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.650+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/3655032227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec1394c0 con 0x7fdbec06ed30 2023-12-08T20:56:00.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.650+0000 7fdbe97fa640 1 -- 172.21.15.53:0/3655032227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc00cd70 con 0x7fdbec06ed30 2023-12-08T20:56:00.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.650+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/3655032227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec15a450 con 0x7fdbec06ed30 2023-12-08T20:56:00.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.650+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/3655032227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec0675b0 con 0x7fdbec06ed30 2023-12-08T20:56:00.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.958+0000 7fdbe97fa640 1 -- 172.21.15.53:0/3655032227 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdbdc013470 con 0x7fdbec06ed30 2023-12-08T20:56:00.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.958+0000 7fdbe97fa640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdbd80664f0 0x7fdbd80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:00.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.958+0000 7fdbebfff640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdbd80664f0 0x7fdbd80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:00.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.958+0000 7fdbebfff640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdbd80664f0 0x7fdbd80689b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00b2000 tx=0x7fdbe00aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:00.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.990+0000 7fdbe97fa640 1 -- 172.21.15.53:0/3655032227 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fdbdc055a00 con 0x7fdbec06ed30 2023-12-08T20:56:00.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:00.990+0000 7fdbe97fa640 1 -- 172.21.15.53:0/3655032227 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdbdc051d40 con 0x7fdbec06ed30 2023-12-08T20:56:01.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.162+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/3655032227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbec15a190 con 0x7fdbec06ed30 2023-12-08T20:56:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.294+0000 7fdbe97fa640 1 -- 172.21.15.53:0/3655032227 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18446 (secure 0 0 0) 0x7fdbdc021020 con 0x7fdbec06ed30 2023-12-08T20:56:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:56:01.296 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:59.702174+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:56:01.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.298+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/3655032227 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdbd80664f0 msgr2=0x7fdbd80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:01.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.298+0000 7fdbf2ab2640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdbd80664f0 0x7fdbd80689b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00b2000 tx=0x7fdbe00aa070 comp rx=0 tx=0).stop 2023-12-08T20:56:01.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.298+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/3655032227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbec06ed30 msgr2=0x7fdbec138db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:01.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.298+0000 7fdbf2ab2640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbec06ed30 0x7fdbec138db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00e960 tx=0x7fdbdc00ee20 comp rx=0 tx=0).stop 2023-12-08T20:56:01.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.298+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/3655032227 shutdown_connections 2023-12-08T20:56:01.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.298+0000 7fdbf2ab2640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fdbd80664f0 0x7fdbd80689b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:01.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.298+0000 7fdbf2ab2640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbec071140 0x7fdbec153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:01.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.298+0000 7fdbf2ab2640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbec06f110 0x7fdbec152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:01.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.298+0000 7fdbf2ab2640 1 --2- 172.21.15.53:0/3655032227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbec06ed30 0x7fdbec138db0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:01.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.298+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/3655032227 >> 172.21.15.53:0/3655032227 conn(0x7fdbec0caef0 msgr2=0x7fdbec06d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:01.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.298+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/3655032227 shutdown_connections 2023-12-08T20:56:01.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.298+0000 7fdbf2ab2640 1 -- 172.21.15.53:0/3655032227 wait complete. 2023-12-08T20:56:01.322 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T20:56:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.458+0000 7fb330468640 1 Processor -- start 2023-12-08T20:56:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.458+0000 7fb330468640 1 -- start start 2023-12-08T20:56:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.458+0000 7fb330468640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb32806ed30 0x7fb3280c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.458+0000 7fb330468640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32806f110 0x7fb32806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.458+0000 7fb330468640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb328157e90 con 0x7fb328071140 2023-12-08T20:56:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.458+0000 7fb330468640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb328158170 con 0x7fb32806ed30 2023-12-08T20:56:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.458+0000 7fb330468640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32815a920 con 0x7fb32806f110 2023-12-08T20:56:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.458+0000 7fb32e204640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb32806ed30 0x7fb3280c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:01.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.462+0000 7fb32e204640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb32806ed30 0x7fb3280c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35612/0 (socket says 172.21.15.53:35612) 2023-12-08T20:56:01.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.462+0000 7fb32e204640 1 -- 172.21.15.53:0/2025227509 learned_addr learned my addr 172.21.15.53:0/2025227509 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:56:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.462+0000 7fb32e204640 1 -- 172.21.15.53:0/2025227509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32806f110 msgr2=0x7fb32806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:56:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.462+0000 7fb32e204640 1 --2- 172.21.15.53:0/2025227509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32806f110 0x7fb32806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.462+0000 7fb32e204640 1 -- 172.21.15.53:0/2025227509 >> v1:172.21.15.146:6789/0 conn(0x7fb328071140 legacy=0x7fb328157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:56:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.462+0000 7fb32e204640 1 -- 172.21.15.53:0/2025227509 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32815ac00 con 0x7fb32806ed30 2023-12-08T20:56:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.466+0000 7fb32e204640 1 --2- 172.21.15.53:0/2025227509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb32806ed30 0x7fb3280c58f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb324009e50 tx=0x7fb32401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad0d2cedc423a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.470+0000 7fb32d202640 1 -- 172.21.15.53:0/2025227509 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3240af400 con 0x7fb32806ed30 2023-12-08T20:56:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.470+0000 7fb32d202640 1 -- 172.21.15.53:0/2025227509 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3240ab050 con 0x7fb32806ed30 2023-12-08T20:56:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.470+0000 7fb32d202640 1 -- 172.21.15.53:0/2025227509 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3240af780 con 0x7fb32806ed30 2023-12-08T20:56:01.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.470+0000 7fb330468640 1 -- 172.21.15.53:0/2025227509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb32806ed30 msgr2=0x7fb3280c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:01.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.470+0000 7fb330468640 1 --2- 172.21.15.53:0/2025227509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb32806ed30 0x7fb3280c58f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb324009e50 tx=0x7fb32401f1c0 comp rx=0 tx=0).stop 2023-12-08T20:56:01.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.470+0000 7fb330468640 1 -- 172.21.15.53:0/2025227509 shutdown_connections 2023-12-08T20:56:01.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.470+0000 7fb330468640 1 --2- 172.21.15.53:0/2025227509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb32806f110 0x7fb32806d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:01.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.470+0000 7fb330468640 1 --2- 172.21.15.53:0/2025227509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb32806ed30 0x7fb3280c58f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:01.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.470+0000 7fb330468640 1 -- 172.21.15.53:0/2025227509 >> 172.21.15.53:0/2025227509 conn(0x7fb3280caef0 msgr2=0x7fb3280cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:01.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.470+0000 7fb330468640 1 -- 172.21.15.53:0/2025227509 shutdown_connections 2023-12-08T20:56:01.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.470+0000 7fb330468640 1 -- 172.21.15.53:0/2025227509 wait complete. 2023-12-08T20:56:01.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.474+0000 7fb330468640 1 Processor -- start 2023-12-08T20:56:01.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.474+0000 7fb330468640 1 -- start start 2023-12-08T20:56:01.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.474+0000 7fb330468640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb32806ed30 0x7fb328154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:01.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.474+0000 7fb330468640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb32806f110 0x7fb3280c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:01.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.474+0000 7fb330468640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb328071140 0x7fb3281ed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:01.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.474+0000 7fb330468640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281548b0 con 0x7fb32806ed30 2023-12-08T20:56:01.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.474+0000 7fb330468640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281f0ff0 con 0x7fb32806f110 2023-12-08T20:56:01.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.474+0000 7fb330468640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281f0470 con 0x7fb328071140 2023-12-08T20:56:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.474+0000 7fb32e204640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb32806ed30 0x7fb328154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.474+0000 7fb32e204640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb32806ed30 0x7fb328154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35628/0 (socket says 172.21.15.53:35628) 2023-12-08T20:56:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.474+0000 7fb32e204640 1 -- 172.21.15.53:0/2457861632 learned_addr learned my addr 172.21.15.53:0/2457861632 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:56:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.478+0000 7fb32ea05640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb328071140 0x7fb3281ed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.478+0000 7fb32e204640 1 -- 172.21.15.53:0/2457861632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb328071140 msgr2=0x7fb3281ed1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.478+0000 7fb32e204640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb328071140 0x7fb3281ed1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.478+0000 7fb32e204640 1 -- 172.21.15.53:0/2457861632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb32806f110 msgr2=0x7fb3280c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.478+0000 7fb32e204640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb32806f110 0x7fb3280c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.478+0000 7fb32e204640 1 -- 172.21.15.53:0/2457861632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb324009b30 con 0x7fb32806ed30 2023-12-08T20:56:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.482+0000 7fb32e204640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb32806ed30 0x7fb328154370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb32401fa60 tx=0x7fb32401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:01.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.490+0000 7fb31effd640 1 -- 172.21.15.53:0/2457861632 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3240afe00 con 0x7fb32806ed30 2023-12-08T20:56:01.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.490+0000 7fb31effd640 1 -- 172.21.15.53:0/2457861632 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3240b9410 con 0x7fb32806ed30 2023-12-08T20:56:01.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.490+0000 7fb31effd640 1 -- 172.21.15.53:0/2457861632 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3240b97c0 con 0x7fb32806ed30 2023-12-08T20:56:01.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.490+0000 7fb330468640 1 -- 172.21.15.53:0/2457861632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3281f0750 con 0x7fb32806ed30 2023-12-08T20:56:01.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.490+0000 7fb330468640 1 -- 172.21.15.53:0/2457861632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3281f0d10 con 0x7fb32806ed30 2023-12-08T20:56:01.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.490+0000 7fb330468640 1 -- 172.21.15.53:0/2457861632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3280675b0 con 0x7fb32806ed30 2023-12-08T20:56:01.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.786+0000 7fb31effd640 1 -- 172.21.15.53:0/2457861632 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3240b6050 con 0x7fb32806ed30 2023-12-08T20:56:01.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.786+0000 7fb31effd640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb30c066470 0x7fb30c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:01.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.786+0000 7fb32da03640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb30c066470 0x7fb30c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:01.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.786+0000 7fb32da03640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb30c066470 0x7fb30c068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb32813ba10 tx=0x7fb318006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.818+0000 7fb31effd640 1 -- 172.21.15.53:0/2457861632 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fb3240f34e0 con 0x7fb32806ed30 2023-12-08T20:56:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:01.818+0000 7fb31effd640 1 -- 172.21.15.53:0/2457861632 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3240ef120 con 0x7fb32806ed30 2023-12-08T20:56:02.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.006+0000 7fb330468640 1 -- 172.21.15.53:0/2457861632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb328070f20 con 0x7fb32806ed30 2023-12-08T20:56:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb31effd640 1 -- 172.21.15.53:0/2457861632 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6501 (secure 0 0 0) 0x7fb3240c1020 con 0x7fb32806ed30 2023-12-08T20:56:02.041 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T20:56:02.041 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6838/3541484412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3541484412},{"type":"v1","addr":"172.21.15.53:6838","nonce":3541484412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/2329639389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6837","nonce":2329639389},{"type":"v1","addr":"172.21.15.53:6839","nonce":2329639389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3938297948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3938297948},{"type":"v1","addr":"172.21.15.146:6833","nonce":3938297948}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2026540331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2026540331},{"type":"v1","addr":"172.21.15.146:6836","nonce":2026540331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/4236922545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4236922545},{"type":"v1","addr":"172.21.15.146:6837","nonce":4236922545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T20:54:56.254252+0000","modified":"2023-12-08T20:55:37.903706+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6835/3454931938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3454931938},{"type":"v1","addr":"172.21.15.53:6835","nonce":3454931938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T20:56:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 10 2023-12-08T20:56:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb330468640 1 -- 172.21.15.53:0/2457861632 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb30c066470 msgr2=0x7fb30c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb330468640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb30c066470 0x7fb30c068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb32813ba10 tx=0x7fb318006ca0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb330468640 1 -- 172.21.15.53:0/2457861632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb32806ed30 msgr2=0x7fb328154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb330468640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb32806ed30 0x7fb328154370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb32401fa60 tx=0x7fb32401bf60 comp rx=0 tx=0).stop 2023-12-08T20:56:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb330468640 1 -- 172.21.15.53:0/2457861632 shutdown_connections 2023-12-08T20:56:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb330468640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb30c066470 0x7fb30c068930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb330468640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb328071140 0x7fb3281ed1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb330468640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb32806f110 0x7fb3280c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb330468640 1 --2- 172.21.15.53:0/2457861632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb32806ed30 0x7fb328154370 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb330468640 1 -- 172.21.15.53:0/2457861632 >> 172.21.15.53:0/2457861632 conn(0x7fb3280caef0 msgr2=0x7fb32806d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb330468640 1 -- 172.21.15.53:0/2457861632 shutdown_connections 2023-12-08T20:56:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.042+0000 7fb330468640 1 -- 172.21.15.53:0/2457861632 wait complete. 2023-12-08T20:56:02.665 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T20:54:56.254252+0000', 'modified': '2023-12-08T20:55:37.903706+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4258}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4258': {'gid': 4258, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.53:6835/3454931938', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 3454931938}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 3454931938}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-08T20:56:02.665 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T20:56:02.665 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-08T20:56:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.802+0000 7f4f13703640 1 Processor -- start 2023-12-08T20:56:02.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.802+0000 7f4f13703640 1 -- start start 2023-12-08T20:56:02.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.806+0000 7f4f13703640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f0c153760 0x7f4f0c061a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.806+0000 7f4f13703640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f0c0ca680 0x7f4f0c06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.806+0000 7f4f13703640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c0c9870 con 0x7f4f0c153b40 2023-12-08T20:56:02.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.806+0000 7f4f13703640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c0cb6a0 con 0x7f4f0c153760 2023-12-08T20:56:02.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.806+0000 7f4f13703640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0cabe0 con 0x7f4f0c0ca680 2023-12-08T20:56:02.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.806+0000 7f4f10c9e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4f0c153b40 0x7f4f0c0cb870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35598/0 (socket says 172.21.15.53:35598) 2023-12-08T20:56:02.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.806+0000 7f4f10c9e640 1 -- 172.21.15.53:0/2230855432 learned_addr learned my addr 172.21.15.53:0/2230855432 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:56:02.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.806+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/2230855432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f0c0ca680 0x7f4f0c06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.806+0000 7f4f1149f640 1 --2- 172.21.15.53:0/2230855432 >> v2:172.21.15.146:3300/0 conn(0x7f4f0c153760 0x7f4f0c061a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.810+0000 7f4f0bfff640 1 -- 172.21.15.53:0/2230855432 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918464104 0 0) 0x7f4f0c0c9870 con 0x7f4f0c153b40 2023-12-08T20:56:02.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.810+0000 7f4f0bfff640 1 -- 172.21.15.53:0/2230855432 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef4003530 con 0x7f4f0c153b40 2023-12-08T20:56:02.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.814+0000 7f4f11ca0640 1 -- 172.21.15.53:0/2230855432 >> v2:172.21.15.146:3300/0 conn(0x7f4f0c153760 msgr2=0x7f4f0c061a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:56:02.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.814+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/2230855432 >> v2:172.21.15.146:3300/0 conn(0x7f4f0c153760 0x7f4f0c061a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.814+0000 7f4f11ca0640 1 -- 172.21.15.53:0/2230855432 >> v1:172.21.15.53:6789/0 conn(0x7f4f0c153b40 legacy=0x7f4f0c0cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:02.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.814+0000 7f4f11ca0640 1 -- 172.21.15.53:0/2230855432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c15d670 con 0x7f4f0c0ca680 2023-12-08T20:56:02.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.818+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/2230855432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f0c0ca680 0x7f4f0c06bce0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009dc0 tx=0x7f4f0401f120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a487afe1015d52 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:02.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.826+0000 7f4f0bfff640 1 -- 172.21.15.53:0/2230855432 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f040af600 con 0x7f4f0c0ca680 2023-12-08T20:56:02.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.826+0000 7f4f0bfff640 1 -- 172.21.15.53:0/2230855432 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f040ab050 con 0x7f4f0c0ca680 2023-12-08T20:56:02.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.826+0000 7f4f0bfff640 1 -- 172.21.15.53:0/2230855432 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f040af980 con 0x7f4f0c0ca680 2023-12-08T20:56:02.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.826+0000 7f4f13703640 1 -- 172.21.15.53:0/2230855432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f0c0ca680 msgr2=0x7f4f0c06bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:02.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.826+0000 7f4f13703640 1 --2- 172.21.15.53:0/2230855432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f0c0ca680 0x7f4f0c06bce0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009dc0 tx=0x7f4f0401f120 comp rx=0 tx=0).stop 2023-12-08T20:56:02.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.826+0000 7f4f13703640 1 -- 172.21.15.53:0/2230855432 shutdown_connections 2023-12-08T20:56:02.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.826+0000 7f4f13703640 1 --2- 172.21.15.53:0/2230855432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f0c0ca680 0x7f4f0c06bce0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.826+0000 7f4f13703640 1 --2- 172.21.15.53:0/2230855432 >> v2:172.21.15.146:3300/0 conn(0x7f4f0c153760 0x7f4f0c061a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.826+0000 7f4f13703640 1 -- 172.21.15.53:0/2230855432 >> 172.21.15.53:0/2230855432 conn(0x7f4f0c08b5c0 msgr2=0x7f4f0c060fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:02.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.826+0000 7f4f13703640 1 -- 172.21.15.53:0/2230855432 shutdown_connections 2023-12-08T20:56:02.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.826+0000 7f4f13703640 1 -- 172.21.15.53:0/2230855432 wait complete. 2023-12-08T20:56:02.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f13703640 1 Processor -- start 2023-12-08T20:56:02.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f13703640 1 -- start start 2023-12-08T20:56:02.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f13703640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f0c0ca680 0x7f4f0c1f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f13703640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f0c153760 0x7f4f0c1eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f13703640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f0c1553b0 0x7f4f0c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f13703640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c15c9d0 con 0x7f4f0c0ca680 2023-12-08T20:56:02.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f13703640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c152eb0 con 0x7f4f0c153760 2023-12-08T20:56:02.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f13703640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c15cc20 con 0x7f4f0c1553b0 2023-12-08T20:56:02.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f1149f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f0c0ca680 0x7f4f0c1f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f1149f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f0c0ca680 0x7f4f0c1f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35638/0 (socket says 172.21.15.53:35638) 2023-12-08T20:56:02.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f1149f640 1 -- 172.21.15.53:0/285229228 learned_addr learned my addr 172.21.15.53:0/285229228 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:56:02.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f10c9e640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f0c153760 0x7f4f0c1eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.830+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f0c1553b0 0x7f4f0c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.834+0000 7f4f1149f640 1 -- 172.21.15.53:0/285229228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f0c1553b0 msgr2=0x7f4f0c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.834+0000 7f4f1149f640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f0c1553b0 0x7f4f0c0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.834+0000 7f4f1149f640 1 -- 172.21.15.53:0/285229228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f0c153760 msgr2=0x7f4f0c1eeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.834+0000 7f4f1149f640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f0c153760 0x7f4f0c1eeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.834+0000 7f4f1149f640 1 -- 172.21.15.53:0/285229228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f04009a70 con 0x7f4f0c0ca680 2023-12-08T20:56:02.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.834+0000 7f4f1149f640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f0c0ca680 0x7f4f0c1f2e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00e930 tx=0x7f4efc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.842+0000 7f4f09ffb640 1 -- 172.21.15.53:0/285229228 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc009690 con 0x7f4f0c0ca680 2023-12-08T20:56:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.842+0000 7f4f09ffb640 1 -- 172.21.15.53:0/285229228 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc00ca00 con 0x7f4f0c0ca680 2023-12-08T20:56:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.842+0000 7f4f09ffb640 1 -- 172.21.15.53:0/285229228 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00cd70 con 0x7f4f0c0ca680 2023-12-08T20:56:02.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.842+0000 7f4f13703640 1 -- 172.21.15.53:0/285229228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c15cf00 con 0x7f4f0c0ca680 2023-12-08T20:56:02.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.842+0000 7f4f13703640 1 -- 172.21.15.53:0/285229228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c1542b0 con 0x7f4f0c0ca680 2023-12-08T20:56:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.846+0000 7f4f16833000 1 Processor -- start 2023-12-08T20:56:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.846+0000 7f4f16833000 1 -- start start 2023-12-08T20:56:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.846+0000 7f4f16833000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce3930 0x560b05ce3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.846+0000 7f4f16833000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05ce8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.846+0000 7f4f16833000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce9310 0x560b05ce96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.846+0000 7f4f16833000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b05b12130 con 0x560b05ce89f0 2023-12-08T20:56:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.846+0000 7f4f16833000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b05aff9a0 con 0x560b05ce9310 2023-12-08T20:56:02.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.846+0000 7f4f16833000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b05afced0 con 0x560b05ce3930 2023-12-08T20:56:02.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.846+0000 7f4f11ca0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce3930 0x560b05ce3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.850+0000 7f4f11ca0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce3930 0x560b05ce3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:55300/0 (socket says 172.21.15.53:55300) 2023-12-08T20:56:02.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.850+0000 7f4f11ca0640 1 -- 172.21.15.53:0/878106393 learned_addr learned my addr 172.21.15.53:0/878106393 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:56:02.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.850+0000 7f4f10c9e640 1 --2- 172.21.15.53:0/878106393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce9310 0x560b05ce96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.854+0000 7f4f11ca0640 1 -- 172.21.15.53:0/878106393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce9310 msgr2=0x560b05ce96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:56:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.854+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/878106393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce9310 0x560b05ce96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.854+0000 7f4f11ca0640 1 -- 172.21.15.53:0/878106393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 msgr2=0x560b05ce8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:56:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.854+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/878106393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05ce8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.854+0000 7f4f11ca0640 1 -- 172.21.15.53:0/878106393 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b057f0890 con 0x560b05ce3930 2023-12-08T20:56:02.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.858+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/878106393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce3930 0x560b05ce3d10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009dc0 tx=0x7f4f04004ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d52bbb867f9d7387 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:02.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.866+0000 7f4f09ffb640 1 -- 172.21.15.53:0/285229228 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4efc013470 con 0x7f4f0c0ca680 2023-12-08T20:56:02.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.866+0000 7f4f09ffb640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4ef80664f0 0x7f4ef80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.866+0000 7f4f1149f640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4ef80664f0 0x7f4ef80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.866+0000 7f4f1149f640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4ef80664f0 0x7f4ef80689b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00cfd0 tx=0x7f4efc069040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:02.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.866+0000 7f4f09ffb640 1 -- 172.21.15.53:0/285229228 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4efc067360 con 0x7f4f0c0ca680 2023-12-08T20:56:02.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.866+0000 7f4ef2ffd640 1 -- 172.21.15.53:0/878106393 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f040af7c0 con 0x560b05ce3930 2023-12-08T20:56:02.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.866+0000 7f4ef2ffd640 1 -- 172.21.15.53:0/878106393 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f040bf070 con 0x560b05ce3930 2023-12-08T20:56:02.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.866+0000 7f4ef2ffd640 1 -- 172.21.15.53:0/878106393 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f040afb60 con 0x560b05ce3930 2023-12-08T20:56:02.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 -- 172.21.15.53:0/878106393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce3930 msgr2=0x560b05ce3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 --2- 172.21.15.53:0/878106393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce3930 0x560b05ce3d10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009dc0 tx=0x7f4f04004ac0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 -- 172.21.15.53:0/878106393 shutdown_connections 2023-12-08T20:56:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 --2- 172.21.15.53:0/878106393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce9310 0x560b05ce96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 --2- 172.21.15.53:0/878106393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05ce8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 --2- 172.21.15.53:0/878106393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce3930 0x560b05ce3d10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 -- 172.21.15.53:0/878106393 >> 172.21.15.53:0/878106393 conn(0x560b05ce47a0 msgr2=0x560b05ce6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 -- 172.21.15.53:0/878106393 shutdown_connections 2023-12-08T20:56:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 -- 172.21.15.53:0/878106393 wait complete. 2023-12-08T20:56:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 -- start start 2023-12-08T20:56:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 Processor -- start 2023-12-08T20:56:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05ce2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce89f0 0x560b05ce3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce9310 0x560b05cf2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b05af87c0 con 0x560b05ce9310 2023-12-08T20:56:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b05ab0bf0 con 0x560b05ce3930 2023-12-08T20:56:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b05ab6a90 con 0x560b05ce89f0 2023-12-08T20:56:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.870+0000 7f4f16833000 10 client.0 _ll_register_callbacks cb 0x560b05c933c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T20:56:02.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.874+0000 7f4f11ca0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05ce2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.874+0000 7f4f11ca0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce9310 0x560b05cf2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.874+0000 7f4f11ca0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05ce2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:50950/0 (socket says 172.21.15.53:50950) 2023-12-08T20:56:02.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.874+0000 7f4f11ca0640 1 -- 172.21.15.53:0/534032260 learned_addr learned my addr 172.21.15.53:0/534032260 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:56:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.874+0000 7f4f10c9e640 1 --2- 172.21.15.53:0/534032260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce89f0 0x560b05ce3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.882+0000 7f4f11ca0640 1 -- 172.21.15.53:0/534032260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce89f0 msgr2=0x560b05ce3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:56:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.882+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/534032260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce89f0 0x560b05ce3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.882+0000 7f4f11ca0640 1 -- 172.21.15.53:0/534032260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 msgr2=0x560b05ce2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:56:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.882+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/534032260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05ce2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.882+0000 7f4f11ca0640 1 -- 172.21.15.53:0/534032260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c15d670 con 0x560b05ce9310 2023-12-08T20:56:02.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.886+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/534032260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce9310 0x560b05cf2990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4f0401f160 tx=0x7f4f04009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8f8e41d74c9cae server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:02.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.886+0000 7f4ee7fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-12-08T20:56:02.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.890+0000 7f4ee7fff640 1 -- 172.21.15.53:0/534032260 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f040af810 con 0x560b05ce9310 2023-12-08T20:56:02.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.890+0000 7f4ee7fff640 1 -- 172.21.15.53:0/534032260 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4f040d0dd0 con 0x560b05ce9310 2023-12-08T20:56:02.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.890+0000 7f4f16833000 1 -- 172.21.15.53:0/534032260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b05aba470 con 0x560b05ce9310 2023-12-08T20:56:02.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.894+0000 7f4ee7fff640 1 -- 172.21.15.53:0/534032260 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f040af970 con 0x560b05ce9310 2023-12-08T20:56:02.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.894+0000 7f4f16833000 10 client.4638 fetch_fsmap learned FSMap version 10 2023-12-08T20:56:02.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.894+0000 7f4f16833000 1 -- 172.21.15.53:0/534032260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x560b05ab9190 con 0x560b05ce9310 2023-12-08T20:56:02.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.902+0000 7f4ee7fff640 1 -- 172.21.15.53:0/534032260 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560b05aba470 con 0x560b05ce9310 2023-12-08T20:56:02.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.902+0000 7f4ee7fff640 1 -- 172.21.15.53:0/534032260 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 10) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f4f04005d20 con 0x560b05ce9310 2023-12-08T20:56:02.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.902+0000 7f4f16833000 10 client.4638 fetch_fsmap finished waiting for FSMap version 10 2023-12-08T20:56:02.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.902+0000 7f4f16833000 10 client.4638 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-08T20:56:02.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.902+0000 7f4f16833000 20 client.4638 populate_metadata read hostname 'smithi053' 2023-12-08T20:56:02.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.902+0000 7f4f16833000 1 --2- 172.21.15.53:0/534032260 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x560b05cf36d0 0x560b05cf3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.902+0000 7f4f16833000 4 client.4638 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T20:56:02.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.902+0000 7f4f16833000 1 -- 172.21.15.53:0/534032260 --> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b05abdb50 con 0x560b05cf36d0 2023-12-08T20:56:02.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.902+0000 7f4f10c9e640 1 --2- 172.21.15.53:0/534032260 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x560b05cf36d0 0x560b05cf3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.906+0000 7f4f10c9e640 1 --2- 172.21.15.53:0/534032260 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x560b05cf36d0 0x560b05cf3ab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8394819d8743628a server_cookie=be3e94a7842b7f40 in_seq=0 out_seq=0 2023-12-08T20:56:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.906+0000 7f4ee7fff640 10 client.4638 ms_handle_connect on v2:172.21.15.53:6834/3454931938 2023-12-08T20:56:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4ee7fff640 1 -- 172.21.15.53:0/534032260 <== mds.0 v2:172.21.15.53:6834/3454931938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560b05abdb50 con 0x560b05cf36d0 2023-12-08T20:56:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4ee7fff640 10 client.4638 handle_command_reply: tid=0 2023-12-08T20:56:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4f16833000 1 client.4638 shutdown 2023-12-08T20:56:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4f16833000 1 -- 172.21.15.53:0/534032260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce9310 msgr2=0x560b05cf2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4f16833000 1 --2- 172.21.15.53:0/534032260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce9310 0x560b05cf2990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4f0401f160 tx=0x7f4f04009750 comp rx=0 tx=0).stop 2023-12-08T20:56:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4f16833000 1 -- 172.21.15.53:0/534032260 shutdown_connections 2023-12-08T20:56:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4f16833000 1 --2- 172.21.15.53:0/534032260 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x560b05cf36d0 0x560b05cf3ab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4f16833000 1 --2- 172.21.15.53:0/534032260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce9310 0x560b05cf2990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4f16833000 1 --2- 172.21.15.53:0/534032260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce89f0 0x560b05ce3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4f16833000 1 --2- 172.21.15.53:0/534032260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05ce2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4ee7fff640 0 client.4638 ms_handle_reset on v2:172.21.15.53:6834/3454931938 2023-12-08T20:56:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4f16833000 1 -- 172.21.15.53:0/534032260 >> 172.21.15.53:0/534032260 conn(0x560b05ce47a0 msgr2=0x560b05cadba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4f16833000 1 -- 172.21.15.53:0/534032260 shutdown_connections 2023-12-08T20:56:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4f16833000 1 -- 172.21.15.53:0/534032260 wait complete. 2023-12-08T20:56:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.938+0000 7f4f16833000 20 client.4638 trim_cache size 0 max 16384 2023-12-08T20:56:02.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.978+0000 7f4f16833000 1 Processor -- start 2023-12-08T20:56:02.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.982+0000 7f4f16833000 1 -- start start 2023-12-08T20:56:02.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.982+0000 7f4f16833000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05cf3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.982+0000 7f4f16833000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05cf3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.982+0000 7f4f16833000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce9310 0x560b05cf4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:02.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.982+0000 7f4f16833000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b057b1940 con 0x560b05ce89f0 2023-12-08T20:56:02.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.982+0000 7f4f16833000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b05afc7c0 con 0x560b05ce3930 2023-12-08T20:56:02.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.982+0000 7f4f16833000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b05aafa10 con 0x560b05ce9310 2023-12-08T20:56:02.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.982+0000 7f4f10c9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05cf3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.982+0000 7f4f11ca0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce9310 0x560b05cf4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.982+0000 7f4f11ca0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05cf3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:02.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.982+0000 7f4f10c9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05cf3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35670/0 (socket says 172.21.15.53:35670) 2023-12-08T20:56:02.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.982+0000 7f4f10c9e640 1 -- 172.21.15.53:0/218646359 learned_addr learned my addr 172.21.15.53:0/218646359 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:56:02.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.990+0000 7f4f10c9e640 1 -- 172.21.15.53:0/218646359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce9310 msgr2=0x560b05cf4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:56:02.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.990+0000 7f4f10c9e640 1 --2- 172.21.15.53:0/218646359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce9310 0x560b05cf4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.990+0000 7f4f10c9e640 1 -- 172.21.15.53:0/218646359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 msgr2=0x560b05cf3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:56:02.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.990+0000 7f4f10c9e640 1 --2- 172.21.15.53:0/218646359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05cf3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:02.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.990+0000 7f4f10c9e640 1 -- 172.21.15.53:0/218646359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b05a9f490 con 0x560b05ce89f0 2023-12-08T20:56:02.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:02.994+0000 7f4f10c9e640 1 --2- 172.21.15.53:0/218646359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05cf3ff0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c15a670 tx=0x7f4f00007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fde7fddf1d1524 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:03.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.002+0000 7f4ef37fe640 1 -- 172.21.15.53:0/218646359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0001d070 con 0x560b05ce89f0 2023-12-08T20:56:03.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.002+0000 7f4ef37fe640 1 -- 172.21.15.53:0/218646359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f000047f0 con 0x560b05ce89f0 2023-12-08T20:56:03.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.002+0000 7f4ef37fe640 1 -- 172.21.15.53:0/218646359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00004b60 con 0x560b05ce89f0 2023-12-08T20:56:03.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 -- 172.21.15.53:0/218646359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 msgr2=0x560b05cf3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:03.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 --2- 172.21.15.53:0/218646359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05cf3ff0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c15a670 tx=0x7f4f00007d40 comp rx=0 tx=0).stop 2023-12-08T20:56:03.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 -- 172.21.15.53:0/218646359 shutdown_connections 2023-12-08T20:56:03.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 --2- 172.21.15.53:0/218646359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce9310 0x560b05cf4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 --2- 172.21.15.53:0/218646359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05cf3ff0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 --2- 172.21.15.53:0/218646359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05cf3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 -- 172.21.15.53:0/218646359 >> 172.21.15.53:0/218646359 conn(0x560b05ce47a0 msgr2=0x560b05cf1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:03.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 -- 172.21.15.53:0/218646359 shutdown_connections 2023-12-08T20:56:03.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 -- 172.21.15.53:0/218646359 wait complete. 2023-12-08T20:56:03.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 -- start start 2023-12-08T20:56:03.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 Processor -- start 2023-12-08T20:56:03.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05caa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:03.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05d0f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:03.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce9310 0x560b05d0fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:03.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b05cad220 con 0x560b05ce89f0 2023-12-08T20:56:03.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b05af87c0 con 0x560b05ce3930 2023-12-08T20:56:03.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b05caf890 con 0x560b05ce9310 2023-12-08T20:56:03.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.006+0000 7f4f16833000 10 client.0 _ll_register_callbacks cb 0x560b05c73bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T20:56:03.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.010+0000 7f4f10c9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05d0f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.010+0000 7f4f10c9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05d0f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35676/0 (socket says 172.21.15.53:35676) 2023-12-08T20:56:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.010+0000 7f4f10c9e640 1 -- 172.21.15.53:0/59603975 learned_addr learned my addr 172.21.15.53:0/59603975 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:56:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.010+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce9310 0x560b05d0fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.010+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05caa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:03.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.014+0000 7f4f10c9e640 1 -- 172.21.15.53:0/59603975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce9310 msgr2=0x560b05d0fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:56:03.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.014+0000 7f4f10c9e640 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce9310 0x560b05d0fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.014+0000 7f4f10c9e640 1 -- 172.21.15.53:0/59603975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 msgr2=0x560b05caa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T20:56:03.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.014+0000 7f4f10c9e640 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05caa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.014+0000 7f4f10c9e640 1 -- 172.21.15.53:0/59603975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef4003530 con 0x560b05ce89f0 2023-12-08T20:56:03.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.018+0000 7f4f10c9e640 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05d0f690 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4f00001210 tx=0x7f4f00000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c77b6819d00bd70 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:03.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.018+0000 7f4ee7fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-12-08T20:56:03.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.022+0000 7f4ee7fff640 1 -- 172.21.15.53:0/59603975 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00004ea0 con 0x560b05ce89f0 2023-12-08T20:56:03.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.022+0000 7f4ee7fff640 1 -- 172.21.15.53:0/59603975 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4f00006230 con 0x560b05ce89f0 2023-12-08T20:56:03.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.022+0000 7f4f16833000 1 -- 172.21.15.53:0/59603975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b05af7110 con 0x560b05ce89f0 2023-12-08T20:56:03.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.022+0000 7f4ee7fff640 1 -- 172.21.15.53:0/59603975 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f000063f0 con 0x560b05ce89f0 2023-12-08T20:56:03.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.022+0000 7f4f16833000 10 client.4644 fetch_fsmap learned FSMap version 10 2023-12-08T20:56:03.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.022+0000 7f4f16833000 1 -- 172.21.15.53:0/59603975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x560b057f0cc0 con 0x560b05ce89f0 2023-12-08T20:56:03.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.030+0000 7f4ee7fff640 1 -- 172.21.15.53:0/59603975 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560b05af7110 con 0x560b05ce89f0 2023-12-08T20:56:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.030+0000 7f4ee7fff640 1 -- 172.21.15.53:0/59603975 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 10) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f4f00012040 con 0x560b05ce89f0 2023-12-08T20:56:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.030+0000 7f4f16833000 10 client.4644 fetch_fsmap finished waiting for FSMap version 10 2023-12-08T20:56:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.030+0000 7f4f16833000 10 client.4644 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-08T20:56:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.030+0000 7f4f16833000 20 client.4644 populate_metadata read hostname 'smithi053' 2023-12-08T20:56:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.030+0000 7f4f16833000 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x560b05d10110 0x560b05d56ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.030+0000 7f4f16833000 4 client.4644 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T20:56:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.030+0000 7f4f16833000 1 -- 172.21.15.53:0/59603975 --> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560b05b269a0 con 0x560b05d10110 2023-12-08T20:56:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.030+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x560b05d10110 0x560b05d56ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:03.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.034+0000 7f4ee7fff640 10 client.4644 ms_handle_connect on v2:172.21.15.53:6834/3454931938 2023-12-08T20:56:03.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.034+0000 7f4f11ca0640 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x560b05d10110 0x560b05d56ac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d0351bdb5ca4abf server_cookie=b547ad3b14600b31 in_seq=0 out_seq=0 2023-12-08T20:56:03.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.038+0000 7f4ee7fff640 1 -- 172.21.15.53:0/59603975 <== mds.0 v2:172.21.15.53:6834/3454931938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x560b05b269a0 con 0x560b05d10110 2023-12-08T20:56:03.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.038+0000 7f4ee7fff640 10 client.4644 handle_command_reply: tid=0 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.038+0000 7f4f16833000 1 client.4644 shutdown 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.038+0000 7f4f16833000 1 -- 172.21.15.53:0/59603975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 msgr2=0x560b05d0f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.038+0000 7f4f16833000 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05d0f690 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4f00001210 tx=0x7f4f00000ee0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.038+0000 7f4f16833000 1 -- 172.21.15.53:0/59603975 shutdown_connections 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.038+0000 7f4f16833000 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.53:6834/3454931938,v1:172.21.15.53:6835/3454931938] conn(0x560b05d10110 0x560b05d56ac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.038+0000 7f4f16833000 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560b05ce9310 0x560b05d0fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.038+0000 7f4f16833000 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b05ce89f0 0x560b05d0f690 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.038+0000 7f4f16833000 1 --2- 172.21.15.53:0/59603975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b05ce3930 0x560b05caa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.038+0000 7f4ee7fff640 0 client.4644 ms_handle_reset on v2:172.21.15.53:6834/3454931938 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f16833000 1 -- 172.21.15.53:0/59603975 >> 172.21.15.53:0/59603975 conn(0x560b05ce47a0 msgr2=0x560b05cf4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f16833000 1 -- 172.21.15.53:0/59603975 shutdown_connections 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f16833000 1 -- 172.21.15.53:0/59603975 wait complete. 2023-12-08T20:56:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f16833000 20 client.4644 trim_cache size 0 max 16384 2023-12-08T20:56:03.042 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-12-08T20:56:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "b118091f-f50b-41fe-890c-fae34a9e8e21", 2023-12-08T20:56:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-12-08T20:56:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4258, 2023-12-08T20:56:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-12-08T20:56:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-12-08T20:56:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-12-08T20:56:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 64.864896449, 2023-12-08T20:56:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 10, 2023-12-08T20:56:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 30, 2023-12-08T20:56:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 28, 2023-12-08T20:56:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 82.658086076000004 2023-12-08T20:56:03.043 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-12-08T20:56:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f13703640 1 -- 172.21.15.53:0/285229228 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4ef80664f0 msgr2=0x7f4ef80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f13703640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4ef80664f0 0x7f4ef80689b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00cfd0 tx=0x7f4efc069040 comp rx=0 tx=0).stop 2023-12-08T20:56:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f13703640 1 -- 172.21.15.53:0/285229228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f0c0ca680 msgr2=0x7f4f0c1f2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f13703640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f0c0ca680 0x7f4f0c1f2e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00e930 tx=0x7f4efc00edf0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f13703640 1 -- 172.21.15.53:0/285229228 shutdown_connections 2023-12-08T20:56:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f13703640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4ef80664f0 0x7f4ef80689b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f13703640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f0c1553b0 0x7f4f0c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f13703640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f0c153760 0x7f4f0c1eeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f13703640 1 --2- 172.21.15.53:0/285229228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f0c0ca680 0x7f4f0c1f2e00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f13703640 1 -- 172.21.15.53:0/285229228 >> 172.21.15.53:0/285229228 conn(0x7f4f0c08b5c0 msgr2=0x7f4f0c073900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f13703640 1 -- 172.21.15.53:0/285229228 shutdown_connections 2023-12-08T20:56:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.042+0000 7f4f13703640 1 -- 172.21.15.53:0/285229228 wait complete. 2023-12-08T20:56:03.069 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-08T20:56:03.085 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-08T20:56:03.086 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-12-08T20:56:03.086 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-12-08T20:56:03.086 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T20:56:03.086 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T20:56:03.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:03.086 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-12-08T20:56:03.093 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-08T20:56:03.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:03.093 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T20:56:03.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:03.153 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2023-12-08T20:56:03.330 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-08T20:56:03.330 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T20:56:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.466+0000 7f6cd846c640 1 Processor -- start 2023-12-08T20:56:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.466+0000 7f6cd846c640 1 -- start start 2023-12-08T20:56:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.466+0000 7f6cd846c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6cd00718f0 0x7f6cd006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.466+0000 7f6cd846c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd00c77a0 con 0x7f6cd00c67d0 2023-12-08T20:56:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.466+0000 7f6cd846c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd015a250 con 0x7f6cd00726a0 2023-12-08T20:56:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.466+0000 7f6cd846c640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd00616f0 con 0x7f6cd00718f0 2023-12-08T20:56:03.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.542+0000 7f6cd5a07640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6cd00c67d0 0x7f6cd0071cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35600/0 (socket says 172.21.15.53:35600) 2023-12-08T20:56:03.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.542+0000 7f6cd5a07640 1 -- 172.21.15.53:0/3255571215 learned_addr learned my addr 172.21.15.53:0/3255571215 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T20:56:03.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.558+0000 7f6cd6208640 1 --2- 172.21.15.53:0/3255571215 >> v2:172.21.15.146:3300/0 conn(0x7f6cd00718f0 0x7f6cd006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:03.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.566+0000 7f6cd5206640 1 -- 172.21.15.53:0/3255571215 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252703884 0 0) 0x7f6cd00c77a0 con 0x7f6cd00c67d0 2023-12-08T20:56:03.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.566+0000 7f6cd5206640 1 -- 172.21.15.53:0/3255571215 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cbc003530 con 0x7f6cd00c67d0 2023-12-08T20:56:03.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.566+0000 7f6cd6208640 1 -- 172.21.15.53:0/3255571215 >> v1:172.21.15.146:6789/0 conn(0x7f6cd00726a0 legacy=0x7f6cd0153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:03.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.566+0000 7f6cd6208640 1 -- 172.21.15.53:0/3255571215 >> v1:172.21.15.53:6789/0 conn(0x7f6cd00c67d0 legacy=0x7f6cd0071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:03.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.566+0000 7f6cd6208640 1 -- 172.21.15.53:0/3255571215 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd015a530 con 0x7f6cd00718f0 2023-12-08T20:56:03.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.586+0000 7f6cd6208640 1 --2- 172.21.15.53:0/3255571215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd00718f0 0x7f6cd006a5b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009d90 tx=0x7f6ccc01f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f03856fa44cf1c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:03.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.602+0000 7f6cd5206640 1 -- 172.21.15.53:0/3255571215 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0af600 con 0x7f6cd00718f0 2023-12-08T20:56:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.602+0000 7f6cd5206640 1 -- 172.21.15.53:0/3255571215 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc0ab050 con 0x7f6cd00718f0 2023-12-08T20:56:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.602+0000 7f6cd5206640 1 -- 172.21.15.53:0/3255571215 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0af980 con 0x7f6cd00718f0 2023-12-08T20:56:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 -- 172.21.15.53:0/3255571215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd00718f0 msgr2=0x7f6cd006a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 --2- 172.21.15.53:0/3255571215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd00718f0 0x7f6cd006a5b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009d90 tx=0x7f6ccc01f130 comp rx=0 tx=0).stop 2023-12-08T20:56:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 -- 172.21.15.53:0/3255571215 shutdown_connections 2023-12-08T20:56:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 --2- 172.21.15.53:0/3255571215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd00718f0 0x7f6cd006a5b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 -- 172.21.15.53:0/3255571215 >> 172.21.15.53:0/3255571215 conn(0x7f6cd00c7f70 msgr2=0x7f6cd00c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 -- 172.21.15.53:0/3255571215 shutdown_connections 2023-12-08T20:56:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 -- 172.21.15.53:0/3255571215 wait complete. 2023-12-08T20:56:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 Processor -- start 2023-12-08T20:56:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 -- start start 2023-12-08T20:56:03.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cd00718f0 0x7f6cd014c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:03.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd00726a0 0x7f6cd01f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:03.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cd00c67d0 0x7f6cd0159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:03.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd0156130 con 0x7f6cd00718f0 2023-12-08T20:56:03.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd01546a0 con 0x7f6cd00726a0 2023-12-08T20:56:03.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.606+0000 7f6cd846c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd014bc50 con 0x7f6cd00c67d0 2023-12-08T20:56:03.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.610+0000 7f6cd5a07640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd00726a0 0x7f6cd01f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:03.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.610+0000 7f6cd6a09640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cd00c67d0 0x7f6cd0159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.610+0000 7f6cd6a09640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cd00c67d0 0x7f6cd0159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:55340/0 (socket says 172.21.15.53:55340) 2023-12-08T20:56:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.610+0000 7f6cd6a09640 1 -- 172.21.15.53:0/703816614 learned_addr learned my addr 172.21.15.53:0/703816614 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T20:56:03.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.618+0000 7f6cd6208640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cd00718f0 0x7f6cd014c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:03.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.622+0000 7f6cd6a09640 1 -- 172.21.15.53:0/703816614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd00726a0 msgr2=0x7f6cd01f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:03.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.622+0000 7f6cd6a09640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd00726a0 0x7f6cd01f3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.622+0000 7f6cd6a09640 1 -- 172.21.15.53:0/703816614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cd00718f0 msgr2=0x7f6cd014c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:03.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.622+0000 7f6cd6a09640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cd00718f0 0x7f6cd014c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:03.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.622+0000 7f6cd6a09640 1 -- 172.21.15.53:0/703816614 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc009a70 con 0x7f6cd00c67d0 2023-12-08T20:56:03.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.626+0000 7f6cd6a09640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cd00c67d0 0x7f6cd0159780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c460 tx=0x7f6cc800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:03.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.634+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/703816614 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8005220 con 0x7f6cd00c67d0 2023-12-08T20:56:03.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.634+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/703816614 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc8005380 con 0x7f6cd00c67d0 2023-12-08T20:56:03.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.634+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/703816614 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8007270 con 0x7f6cd00c67d0 2023-12-08T20:56:03.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.634+0000 7f6cd846c640 1 -- 172.21.15.53:0/703816614 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd01f35d0 con 0x7f6cd00c67d0 2023-12-08T20:56:03.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.638+0000 7f6cd846c640 1 -- 172.21.15.53:0/703816614 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd0155e50 con 0x7f6cd00c67d0 2023-12-08T20:56:03.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.638+0000 7f6cd846c640 1 -- 172.21.15.53:0/703816614 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd0074190 con 0x7f6cd00c67d0 2023-12-08T20:56:03.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.946+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/703816614 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6cc80073d0 con 0x7f6cd00c67d0 2023-12-08T20:56:03.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.946+0000 7f6cc6ffd640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6cb40664c0 0x7f6cb4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:56:03.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.946+0000 7f6cd6208640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6cb40664c0 0x7f6cb4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:56:03.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.950+0000 7f6cd6208640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6cb40664c0 0x7f6cb4068980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0b1000 tx=0x7f6ccc0aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:56:03.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.950+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/703816614 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f6cc8007680 con 0x7f6cd00c67d0 2023-12-08T20:56:03.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:03.962+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/703816614 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6cc8051920 con 0x7f6cd00c67d0 2023-12-08T20:56:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.178+0000 7f6cd846c640 1 -- 172.21.15.53:0/703816614 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6cd01547e0 con 0x7f6cd00c67d0 2023-12-08T20:56:04.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.186+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/703816614 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6cc8054f40 con 0x7f6cd00c67d0 2023-12-08T20:56:04.186 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-08T20:56:04.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.190+0000 7f6cd846c640 1 -- 172.21.15.53:0/703816614 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6cb40664c0 msgr2=0x7f6cb4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:04.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.190+0000 7f6cd846c640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6cb40664c0 0x7f6cb4068980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0b1000 tx=0x7f6ccc0aa000 comp rx=0 tx=0).stop 2023-12-08T20:56:04.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.190+0000 7f6cd846c640 1 -- 172.21.15.53:0/703816614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cd00c67d0 msgr2=0x7f6cd0159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:56:04.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.190+0000 7f6cd846c640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cd00c67d0 0x7f6cd0159780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c460 tx=0x7f6cc800c920 comp rx=0 tx=0).stop 2023-12-08T20:56:04.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.190+0000 7f6cd846c640 1 -- 172.21.15.53:0/703816614 shutdown_connections 2023-12-08T20:56:04.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.190+0000 7f6cd846c640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6cb40664c0 0x7f6cb4068980 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:04.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.190+0000 7f6cd846c640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cd00c67d0 0x7f6cd0159780 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:04.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.190+0000 7f6cd846c640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd00726a0 0x7f6cd01f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:04.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.190+0000 7f6cd846c640 1 --2- 172.21.15.53:0/703816614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cd00718f0 0x7f6cd014c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:56:04.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.190+0000 7f6cd846c640 1 -- 172.21.15.53:0/703816614 >> 172.21.15.53:0/703816614 conn(0x7f6cd00c7f70 msgr2=0x7f6cd0071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:56:04.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.190+0000 7f6cd846c640 1 -- 172.21.15.53:0/703816614 shutdown_connections 2023-12-08T20:56:04.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:04.190+0000 7f6cd846c640 1 -- 172.21.15.53:0/703816614 wait complete. 2023-12-08T20:56:04.207 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T20:56:04.208 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T20:56:04.208 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-12-08T20:56:04.208 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T20:56:04.208 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T20:56:04.208 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T20:56:04.208 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T20:56:04.208 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T20:56:04.208 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T20:56:04.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:04.208 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-12-08T20:56:04.214 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T20:56:04.215 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-12-08T20:56:04.216 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-12-08T20:56:04.216 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-08T20:56:04.216 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42024sec preferred_lft 42024sec 2023-12-08T20:56:04.216 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-12-08T20:56:04.216 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:56:04.216 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T20:56:04.216 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-12-08T20:56:04.216 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-12-08T20:56:04.216 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T20:56:04.216 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:7e:62:58:1a brd ff:ff:ff:ff:ff:ff 2023-12-08T20:56:04.216 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T20:56:04.217 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:56:04.218 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-08T20:56:04.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:04.218 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-12-08T20:56:04.218 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-12-08T20:56:04.218 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add name ceph-brx type bridge 2023-12-08T20:56:04.218 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr flush dev ceph-brx 2023-12-08T20:56:04.218 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set ceph-brx up 2023-12-08T20:56:04.218 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-08T20:56:04.218 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-12-08T20:56:04.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:04.298 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T20:56:04.349 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-12-08T20:56:04.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:04.350 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-12-08T20:56:04.397 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-12-08T20:56:04.397 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T20:56:04.398 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-08T20:56:04.398 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T20:56:04.398 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-08T20:56:04.398 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T20:56:04.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:04.398 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-12-08T20:56:04.398 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-12-08T20:56:04.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T20:56:04.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T20:56:04.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T20:56:04.399 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-12-08T20:56:04.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:04.477 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-12-08T20:56:04.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:04.524 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2023-12-08T20:56:04.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:04.572 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-12-08T20:56:04.572 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-12-08T20:56:04.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:04.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-08T20:56:04.573 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-12-08T20:56:04.647 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-08T20:56:04.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:04.647 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-12-08T20:56:04.647 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-12-08T20:56:04.647 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-08T20:56:04.647 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-08T20:56:04.647 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-08T20:56:04.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-08T20:56:04.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-08T20:56:04.648 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-12-08T20:56:04.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:04.740 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-12-08T20:56:04.740 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-12-08T20:56:04.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-12-08T20:56:04.741 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.0 master ceph-brx 2023-12-08T20:56:04.741 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-12-08T20:56:04.759 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-12-08T20:56:04.759 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T20:56:04.759 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T20:56:04.812 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T20:56:04.813 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T20:56:04.813 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T20:56:04.860 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-08T20:56:04.860 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-12-08T20:56:04.917 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T20:56:04.966 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2023-12-08T20:56:04.966 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2023-12-08T20:56:04.966 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2023-12-08T20:56:04.966 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2023-12-08T20:56:04.966 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2023-12-08T20:56:04.966 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2023-12-08T20:56:04.967 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2023-12-08T20:56:04.967 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2023-12-08T20:56:04.967 INFO:teuthology.orchestra.run.smithi053.stdout:/run/lock 2023-12-08T20:56:04.967 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2023-12-08T20:56:04.967 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2023-12-08T20:56:04.967 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2023-12-08T20:56:04.967 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T20:56:04.967 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2023-12-08T20:56:04.967 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2023-12-08T20:56:04.967 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2023-12-08T20:56:04.967 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2023-12-08T20:56:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/fs/nfsd 2023-12-08T20:56:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2023-12-08T20:56:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2023-12-08T20:56:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2023-12-08T20:56:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:/run/rpc_pipefs 2023-12-08T20:56:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2023-12-08T20:56:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2023-12-08T20:56:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T20:56:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T20:56:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T20:56:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T20:56:04.969 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2023-12-08T20:56:04.969 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:04.969 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:04.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:04.970 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-12-08T20:56:05.017 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-08T20:56:05.017 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-08T20:56:05.066 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-12-08T20:56:05.080 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T20:56:05.129 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2023-12-08T20:56:05.129 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2023-12-08T20:56:05.129 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2023-12-08T20:56:05.129 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2023-12-08T20:56:05.129 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2023-12-08T20:56:05.129 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2023-12-08T20:56:05.129 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2023-12-08T20:56:05.129 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2023-12-08T20:56:05.129 INFO:teuthology.orchestra.run.smithi053.stdout:/run/lock 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/fs/nfsd 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/run/rpc_pipefs 2023-12-08T20:56:05.130 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2023-12-08T20:56:05.131 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2023-12-08T20:56:05.131 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T20:56:05.131 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T20:56:05.131 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T20:56:05.131 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T20:56:05.131 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2023-12-08T20:56:05.131 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:05.131 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:05.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:05.132 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-12-08T20:56:06.286 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-12-08T20:56:06.301 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T20:56:06.352 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2023-12-08T20:56:06.352 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2023-12-08T20:56:06.352 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/run/lock 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2023-12-08T20:56:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/fs/nfsd 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/run/rpc_pipefs 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:06.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:06.355 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-12-08T20:56:07.502 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-12-08T20:56:07.517 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T20:56:07.569 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2023-12-08T20:56:07.569 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2023-12-08T20:56:07.569 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2023-12-08T20:56:07.569 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2023-12-08T20:56:07.569 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2023-12-08T20:56:07.569 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2023-12-08T20:56:07.569 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2023-12-08T20:56:07.569 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2023-12-08T20:56:07.569 INFO:teuthology.orchestra.run.smithi053.stdout:/run/lock 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/fs/nfsd 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/run/rpc_pipefs 2023-12-08T20:56:07.570 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2023-12-08T20:56:07.571 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2023-12-08T20:56:07.571 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T20:56:07.571 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T20:56:07.571 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T20:56:07.571 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T20:56:07.571 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2023-12-08T20:56:07.571 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:07.571 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:07.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:07.572 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-12-08T20:56:08.729 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-12-08T20:56:08.746 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T20:56:08.793 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2023-12-08T20:56:08.793 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2023-12-08T20:56:08.793 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2023-12-08T20:56:08.793 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2023-12-08T20:56:08.793 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2023-12-08T20:56:08.793 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2023-12-08T20:56:08.793 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2023-12-08T20:56:08.793 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/run/lock 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/fs/nfsd 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2023-12-08T20:56:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2023-12-08T20:56:08.795 INFO:teuthology.orchestra.run.smithi053.stdout:/run/rpc_pipefs 2023-12-08T20:56:08.795 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2023-12-08T20:56:08.795 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2023-12-08T20:56:08.795 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T20:56:08.795 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T20:56:08.795 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T20:56:08.795 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T20:56:08.795 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2023-12-08T20:56:08.795 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:08.795 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:08.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:08.796 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-12-08T20:56:09.945 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-12-08T20:56:09.961 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T20:56:10.008 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2023-12-08T20:56:10.008 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2023-12-08T20:56:10.008 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/run/lock 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2023-12-08T20:56:10.009 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/fs/nfsd 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/run/rpc_pipefs 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2023-12-08T20:56:10.010 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:10.011 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:10.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:10.012 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-12-08T20:56:11.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-12-08T20:56:11.178 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T20:56:11.225 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2023-12-08T20:56:11.226 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2023-12-08T20:56:11.226 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2023-12-08T20:56:11.226 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2023-12-08T20:56:11.226 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2023-12-08T20:56:11.226 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2023-12-08T20:56:11.226 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2023-12-08T20:56:11.226 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2023-12-08T20:56:11.226 INFO:teuthology.orchestra.run.smithi053.stdout:/run/lock 2023-12-08T20:56:11.226 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2023-12-08T20:56:11.226 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2023-12-08T20:56:11.226 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2023-12-08T20:56:11.227 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T20:56:11.227 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2023-12-08T20:56:11.227 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2023-12-08T20:56:11.227 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2023-12-08T20:56:11.227 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2023-12-08T20:56:11.227 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/fs/nfsd 2023-12-08T20:56:11.227 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2023-12-08T20:56:11.227 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2023-12-08T20:56:11.227 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2023-12-08T20:56:11.227 INFO:teuthology.orchestra.run.smithi053.stdout:/run/rpc_pipefs 2023-12-08T20:56:11.227 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2023-12-08T20:56:11.227 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2023-12-08T20:56:11.228 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T20:56:11.228 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T20:56:11.228 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T20:56:11.228 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T20:56:11.228 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2023-12-08T20:56:11.228 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:11.228 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:11.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:11.229 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-12-08T20:56:12.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[44874]: starting ceph client 2023-12-08T20:56:12.288 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-12-08T20:56:12.074+0000 68d1100 -1 init, newargv = 0x7e2e170 newargc=15 2023-12-08T20:56:12.379 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-12-08T20:56:12.392 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T20:56:12.440 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2023-12-08T20:56:12.441 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2023-12-08T20:56:12.441 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2023-12-08T20:56:12.441 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2023-12-08T20:56:12.441 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2023-12-08T20:56:12.441 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2023-12-08T20:56:12.441 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2023-12-08T20:56:12.441 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2023-12-08T20:56:12.441 INFO:teuthology.orchestra.run.smithi053.stdout:/run/lock 2023-12-08T20:56:12.441 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2023-12-08T20:56:12.441 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2023-12-08T20:56:12.441 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/fs/nfsd 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/run/rpc_pipefs 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2023-12-08T20:56:12.442 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T20:56:12.443 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T20:56:12.443 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T20:56:12.443 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T20:56:12.443 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2023-12-08T20:56:12.443 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:12.443 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:12.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:12.444 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-12-08T20:56:13.284 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[44874]: starting fuse 2023-12-08T20:56:13.598 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-12-08T20:56:13.614 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T20:56:13.667 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2023-12-08T20:56:13.667 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/run/lock 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2023-12-08T20:56:13.668 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/fs/nfsd 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/run/rpc_pipefs 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:13.669 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:56:13.670 INFO:teuthology.orchestra.run.smithi053.stdout:/home/ubuntu/cephtest/mnt.0 2023-12-08T20:56:13.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:13.671 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-12-08T20:56:13.717 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-12-08T20:56:13.717 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-12-08T20:56:13.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo stdin-killer -- python3 -c ' 2023-12-08T20:56:13.717 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-12-08T20:56:13.717 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-12-08T20:56:13.718 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-12-08T20:56:13.718 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-12-08T20:56:13.718 DEBUG:teuthology.orchestra.run.smithi053:> 2023-12-08T20:56:13.718 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-12-08T20:56:13.718 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-08T20:56:13.718 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-12-08T20:56:13.718 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-08T20:56:13.718 DEBUG:teuthology.orchestra.run.smithi053:> 2023-12-08T20:56:13.718 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-12-08T20:56:13.718 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-12-08T20:56:13.719 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-12-08T20:56:13.719 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-12-08T20:56:13.719 DEBUG:teuthology.orchestra.run.smithi053:> 2023-12-08T20:56:13.719 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-12-08T20:56:13.719 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T20:56:13.719 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T20:56:13.719 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T20:56:13.719 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-12-08T20:56:13.719 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-12-08T20:56:13.719 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-12-08T20:56:13.720 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T20:56:13.720 DEBUG:teuthology.orchestra.run.smithi053:> 2023-12-08T20:56:13.720 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-12-08T20:56:13.720 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-12-08T20:56:13.844 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.44874.asok 2023-12-08T20:56:13.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T20:56:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T20:56:13.858 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44874.asok 2023-12-08T20:56:13.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:13.859 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44874.asok status 2023-12-08T20:56:14.182 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-12-08T20:56:14.182 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-12-08T20:56:14.182 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "9dcc13bb80dcc1cdea72b04d80505b4649a2b882", 2023-12-08T20:56:14.182 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)", 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "44874", 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4603, 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 4603 2023-12-08T20:56:14.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:0", 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1907388050 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:0", 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1907388050 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.4603 172.21.15.53:0/1907388050", 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "172.21.15.53:0/1907388050", 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-12-08T20:56:14.184 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 10, 2023-12-08T20:56:14.185 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 30, 2023-12-08T20:56:14.185 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-12-08T20:56:14.185 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-12-08T20:56:14.185 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-12-08T20:56:14.185 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-12-08T20:56:14.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:14.200 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-12-08T20:56:14.200 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-08T20:56:14.281 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-12-08T20:56:14.281 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-08T20:56:14.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:56:14.281 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T20:56:14.330 INFO:teuthology.run_tasks:Running task workunit... 2023-12-08T20:56:14.344 INFO:tasks.workunit:Pulling workunits from ref 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:56:14.344 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-08T20:56:14.344 INFO:tasks.workunit:timeout=3h 2023-12-08T20:56:14.344 INFO:tasks.workunit:cleanup=True 2023-12-08T20:56:14.345 DEBUG:teuthology.orchestra.run.smithi053:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-08T20:56:14.352 INFO:teuthology.orchestra.run.smithi053.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-08T20:56:14.352 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-12-08T20:56:14.352 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 2dh/45d Inode: 1 Links: 2 2023-12-08T20:56:14.352 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:56:14.352 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-08T20:56:14.352 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-12-08 20:54:58.496747642 +0000 2023-12-08T20:56:14.352 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-12-08 20:55:15.098314737 +0000 2023-12-08T20:56:14.352 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-12-08T20:56:14.353 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-08T20:56:14.353 DEBUG:teuthology.orchestra.run.smithi053:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-08T20:56:15.030 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:56:15.038 INFO:tasks.workunit.client.0.smithi053.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-08T20:56:26.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:56:26.741 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:56:56.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:56:56.797 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:57:23.665 INFO:tasks.workunit.client.0.smithi053.stderr:Note: switching to '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'. 2023-12-08T20:57:23.665 INFO:tasks.workunit.client.0.smithi053.stderr: 2023-12-08T20:57:23.665 INFO:tasks.workunit.client.0.smithi053.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-08T20:57:23.665 INFO:tasks.workunit.client.0.smithi053.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-08T20:57:23.665 INFO:tasks.workunit.client.0.smithi053.stderr:state without impacting any branches by switching back to a branch. 2023-12-08T20:57:23.665 INFO:tasks.workunit.client.0.smithi053.stderr: 2023-12-08T20:57:23.666 INFO:tasks.workunit.client.0.smithi053.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-08T20:57:23.666 INFO:tasks.workunit.client.0.smithi053.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-08T20:57:23.666 INFO:tasks.workunit.client.0.smithi053.stderr: 2023-12-08T20:57:23.666 INFO:tasks.workunit.client.0.smithi053.stderr: git switch -c 2023-12-08T20:57:23.666 INFO:tasks.workunit.client.0.smithi053.stderr: 2023-12-08T20:57:23.666 INFO:tasks.workunit.client.0.smithi053.stderr:Or undo this operation with: 2023-12-08T20:57:23.666 INFO:tasks.workunit.client.0.smithi053.stderr: 2023-12-08T20:57:23.666 INFO:tasks.workunit.client.0.smithi053.stderr: git switch - 2023-12-08T20:57:23.666 INFO:tasks.workunit.client.0.smithi053.stderr: 2023-12-08T20:57:23.666 INFO:tasks.workunit.client.0.smithi053.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-08T20:57:23.666 INFO:tasks.workunit.client.0.smithi053.stderr: 2023-12-08T20:57:23.666 INFO:tasks.workunit.client.0.smithi053.stderr:HEAD is now at 9dcc13bb80d Merge pull request #54751 from zdover23/wip-doc-2023-12-02-radosgw-multisite-starting-the-gateway 2023-12-08T20:57:23.670 DEBUG:teuthology.orchestra.run.smithi053:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-08T20:57:23.678 INFO:tasks.workunit.client.0.smithi053.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-08T20:57:23.680 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-08T20:57:23.680 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-08T20:57:24.490 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-08T20:57:24.593 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-08T20:57:24.642 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-08T20:57:24.644 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-08T20:57:24.644 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-08T20:57:24.691 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-08T20:57:24.694 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T20:57:24.694 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-08T20:57:24.740 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-12-08T20:57:24.741 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-12-08T20:57:24.741 DEBUG:teuthology.orchestra.run.smithi053:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-12-08T20:57:25.170 INFO:tasks.workunit.client.0.smithi053.stderr:+ dbench 1 2023-12-08T20:57:25.183 INFO:tasks.workunit.client.0.smithi053.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-12-08T20:57:25.184 INFO:tasks.workunit.client.0.smithi053.stdout: 2023-12-08T20:57:25.184 INFO:tasks.workunit.client.0.smithi053.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-12-08T20:57:25.186 INFO:tasks.workunit.client.0.smithi053.stdout:0 of 1 processes prepared for launch 0 sec 2023-12-08T20:57:25.286 INFO:tasks.workunit.client.0.smithi053.stdout:1 of 1 processes prepared for launch 0 sec 2023-12-08T20:57:25.286 INFO:tasks.workunit.client.0.smithi053.stdout:releasing clients 2023-12-08T20:57:26.286 INFO:tasks.workunit.client.0.smithi053.stdout: 0 7 0.00 MB/sec warmup 1 sec latency 171.901 ms 2023-12-08T20:57:26.923 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:57:26.926 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:57:27.286 INFO:tasks.workunit.client.0.smithi053.stdout: 0 12 0.00 MB/sec warmup 2 sec latency 28.274 ms 2023-12-08T20:57:28.286 INFO:tasks.workunit.client.0.smithi053.stdout: 1 31 0.35 MB/sec warmup 3 sec latency 428.552 ms 2023-12-08T20:57:29.287 INFO:tasks.workunit.client.0.smithi053.stdout: 1 71 0.79 MB/sec warmup 4 sec latency 501.106 ms 2023-12-08T20:57:30.287 INFO:tasks.workunit.client.0.smithi053.stdout: 1 91 0.84 MB/sec warmup 5 sec latency 496.596 ms 2023-12-08T20:57:31.287 INFO:tasks.workunit.client.0.smithi053.stdout: 1 121 0.92 MB/sec warmup 6 sec latency 469.653 ms 2023-12-08T20:57:32.287 INFO:tasks.workunit.client.0.smithi053.stdout: 1 137 0.86 MB/sec warmup 7 sec latency 470.201 ms 2023-12-08T20:57:33.287 INFO:tasks.workunit.client.0.smithi053.stdout: 1 147 0.79 MB/sec warmup 8 sec latency 529.024 ms 2023-12-08T20:57:34.287 INFO:tasks.workunit.client.0.smithi053.stdout: 1 157 0.73 MB/sec warmup 9 sec latency 468.590 ms 2023-12-08T20:57:35.287 INFO:tasks.workunit.client.0.smithi053.stdout: 1 173 0.71 MB/sec warmup 10 sec latency 526.677 ms 2023-12-08T20:57:36.288 INFO:tasks.workunit.client.0.smithi053.stdout: 1 189 0.69 MB/sec warmup 11 sec latency 626.607 ms 2023-12-08T20:57:37.287 INFO:tasks.workunit.client.0.smithi053.stdout: 1 199 0.65 MB/sec warmup 12 sec latency 526.491 ms 2023-12-08T20:57:38.287 INFO:tasks.workunit.client.0.smithi053.stdout: 1 210 0.62 MB/sec warmup 13 sec latency 581.251 ms 2023-12-08T20:57:39.287 INFO:tasks.workunit.client.0.smithi053.stdout: 1 223 0.62 MB/sec warmup 14 sec latency 492.763 ms 2023-12-08T20:57:40.287 INFO:tasks.workunit.client.0.smithi053.stdout: 1 239 0.61 MB/sec warmup 15 sec latency 511.122 ms 2023-12-08T20:57:41.288 INFO:tasks.workunit.client.0.smithi053.stdout: 1 255 0.60 MB/sec warmup 16 sec latency 576.452 ms 2023-12-08T20:57:42.288 INFO:tasks.workunit.client.0.smithi053.stdout: 1 263 0.58 MB/sec warmup 17 sec latency 560.000 ms 2023-12-08T20:57:43.288 INFO:tasks.workunit.client.0.smithi053.stdout: 1 279 0.58 MB/sec warmup 18 sec latency 642.157 ms 2023-12-08T20:57:44.288 INFO:tasks.workunit.client.0.smithi053.stdout: 1 297 0.58 MB/sec warmup 19 sec latency 517.167 ms 2023-12-08T20:57:45.288 INFO:tasks.workunit.client.0.smithi053.stdout: 1 306 0.56 MB/sec warmup 20 sec latency 480.289 ms 2023-12-08T20:57:46.289 INFO:tasks.workunit.client.0.smithi053.stdout: 1 323 0.56 MB/sec warmup 21 sec latency 395.740 ms 2023-12-08T20:57:47.288 INFO:tasks.workunit.client.0.smithi053.stdout: 1 337 0.55 MB/sec warmup 22 sec latency 664.464 ms 2023-12-08T20:57:48.288 INFO:tasks.workunit.client.0.smithi053.stdout: 1 349 0.54 MB/sec warmup 23 sec latency 554.106 ms 2023-12-08T20:57:49.288 INFO:tasks.workunit.client.0.smithi053.stdout: 1 357 0.53 MB/sec warmup 24 sec latency 591.344 ms 2023-12-08T20:57:50.288 INFO:tasks.workunit.client.0.smithi053.stdout: 1 373 0.53 MB/sec warmup 25 sec latency 507.711 ms 2023-12-08T20:57:51.289 INFO:tasks.workunit.client.0.smithi053.stdout: 1 389 0.53 MB/sec warmup 26 sec latency 571.236 ms 2023-12-08T20:57:52.288 INFO:tasks.workunit.client.0.smithi053.stdout: 1 405 0.53 MB/sec warmup 27 sec latency 561.509 ms 2023-12-08T20:57:53.289 INFO:tasks.workunit.client.0.smithi053.stdout: 1 413 0.52 MB/sec warmup 28 sec latency 622.294 ms 2023-12-08T20:57:54.289 INFO:tasks.workunit.client.0.smithi053.stdout: 1 429 0.52 MB/sec warmup 29 sec latency 553.829 ms 2023-12-08T20:57:55.289 INFO:tasks.workunit.client.0.smithi053.stdout: 1 444 0.52 MB/sec warmup 30 sec latency 562.207 ms 2023-12-08T20:57:56.289 INFO:tasks.workunit.client.0.smithi053.stdout: 1 453 0.51 MB/sec warmup 31 sec latency 678.286 ms 2023-12-08T20:57:56.969 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:57:56.972 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:57:57.289 INFO:tasks.workunit.client.0.smithi053.stdout: 1 469 0.51 MB/sec warmup 32 sec latency 596.291 ms 2023-12-08T20:57:58.289 INFO:tasks.workunit.client.0.smithi053.stdout: 1 477 0.51 MB/sec warmup 33 sec latency 670.642 ms 2023-12-08T20:57:59.290 INFO:tasks.workunit.client.0.smithi053.stdout: 1 493 0.51 MB/sec warmup 34 sec latency 602.638 ms 2023-12-08T20:58:00.289 INFO:tasks.workunit.client.0.smithi053.stdout: 1 503 0.50 MB/sec warmup 35 sec latency 586.232 ms 2023-12-08T20:58:01.289 INFO:tasks.workunit.client.0.smithi053.stdout: 1 513 0.49 MB/sec warmup 36 sec latency 703.342 ms 2023-12-08T20:58:02.289 INFO:tasks.workunit.client.0.smithi053.stdout: 1 542 0.52 MB/sec warmup 37 sec latency 489.218 ms 2023-12-08T20:58:03.289 INFO:tasks.workunit.client.0.smithi053.stdout: 1 603 0.55 MB/sec warmup 38 sec latency 668.920 ms 2023-12-08T20:58:04.290 INFO:tasks.workunit.client.0.smithi053.stdout: 1 604 0.54 MB/sec warmup 39 sec latency 864.233 ms 2023-12-08T20:58:05.290 INFO:tasks.workunit.client.0.smithi053.stdout: 1 609 0.52 MB/sec warmup 40 sec latency 330.390 ms 2023-12-08T20:58:06.290 INFO:tasks.workunit.client.0.smithi053.stdout: 1 614 0.51 MB/sec warmup 41 sec latency 1035.556 ms 2023-12-08T20:58:07.290 INFO:tasks.workunit.client.0.smithi053.stdout: 1 636 0.50 MB/sec warmup 42 sec latency 1040.455 ms 2023-12-08T20:58:08.290 INFO:tasks.workunit.client.0.smithi053.stdout: 1 644 0.49 MB/sec warmup 43 sec latency 793.273 ms 2023-12-08T20:58:09.290 INFO:tasks.workunit.client.0.smithi053.stdout: 1 645 0.48 MB/sec warmup 44 sec latency 1297.518 ms 2023-12-08T20:58:10.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 651 0.47 MB/sec warmup 45 sec latency 1011.972 ms 2023-12-08T20:58:11.290 INFO:tasks.workunit.client.0.smithi053.stdout: 1 653 0.46 MB/sec warmup 46 sec latency 776.643 ms 2023-12-08T20:58:12.290 INFO:tasks.workunit.client.0.smithi053.stdout: 1 658 0.45 MB/sec warmup 47 sec latency 968.909 ms 2023-12-08T20:58:13.290 INFO:tasks.workunit.client.0.smithi053.stdout: 1 680 0.44 MB/sec warmup 48 sec latency 155.182 ms 2023-12-08T20:58:14.290 INFO:tasks.workunit.client.0.smithi053.stdout: 1 682 0.43 MB/sec warmup 49 sec latency 958.376 ms 2023-12-08T20:58:15.291 INFO:tasks.workunit.client.0.smithi053.stdout: 1 685 0.42 MB/sec warmup 50 sec latency 1155.553 ms 2023-12-08T20:58:16.293 INFO:tasks.workunit.client.0.smithi053.stdout: 1 705 0.42 MB/sec warmup 51 sec latency 371.559 ms 2023-12-08T20:58:17.291 INFO:tasks.workunit.client.0.smithi053.stdout: 1 711 0.41 MB/sec warmup 52 sec latency 703.173 ms 2023-12-08T20:58:18.291 INFO:tasks.workunit.client.0.smithi053.stdout: 1 721 0.40 MB/sec warmup 53 sec latency 537.312 ms 2023-12-08T20:58:19.291 INFO:tasks.workunit.client.0.smithi053.stdout: 1 743 0.39 MB/sec warmup 54 sec latency 157.004 ms 2023-12-08T20:58:20.291 INFO:tasks.workunit.client.0.smithi053.stdout: 1 744 0.39 MB/sec warmup 55 sec latency 928.778 ms 2023-12-08T20:58:21.291 INFO:tasks.workunit.client.0.smithi053.stdout: 1 746 0.38 MB/sec warmup 56 sec latency 988.519 ms 2023-12-08T20:58:22.291 INFO:tasks.workunit.client.0.smithi053.stdout: 1 769 0.37 MB/sec warmup 57 sec latency 1000.498 ms 2023-12-08T20:58:23.291 INFO:tasks.workunit.client.0.smithi053.stdout: 1 778 0.37 MB/sec warmup 58 sec latency 579.739 ms 2023-12-08T20:58:24.291 INFO:tasks.workunit.client.0.smithi053.stdout: 1 790 0.36 MB/sec warmup 59 sec latency 655.147 ms 2023-12-08T20:58:25.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 811 0.36 MB/sec warmup 60 sec latency 142.905 ms 2023-12-08T20:58:26.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 812 0.35 MB/sec warmup 61 sec latency 923.831 ms 2023-12-08T20:58:27.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 813 0.35 MB/sec warmup 62 sec latency 971.354 ms 2023-12-08T20:58:27.587 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:58:27.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:58:28.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 818 0.34 MB/sec warmup 63 sec latency 1001.795 ms 2023-12-08T20:58:29.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 823 0.34 MB/sec warmup 64 sec latency 930.686 ms 2023-12-08T20:58:30.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 851 0.33 MB/sec warmup 65 sec latency 955.823 ms 2023-12-08T20:58:31.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 853 0.33 MB/sec warmup 66 sec latency 925.658 ms 2023-12-08T20:58:32.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 854 0.32 MB/sec warmup 67 sec latency 976.664 ms 2023-12-08T20:58:33.295 INFO:tasks.workunit.client.0.smithi053.stdout: 1 862 0.32 MB/sec warmup 68 sec latency 1014.765 ms 2023-12-08T20:58:34.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 863 0.31 MB/sec warmup 69 sec latency 1003.462 ms 2023-12-08T20:58:35.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 880 0.31 MB/sec warmup 70 sec latency 454.879 ms 2023-12-08T20:58:36.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 885 0.31 MB/sec warmup 71 sec latency 954.473 ms 2023-12-08T20:58:37.292 INFO:tasks.workunit.client.0.smithi053.stdout: 1 902 0.30 MB/sec warmup 72 sec latency 460.213 ms 2023-12-08T20:58:38.293 INFO:tasks.workunit.client.0.smithi053.stdout: 1 903 0.30 MB/sec warmup 73 sec latency 903.801 ms 2023-12-08T20:58:39.293 INFO:tasks.workunit.client.0.smithi053.stdout: 1 916 0.29 MB/sec warmup 74 sec latency 334.921 ms 2023-12-08T20:58:40.293 INFO:tasks.workunit.client.0.smithi053.stdout: 1 927 0.29 MB/sec warmup 75 sec latency 451.019 ms 2023-12-08T20:58:41.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 928 0.29 MB/sec warmup 76 sec latency 891.581 ms 2023-12-08T20:58:42.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 930 0.28 MB/sec warmup 77 sec latency 956.425 ms 2023-12-08T20:58:43.293 INFO:tasks.workunit.client.0.smithi053.stdout: 1 931 0.28 MB/sec warmup 78 sec latency 697.856 ms 2023-12-08T20:58:44.293 INFO:tasks.workunit.client.0.smithi053.stdout: 1 933 0.28 MB/sec warmup 79 sec latency 921.729 ms 2023-12-08T20:58:45.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 937 0.27 MB/sec warmup 80 sec latency 646.892 ms 2023-12-08T20:58:46.293 INFO:tasks.workunit.client.0.smithi053.stdout: 1 942 0.27 MB/sec warmup 81 sec latency 975.579 ms 2023-12-08T20:58:47.293 INFO:tasks.workunit.client.0.smithi053.stdout: 1 964 0.27 MB/sec warmup 82 sec latency 905.938 ms 2023-12-08T20:58:48.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 969 0.26 MB/sec warmup 83 sec latency 794.793 ms 2023-12-08T20:58:49.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 983 0.26 MB/sec warmup 84 sec latency 828.061 ms 2023-12-08T20:58:50.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 994 0.26 MB/sec warmup 85 sec latency 348.503 ms 2023-12-08T20:58:51.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1000 0.26 MB/sec warmup 86 sec latency 970.418 ms 2023-12-08T20:58:52.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1027 0.26 MB/sec warmup 87 sec latency 604.319 ms 2023-12-08T20:58:53.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1033 0.26 MB/sec warmup 88 sec latency 891.964 ms 2023-12-08T20:58:54.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1038 0.26 MB/sec warmup 89 sec latency 1036.258 ms 2023-12-08T20:58:55.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1046 0.25 MB/sec warmup 90 sec latency 480.166 ms 2023-12-08T20:58:56.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1047 0.25 MB/sec warmup 91 sec latency 972.124 ms 2023-12-08T20:58:57.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1048 0.25 MB/sec warmup 92 sec latency 984.013 ms 2023-12-08T20:58:57.632 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:58:57.637 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:58:58.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1050 0.25 MB/sec warmup 93 sec latency 1408.294 ms 2023-12-08T20:58:59.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1060 0.24 MB/sec warmup 94 sec latency 316.472 ms 2023-12-08T20:59:00.294 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1073 0.24 MB/sec warmup 95 sec latency 364.668 ms 2023-12-08T20:59:01.295 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1088 0.24 MB/sec warmup 96 sec latency 369.816 ms 2023-12-08T20:59:02.295 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1095 0.24 MB/sec warmup 97 sec latency 1015.993 ms 2023-12-08T20:59:03.295 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1100 0.23 MB/sec warmup 98 sec latency 405.335 ms 2023-12-08T20:59:04.295 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1114 0.23 MB/sec warmup 99 sec latency 960.222 ms 2023-12-08T20:59:05.295 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1114 0.23 MB/sec warmup 100 sec latency 1003.734 ms 2023-12-08T20:59:06.295 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1128 0.23 MB/sec warmup 101 sec latency 1129.149 ms 2023-12-08T20:59:07.295 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1138 0.23 MB/sec warmup 102 sec latency 421.870 ms 2023-12-08T20:59:08.295 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1149 0.22 MB/sec warmup 103 sec latency 733.236 ms 2023-12-08T20:59:09.295 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1157 0.22 MB/sec warmup 104 sec latency 564.877 ms 2023-12-08T20:59:10.295 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1163 0.22 MB/sec warmup 105 sec latency 964.924 ms 2023-12-08T20:59:11.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1169 0.22 MB/sec warmup 106 sec latency 962.264 ms 2023-12-08T20:59:12.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1170 0.22 MB/sec warmup 107 sec latency 914.305 ms 2023-12-08T20:59:13.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1172 0.21 MB/sec warmup 108 sec latency 1074.884 ms 2023-12-08T20:59:14.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1177 0.21 MB/sec warmup 109 sec latency 413.628 ms 2023-12-08T20:59:15.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1181 0.21 MB/sec warmup 110 sec latency 371.698 ms 2023-12-08T20:59:16.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1202 0.21 MB/sec warmup 111 sec latency 387.799 ms 2023-12-08T20:59:17.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1204 0.21 MB/sec warmup 112 sec latency 892.314 ms 2023-12-08T20:59:18.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1215 0.20 MB/sec warmup 113 sec latency 1056.932 ms 2023-12-08T20:59:19.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1231 0.20 MB/sec warmup 114 sec latency 336.329 ms 2023-12-08T20:59:20.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1244 0.20 MB/sec warmup 115 sec latency 357.760 ms 2023-12-08T20:59:21.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1248 0.20 MB/sec warmup 116 sec latency 648.124 ms 2023-12-08T20:59:22.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1251 0.20 MB/sec warmup 117 sec latency 1028.177 ms 2023-12-08T20:59:23.296 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1273 0.20 MB/sec warmup 118 sec latency 353.657 ms 2023-12-08T20:59:24.297 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1278 0.19 MB/sec warmup 119 sec latency 649.368 ms 2023-12-08T20:59:26.297 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1281 0.00 MB/sec execute 1 sec latency 1014.154 ms 2023-12-08T20:59:27.297 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1284 0.00 MB/sec execute 2 sec latency 1004.403 ms 2023-12-08T20:59:27.836 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:59:27.839 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:59:28.297 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1285 0.00 MB/sec execute 3 sec latency 1491.291 ms 2023-12-08T20:59:29.297 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1376 0.71 MB/sec execute 4 sec latency 579.257 ms 2023-12-08T20:59:30.297 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1377 0.57 MB/sec execute 5 sec latency 968.688 ms 2023-12-08T20:59:31.300 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1381 0.48 MB/sec execute 6 sec latency 938.124 ms 2023-12-08T20:59:32.297 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1382 0.41 MB/sec execute 7 sec latency 977.327 ms 2023-12-08T20:59:33.297 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1385 0.36 MB/sec execute 8 sec latency 911.275 ms 2023-12-08T20:59:34.297 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1396 0.32 MB/sec execute 9 sec latency 968.270 ms 2023-12-08T20:59:35.297 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1397 0.29 MB/sec execute 10 sec latency 873.951 ms 2023-12-08T20:59:36.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1416 0.26 MB/sec execute 11 sec latency 954.604 ms 2023-12-08T20:59:37.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1417 0.24 MB/sec execute 12 sec latency 982.485 ms 2023-12-08T20:59:38.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1421 0.22 MB/sec execute 13 sec latency 988.592 ms 2023-12-08T20:59:39.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1441 0.21 MB/sec execute 14 sec latency 441.665 ms 2023-12-08T20:59:40.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1448 0.19 MB/sec execute 15 sec latency 507.011 ms 2023-12-08T20:59:41.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1451 0.18 MB/sec execute 16 sec latency 980.649 ms 2023-12-08T20:59:42.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1465 0.17 MB/sec execute 17 sec latency 192.749 ms 2023-12-08T20:59:43.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1466 0.16 MB/sec execute 18 sec latency 713.630 ms 2023-12-08T20:59:44.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1485 0.15 MB/sec execute 19 sec latency 927.932 ms 2023-12-08T20:59:45.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1486 0.15 MB/sec execute 20 sec latency 1082.509 ms 2023-12-08T20:59:46.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1490 0.14 MB/sec execute 21 sec latency 487.929 ms 2023-12-08T20:59:47.298 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1497 0.13 MB/sec execute 22 sec latency 937.032 ms 2023-12-08T20:59:48.299 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1501 0.13 MB/sec execute 23 sec latency 595.401 ms 2023-12-08T20:59:49.299 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1516 0.12 MB/sec execute 24 sec latency 458.164 ms 2023-12-08T20:59:50.299 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1525 0.12 MB/sec execute 25 sec latency 455.614 ms 2023-12-08T20:59:51.299 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1526 0.11 MB/sec execute 26 sec latency 997.238 ms 2023-12-08T20:59:52.299 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1530 0.11 MB/sec execute 27 sec latency 1083.289 ms 2023-12-08T20:59:53.299 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1551 0.11 MB/sec execute 28 sec latency 1125.328 ms 2023-12-08T20:59:54.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1555 0.10 MB/sec execute 29 sec latency 407.149 ms 2023-12-08T20:59:55.299 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1560 0.10 MB/sec execute 30 sec latency 995.053 ms 2023-12-08T20:59:56.299 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1576 0.10 MB/sec execute 31 sec latency 198.069 ms 2023-12-08T20:59:57.299 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1586 0.09 MB/sec execute 32 sec latency 179.323 ms 2023-12-08T20:59:57.992 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:59:57.995 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T20:59:58.299 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1589 0.09 MB/sec execute 33 sec latency 552.974 ms 2023-12-08T20:59:59.300 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1603 0.09 MB/sec execute 34 sec latency 921.579 ms 2023-12-08T21:00:00.300 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1606 0.09 MB/sec execute 35 sec latency 550.195 ms 2023-12-08T21:00:01.300 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1610 0.08 MB/sec execute 36 sec latency 986.842 ms 2023-12-08T21:00:02.300 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1613 0.08 MB/sec execute 37 sec latency 954.432 ms 2023-12-08T21:00:03.300 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1617 0.08 MB/sec execute 38 sec latency 343.273 ms 2023-12-08T21:00:04.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1627 0.08 MB/sec execute 39 sec latency 1003.058 ms 2023-12-08T21:00:05.300 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1641 0.08 MB/sec execute 40 sec latency 501.964 ms 2023-12-08T21:00:06.300 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1643 0.07 MB/sec execute 41 sec latency 965.436 ms 2023-12-08T21:00:07.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1644 0.07 MB/sec execute 42 sec latency 960.925 ms 2023-12-08T21:00:08.300 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1653 0.07 MB/sec execute 43 sec latency 1002.180 ms 2023-12-08T21:00:09.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1674 0.07 MB/sec execute 44 sec latency 990.549 ms 2023-12-08T21:00:10.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1686 0.07 MB/sec execute 45 sec latency 635.868 ms 2023-12-08T21:00:11.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1696 0.07 MB/sec execute 46 sec latency 810.249 ms 2023-12-08T21:00:12.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1701 0.07 MB/sec execute 47 sec latency 482.681 ms 2023-12-08T21:00:13.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1707 0.06 MB/sec execute 48 sec latency 957.916 ms 2023-12-08T21:00:14.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1711 0.06 MB/sec execute 49 sec latency 943.333 ms 2023-12-08T21:00:15.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1731 0.06 MB/sec execute 50 sec latency 194.581 ms 2023-12-08T21:00:16.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1769 0.06 MB/sec execute 51 sec latency 276.887 ms 2023-12-08T21:00:17.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1772 0.06 MB/sec execute 52 sec latency 502.223 ms 2023-12-08T21:00:18.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1773 0.06 MB/sec execute 53 sec latency 1276.369 ms 2023-12-08T21:00:19.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1801 0.06 MB/sec execute 54 sec latency 162.708 ms 2023-12-08T21:00:20.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1805 0.06 MB/sec execute 55 sec latency 305.161 ms 2023-12-08T21:00:21.301 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1808 0.06 MB/sec execute 56 sec latency 964.439 ms 2023-12-08T21:00:22.302 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1822 0.06 MB/sec execute 57 sec latency 438.812 ms 2023-12-08T21:00:23.302 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1825 0.06 MB/sec execute 58 sec latency 976.094 ms 2023-12-08T21:00:24.302 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1826 0.05 MB/sec execute 59 sec latency 930.411 ms 2023-12-08T21:00:25.302 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1838 0.05 MB/sec execute 60 sec latency 963.107 ms 2023-12-08T21:00:26.302 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1841 0.05 MB/sec execute 61 sec latency 449.949 ms 2023-12-08T21:00:27.302 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1855 0.05 MB/sec execute 62 sec latency 1024.268 ms 2023-12-08T21:00:28.056 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:00:28.059 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:00:28.302 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1858 0.05 MB/sec execute 63 sec latency 625.807 ms 2023-12-08T21:00:29.302 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1862 0.05 MB/sec execute 64 sec latency 1033.285 ms 2023-12-08T21:00:30.302 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1866 0.05 MB/sec execute 65 sec latency 931.222 ms 2023-12-08T21:00:31.302 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1869 0.05 MB/sec execute 66 sec latency 400.696 ms 2023-12-08T21:00:32.302 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1884 0.05 MB/sec execute 67 sec latency 981.785 ms 2023-12-08T21:00:33.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1898 0.05 MB/sec execute 68 sec latency 550.056 ms 2023-12-08T21:00:34.302 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1903 0.05 MB/sec execute 69 sec latency 915.888 ms 2023-12-08T21:00:35.303 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1910 0.05 MB/sec execute 70 sec latency 878.463 ms 2023-12-08T21:00:36.303 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1912 0.05 MB/sec execute 71 sec latency 802.300 ms 2023-12-08T21:00:37.303 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1920 0.05 MB/sec execute 72 sec latency 933.209 ms 2023-12-08T21:00:38.303 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1945 0.05 MB/sec execute 73 sec latency 1144.492 ms 2023-12-08T21:00:39.303 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1972 0.04 MB/sec execute 74 sec latency 204.140 ms 2023-12-08T21:00:40.303 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1975 0.04 MB/sec execute 75 sec latency 546.925 ms 2023-12-08T21:00:41.303 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1980 0.04 MB/sec execute 76 sec latency 945.414 ms 2023-12-08T21:00:42.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1997 0.04 MB/sec execute 77 sec latency 272.818 ms 2023-12-08T21:00:43.303 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2004 0.04 MB/sec execute 78 sec latency 975.194 ms 2023-12-08T21:00:44.303 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2027 0.04 MB/sec execute 79 sec latency 241.268 ms 2023-12-08T21:00:45.303 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2034 0.04 MB/sec execute 80 sec latency 504.128 ms 2023-12-08T21:00:46.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2043 0.04 MB/sec execute 81 sec latency 953.764 ms 2023-12-08T21:00:47.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2051 0.04 MB/sec execute 82 sec latency 972.359 ms 2023-12-08T21:00:48.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2051 0.04 MB/sec execute 83 sec latency 1115.863 ms 2023-12-08T21:00:49.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2053 0.04 MB/sec execute 84 sec latency 1252.980 ms 2023-12-08T21:00:50.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2059 0.04 MB/sec execute 85 sec latency 972.517 ms 2023-12-08T21:00:51.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2061 0.04 MB/sec execute 86 sec latency 598.941 ms 2023-12-08T21:00:52.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2079 0.04 MB/sec execute 87 sec latency 941.220 ms 2023-12-08T21:00:53.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2080 0.04 MB/sec execute 88 sec latency 1217.657 ms 2023-12-08T21:00:54.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2083 0.04 MB/sec execute 89 sec latency 879.830 ms 2023-12-08T21:00:55.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2093 0.04 MB/sec execute 90 sec latency 347.797 ms 2023-12-08T21:00:56.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2096 0.04 MB/sec execute 91 sec latency 919.803 ms 2023-12-08T21:00:57.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2104 0.04 MB/sec execute 92 sec latency 1039.648 ms 2023-12-08T21:00:58.193 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:00:58.197 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:00:58.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2138 0.04 MB/sec execute 93 sec latency 278.400 ms 2023-12-08T21:00:59.304 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2140 0.04 MB/sec execute 94 sec latency 822.672 ms 2023-12-08T21:01:00.305 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2146 0.04 MB/sec execute 95 sec latency 977.115 ms 2023-12-08T21:01:01.305 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2168 0.04 MB/sec execute 96 sec latency 921.042 ms 2023-12-08T21:01:02.305 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2173 0.04 MB/sec execute 97 sec latency 934.666 ms 2023-12-08T21:01:03.305 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2175 0.04 MB/sec execute 98 sec latency 963.589 ms 2023-12-08T21:01:04.305 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2179 0.04 MB/sec execute 99 sec latency 1225.547 ms 2023-12-08T21:01:05.305 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2183 0.04 MB/sec execute 100 sec latency 343.326 ms 2023-12-08T21:01:06.305 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2197 0.04 MB/sec execute 101 sec latency 985.590 ms 2023-12-08T21:01:07.306 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2201 0.04 MB/sec execute 102 sec latency 531.389 ms 2023-12-08T21:01:08.305 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2221 0.04 MB/sec execute 103 sec latency 310.269 ms 2023-12-08T21:01:09.305 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2237 0.04 MB/sec execute 104 sec latency 952.047 ms 2023-12-08T21:01:10.305 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2262 0.03 MB/sec execute 105 sec latency 212.174 ms 2023-12-08T21:01:11.306 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2292 0.04 MB/sec execute 106 sec latency 446.130 ms 2023-12-08T21:01:12.306 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2297 0.04 MB/sec execute 107 sec latency 935.579 ms 2023-12-08T21:01:13.306 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2303 0.04 MB/sec execute 108 sec latency 321.801 ms 2023-12-08T21:01:14.306 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2306 0.04 MB/sec execute 109 sec latency 963.004 ms 2023-12-08T21:01:15.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2307 0.04 MB/sec execute 110 sec latency 932.445 ms 2023-12-08T21:01:16.306 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2307 0.04 MB/sec execute 111 sec latency 1389.367 ms 2023-12-08T21:01:17.306 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2321 0.04 MB/sec execute 112 sec latency 1573.103 ms 2023-12-08T21:01:18.306 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2324 0.04 MB/sec execute 113 sec latency 1007.199 ms 2023-12-08T21:01:19.306 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2327 0.04 MB/sec execute 114 sec latency 1438.205 ms 2023-12-08T21:01:20.306 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2335 0.04 MB/sec execute 115 sec latency 369.647 ms 2023-12-08T21:01:21.306 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2337 0.04 MB/sec execute 116 sec latency 958.702 ms 2023-12-08T21:01:22.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2340 0.04 MB/sec execute 117 sec latency 893.277 ms 2023-12-08T21:01:23.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2356 0.04 MB/sec execute 118 sec latency 1040.176 ms 2023-12-08T21:01:24.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2361 0.04 MB/sec execute 119 sec latency 516.190 ms 2023-12-08T21:01:25.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2362 0.04 MB/sec execute 120 sec latency 941.673 ms 2023-12-08T21:01:26.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2364 0.04 MB/sec execute 121 sec latency 1082.808 ms 2023-12-08T21:01:27.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2366 0.04 MB/sec execute 122 sec latency 985.823 ms 2023-12-08T21:01:28.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2367 0.04 MB/sec execute 123 sec latency 1243.088 ms 2023-12-08T21:01:28.316 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:01:28.319 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:01:29.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2371 0.04 MB/sec execute 124 sec latency 686.918 ms 2023-12-08T21:01:30.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2388 0.04 MB/sec execute 125 sec latency 863.644 ms 2023-12-08T21:01:31.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2391 0.04 MB/sec execute 126 sec latency 564.340 ms 2023-12-08T21:01:32.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2395 0.04 MB/sec execute 127 sec latency 979.720 ms 2023-12-08T21:01:33.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2400 0.04 MB/sec execute 128 sec latency 332.390 ms 2023-12-08T21:01:34.307 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2410 0.04 MB/sec execute 129 sec latency 353.566 ms 2023-12-08T21:01:35.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2416 0.04 MB/sec execute 130 sec latency 1031.101 ms 2023-12-08T21:01:36.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2428 0.04 MB/sec execute 131 sec latency 311.728 ms 2023-12-08T21:01:37.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2431 0.04 MB/sec execute 132 sec latency 641.471 ms 2023-12-08T21:01:38.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2432 0.04 MB/sec execute 133 sec latency 937.030 ms 2023-12-08T21:01:39.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2435 0.04 MB/sec execute 134 sec latency 1217.239 ms 2023-12-08T21:01:40.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2441 0.04 MB/sec execute 135 sec latency 415.193 ms 2023-12-08T21:01:41.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2449 0.04 MB/sec execute 136 sec latency 305.698 ms 2023-12-08T21:01:42.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2466 0.04 MB/sec execute 137 sec latency 415.954 ms 2023-12-08T21:01:43.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2470 0.04 MB/sec execute 138 sec latency 395.594 ms 2023-12-08T21:01:44.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2479 0.04 MB/sec execute 139 sec latency 970.873 ms 2023-12-08T21:01:45.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2490 0.04 MB/sec execute 140 sec latency 603.603 ms 2023-12-08T21:01:46.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2492 0.04 MB/sec execute 141 sec latency 936.177 ms 2023-12-08T21:01:47.308 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2494 0.04 MB/sec execute 142 sec latency 1063.303 ms 2023-12-08T21:01:48.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2500 0.04 MB/sec execute 143 sec latency 1051.501 ms 2023-12-08T21:01:49.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2506 0.04 MB/sec execute 144 sec latency 329.219 ms 2023-12-08T21:01:50.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2549 0.04 MB/sec execute 145 sec latency 943.408 ms 2023-12-08T21:01:51.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2551 0.04 MB/sec execute 146 sec latency 897.492 ms 2023-12-08T21:01:52.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2556 0.04 MB/sec execute 147 sec latency 958.507 ms 2023-12-08T21:01:53.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2560 0.04 MB/sec execute 148 sec latency 495.754 ms 2023-12-08T21:01:54.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2562 0.04 MB/sec execute 149 sec latency 929.129 ms 2023-12-08T21:01:55.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2576 0.04 MB/sec execute 150 sec latency 380.374 ms 2023-12-08T21:01:56.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2580 0.04 MB/sec execute 151 sec latency 755.338 ms 2023-12-08T21:01:57.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2581 0.04 MB/sec execute 152 sec latency 1041.964 ms 2023-12-08T21:01:58.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2583 0.04 MB/sec execute 153 sec latency 1021.612 ms 2023-12-08T21:01:58.386 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:01:58.389 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:01:59.309 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2596 0.04 MB/sec execute 154 sec latency 413.481 ms 2023-12-08T21:02:00.310 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2600 0.04 MB/sec execute 155 sec latency 672.896 ms 2023-12-08T21:02:01.310 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2604 0.04 MB/sec execute 156 sec latency 1046.559 ms 2023-12-08T21:02:02.310 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2609 0.04 MB/sec execute 157 sec latency 423.978 ms 2023-12-08T21:02:03.310 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2615 0.04 MB/sec execute 158 sec latency 773.387 ms 2023-12-08T21:02:04.310 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2617 0.04 MB/sec execute 159 sec latency 1032.680 ms 2023-12-08T21:02:05.310 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2618 0.04 MB/sec execute 160 sec latency 936.800 ms 2023-12-08T21:02:06.310 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2621 0.04 MB/sec execute 161 sec latency 952.394 ms 2023-12-08T21:02:07.310 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2718 0.05 MB/sec execute 162 sec latency 936.338 ms 2023-12-08T21:02:08.310 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2718 0.05 MB/sec execute 163 sec latency 1184.573 ms 2023-12-08T21:02:09.310 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2745 0.05 MB/sec execute 164 sec latency 1365.328 ms 2023-12-08T21:02:10.311 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2752 0.05 MB/sec execute 165 sec latency 940.114 ms 2023-12-08T21:02:11.311 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2760 0.05 MB/sec execute 166 sec latency 630.688 ms 2023-12-08T21:02:12.311 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2763 0.05 MB/sec execute 167 sec latency 1007.660 ms 2023-12-08T21:02:13.311 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2775 0.05 MB/sec execute 168 sec latency 326.417 ms 2023-12-08T21:02:14.311 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2780 0.05 MB/sec execute 169 sec latency 360.156 ms 2023-12-08T21:02:15.311 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2784 0.05 MB/sec execute 170 sec latency 965.425 ms 2023-12-08T21:02:16.311 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2872 0.05 MB/sec execute 171 sec latency 598.751 ms 2023-12-08T21:02:17.311 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2876 0.05 MB/sec execute 172 sec latency 1111.304 ms 2023-12-08T21:02:18.311 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2881 0.05 MB/sec execute 173 sec latency 420.789 ms 2023-12-08T21:02:19.311 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2898 0.06 MB/sec execute 174 sec latency 482.631 ms 2023-12-08T21:02:20.314 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2903 0.06 MB/sec execute 175 sec latency 418.635 ms 2023-12-08T21:02:21.311 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2922 0.06 MB/sec execute 176 sec latency 367.678 ms 2023-12-08T21:02:22.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2931 0.06 MB/sec execute 177 sec latency 559.811 ms 2023-12-08T21:02:23.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2938 0.06 MB/sec execute 178 sec latency 656.536 ms 2023-12-08T21:02:24.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2943 0.06 MB/sec execute 179 sec latency 1026.796 ms 2023-12-08T21:02:25.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2966 0.06 MB/sec execute 180 sec latency 844.251 ms 2023-12-08T21:02:26.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2974 0.06 MB/sec execute 181 sec latency 983.888 ms 2023-12-08T21:02:27.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2975 0.06 MB/sec execute 182 sec latency 956.318 ms 2023-12-08T21:02:28.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2978 0.06 MB/sec execute 183 sec latency 475.294 ms 2023-12-08T21:02:28.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:02:28.521 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:02:29.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2989 0.06 MB/sec execute 184 sec latency 396.848 ms 2023-12-08T21:02:30.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2994 0.06 MB/sec execute 185 sec latency 586.817 ms 2023-12-08T21:02:31.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3003 0.06 MB/sec execute 186 sec latency 921.511 ms 2023-12-08T21:02:32.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3012 0.06 MB/sec execute 187 sec latency 620.659 ms 2023-12-08T21:02:33.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3019 0.06 MB/sec execute 188 sec latency 626.566 ms 2023-12-08T21:02:34.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3025 0.06 MB/sec execute 189 sec latency 449.400 ms 2023-12-08T21:02:35.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3137 0.06 MB/sec execute 190 sec latency 960.950 ms 2023-12-08T21:02:36.312 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3169 0.06 MB/sec execute 191 sec latency 903.736 ms 2023-12-08T21:02:37.313 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3176 0.06 MB/sec execute 192 sec latency 318.829 ms 2023-12-08T21:02:38.313 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3188 0.06 MB/sec execute 193 sec latency 438.622 ms 2023-12-08T21:02:39.313 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3189 0.06 MB/sec execute 194 sec latency 1222.022 ms 2023-12-08T21:02:40.313 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3204 0.06 MB/sec execute 195 sec latency 315.812 ms 2023-12-08T21:02:41.313 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3212 0.06 MB/sec execute 196 sec latency 621.157 ms 2023-12-08T21:02:42.313 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3255 0.06 MB/sec execute 197 sec latency 333.756 ms 2023-12-08T21:02:43.313 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3266 0.06 MB/sec execute 198 sec latency 827.668 ms 2023-12-08T21:02:44.313 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3268 0.06 MB/sec execute 199 sec latency 1004.550 ms 2023-12-08T21:02:45.313 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3277 0.06 MB/sec execute 200 sec latency 928.149 ms 2023-12-08T21:02:46.313 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3280 0.06 MB/sec execute 201 sec latency 950.278 ms 2023-12-08T21:02:47.313 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3281 0.06 MB/sec execute 202 sec latency 978.175 ms 2023-12-08T21:02:48.313 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3282 0.06 MB/sec execute 203 sec latency 1112.097 ms 2023-12-08T21:02:49.314 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3283 0.06 MB/sec execute 204 sec latency 1513.572 ms 2023-12-08T21:02:50.314 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3285 0.06 MB/sec execute 205 sec latency 959.805 ms 2023-12-08T21:02:51.314 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3286 0.06 MB/sec execute 206 sec latency 948.349 ms 2023-12-08T21:02:52.314 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3287 0.06 MB/sec execute 207 sec latency 1014.852 ms 2023-12-08T21:02:53.314 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3290 0.06 MB/sec execute 208 sec latency 980.441 ms 2023-12-08T21:02:54.314 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3291 0.06 MB/sec execute 209 sec latency 959.105 ms 2023-12-08T21:02:55.314 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3292 0.06 MB/sec execute 210 sec latency 957.366 ms 2023-12-08T21:02:56.314 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3293 0.06 MB/sec execute 211 sec latency 954.303 ms 2023-12-08T21:02:57.314 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3294 0.06 MB/sec execute 212 sec latency 945.162 ms 2023-12-08T21:02:58.314 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3295 0.06 MB/sec execute 213 sec latency 923.300 ms 2023-12-08T21:02:58.556 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:02:58.558 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:02:59.314 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3298 0.06 MB/sec execute 214 sec latency 1046.305 ms 2023-12-08T21:03:00.315 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3299 0.06 MB/sec execute 215 sec latency 933.444 ms 2023-12-08T21:03:01.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3303 0.06 MB/sec execute 216 sec latency 943.710 ms 2023-12-08T21:03:02.315 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3306 0.06 MB/sec execute 217 sec latency 880.345 ms 2023-12-08T21:03:03.315 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3307 0.06 MB/sec execute 218 sec latency 899.104 ms 2023-12-08T21:03:04.315 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3308 0.06 MB/sec execute 219 sec latency 914.850 ms 2023-12-08T21:03:05.315 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3309 0.06 MB/sec execute 220 sec latency 986.521 ms 2023-12-08T21:03:05.878 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:09:34.675 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:06.115 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:09:34.912 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:06.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3310 0.06 MB/sec execute 221 sec latency 900.583 ms 2023-12-08T21:03:06.837 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:09:35.559 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:06.843 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:09:35.567 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:06.999 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:09:35.723 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:07.022 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:09:35.746 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:07.315 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3311 0.06 MB/sec execute 222 sec latency 803.761 ms 2023-12-08T21:03:07.525 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:09:36.322 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:08.100 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:09:36.824 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:08.149 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:09:36.872 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:08.315 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3313 0.05 MB/sec execute 223 sec latency 973.993 ms 2023-12-08T21:03:09.315 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3314 0.05 MB/sec execute 224 sec latency 917.283 ms 2023-12-08T21:03:10.315 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3316 0.05 MB/sec execute 225 sec latency 948.099 ms 2023-12-08T21:03:11.315 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3317 0.05 MB/sec execute 226 sec latency 931.910 ms 2023-12-08T21:03:12.315 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3318 0.05 MB/sec execute 227 sec latency 937.382 ms 2023-12-08T21:03:13.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3319 0.05 MB/sec execute 228 sec latency 919.878 ms 2023-12-08T21:03:14.315 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3320 0.05 MB/sec execute 229 sec latency 980.432 ms 2023-12-08T21:03:15.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3322 0.05 MB/sec execute 230 sec latency 963.420 ms 2023-12-08T21:03:16.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3323 0.05 MB/sec execute 231 sec latency 919.455 ms 2023-12-08T21:03:17.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3324 0.05 MB/sec execute 232 sec latency 925.669 ms 2023-12-08T21:03:18.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3325 0.05 MB/sec execute 233 sec latency 965.593 ms 2023-12-08T21:03:19.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3326 0.05 MB/sec execute 234 sec latency 891.550 ms 2023-12-08T21:03:20.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3327 0.05 MB/sec execute 235 sec latency 926.744 ms 2023-12-08T21:03:21.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3330 0.05 MB/sec execute 236 sec latency 934.731 ms 2023-12-08T21:03:22.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3331 0.05 MB/sec execute 237 sec latency 888.211 ms 2023-12-08T21:03:23.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3332 0.05 MB/sec execute 238 sec latency 955.736 ms 2023-12-08T21:03:24.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3333 0.05 MB/sec execute 239 sec latency 892.475 ms 2023-12-08T21:03:25.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3335 0.05 MB/sec execute 240 sec latency 934.906 ms 2023-12-08T21:03:26.316 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3336 0.05 MB/sec execute 241 sec latency 951.292 ms 2023-12-08T21:03:27.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3337 0.05 MB/sec execute 242 sec latency 933.818 ms 2023-12-08T21:03:28.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3339 0.05 MB/sec execute 243 sec latency 960.809 ms 2023-12-08T21:03:28.678 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:03:28.681 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:03:29.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3351 0.05 MB/sec execute 244 sec latency 250.851 ms 2023-12-08T21:03:30.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3359 0.05 MB/sec execute 245 sec latency 405.561 ms 2023-12-08T21:03:31.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3365 0.05 MB/sec execute 246 sec latency 304.560 ms 2023-12-08T21:03:32.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3374 0.05 MB/sec execute 247 sec latency 368.333 ms 2023-12-08T21:03:33.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3379 0.05 MB/sec execute 248 sec latency 495.637 ms 2023-12-08T21:03:34.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3391 0.05 MB/sec execute 249 sec latency 583.688 ms 2023-12-08T21:03:35.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3393 0.05 MB/sec execute 250 sec latency 1160.374 ms 2023-12-08T21:03:36.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3395 0.05 MB/sec execute 251 sec latency 1063.414 ms 2023-12-08T21:03:37.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3398 0.05 MB/sec execute 252 sec latency 1004.631 ms 2023-12-08T21:03:38.317 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3399 0.05 MB/sec execute 253 sec latency 1114.298 ms 2023-12-08T21:03:39.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3494 0.06 MB/sec execute 254 sec latency 398.834 ms 2023-12-08T21:03:40.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3509 0.06 MB/sec execute 255 sec latency 277.100 ms 2023-12-08T21:03:41.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3524 0.06 MB/sec execute 256 sec latency 300.869 ms 2023-12-08T21:03:42.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3531 0.06 MB/sec execute 257 sec latency 570.007 ms 2023-12-08T21:03:43.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3539 0.06 MB/sec execute 258 sec latency 934.353 ms 2023-12-08T21:03:44.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3550 0.06 MB/sec execute 259 sec latency 441.737 ms 2023-12-08T21:03:45.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3557 0.06 MB/sec execute 260 sec latency 336.541 ms 2023-12-08T21:03:46.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3558 0.06 MB/sec execute 261 sec latency 960.598 ms 2023-12-08T21:03:47.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3563 0.06 MB/sec execute 262 sec latency 505.111 ms 2023-12-08T21:03:48.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3573 0.06 MB/sec execute 263 sec latency 531.261 ms 2023-12-08T21:03:49.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3579 0.06 MB/sec execute 264 sec latency 1195.409 ms 2023-12-08T21:03:50.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3588 0.06 MB/sec execute 265 sec latency 303.709 ms 2023-12-08T21:03:51.102 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:10:19.899 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:51.163 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:10:19.960 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:51.231 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:10:19.955 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:51.286 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:10:20.010 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:51.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3617 0.06 MB/sec execute 266 sec latency 945.166 ms 2023-12-08T21:03:51.373 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:10:20.097 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:51.385 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:10:20.109 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:51.575 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:10:20.299 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:51.639 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:10:20.437 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:51.662 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:10:20.385 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:03:52.318 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3628 0.06 MB/sec execute 267 sec latency 345.645 ms 2023-12-08T21:03:53.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3638 0.06 MB/sec execute 268 sec latency 328.631 ms 2023-12-08T21:03:54.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3642 0.06 MB/sec execute 269 sec latency 452.954 ms 2023-12-08T21:03:55.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3645 0.06 MB/sec execute 270 sec latency 974.042 ms 2023-12-08T21:03:56.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3663 0.06 MB/sec execute 271 sec latency 324.821 ms 2023-12-08T21:03:57.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3671 0.06 MB/sec execute 272 sec latency 379.629 ms 2023-12-08T21:03:58.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3672 0.06 MB/sec execute 273 sec latency 951.065 ms 2023-12-08T21:03:58.825 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:03:58.828 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:03:59.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3675 0.06 MB/sec execute 274 sec latency 1384.631 ms 2023-12-08T21:04:00.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3686 0.06 MB/sec execute 275 sec latency 291.269 ms 2023-12-08T21:04:01.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3689 0.06 MB/sec execute 276 sec latency 886.104 ms 2023-12-08T21:04:02.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3696 0.06 MB/sec execute 277 sec latency 415.145 ms 2023-12-08T21:04:03.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3705 0.06 MB/sec execute 278 sec latency 413.348 ms 2023-12-08T21:04:04.319 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3715 0.06 MB/sec execute 279 sec latency 411.838 ms 2023-12-08T21:04:05.320 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3729 0.06 MB/sec execute 280 sec latency 307.714 ms 2023-12-08T21:04:06.320 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3758 0.06 MB/sec execute 281 sec latency 583.723 ms 2023-12-08T21:04:07.320 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3767 0.06 MB/sec execute 282 sec latency 1000.313 ms 2023-12-08T21:04:08.320 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3773 0.06 MB/sec execute 283 sec latency 494.985 ms 2023-12-08T21:04:09.320 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3776 0.06 MB/sec execute 284 sec latency 702.049 ms 2023-12-08T21:04:10.320 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3781 0.06 MB/sec execute 285 sec latency 398.949 ms 2023-12-08T21:04:11.320 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3789 0.06 MB/sec execute 286 sec latency 466.605 ms 2023-12-08T21:04:12.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3791 0.06 MB/sec execute 287 sec latency 472.829 ms 2023-12-08T21:04:13.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3795 0.06 MB/sec execute 288 sec latency 546.350 ms 2023-12-08T21:04:14.320 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3797 0.06 MB/sec execute 289 sec latency 685.972 ms 2023-12-08T21:04:15.320 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3804 0.06 MB/sec execute 290 sec latency 518.352 ms 2023-12-08T21:04:16.320 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3808 0.06 MB/sec execute 291 sec latency 333.104 ms 2023-12-08T21:04:17.321 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3814 0.06 MB/sec execute 292 sec latency 390.569 ms 2023-12-08T21:04:18.321 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3820 0.06 MB/sec execute 293 sec latency 343.264 ms 2023-12-08T21:04:19.320 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3827 0.06 MB/sec execute 294 sec latency 373.484 ms 2023-12-08T21:04:20.321 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3831 0.06 MB/sec execute 295 sec latency 415.291 ms 2023-12-08T21:04:21.321 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3837 0.06 MB/sec execute 296 sec latency 392.883 ms 2023-12-08T21:04:22.321 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3844 0.06 MB/sec execute 297 sec latency 302.540 ms 2023-12-08T21:04:23.321 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3848 0.06 MB/sec execute 298 sec latency 370.994 ms 2023-12-08T21:04:24.321 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3855 0.06 MB/sec execute 299 sec latency 358.490 ms 2023-12-08T21:04:25.321 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3861 0.06 MB/sec execute 300 sec latency 392.221 ms 2023-12-08T21:04:26.321 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3868 0.06 MB/sec execute 301 sec latency 288.680 ms 2023-12-08T21:04:27.321 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3870 0.06 MB/sec execute 302 sec latency 564.208 ms 2023-12-08T21:04:28.321 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3876 0.05 MB/sec execute 303 sec latency 956.857 ms 2023-12-08T21:04:28.998 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:04:29.001 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:04:29.321 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3876 0.05 MB/sec execute 304 sec latency 1101.883 ms 2023-12-08T21:04:30.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3882 0.05 MB/sec execute 305 sec latency 1249.264 ms 2023-12-08T21:04:31.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3896 0.06 MB/sec execute 306 sec latency 355.328 ms 2023-12-08T21:04:32.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3897 0.06 MB/sec execute 307 sec latency 965.118 ms 2023-12-08T21:04:33.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3898 0.05 MB/sec execute 308 sec latency 807.919 ms 2023-12-08T21:04:34.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3905 0.05 MB/sec execute 309 sec latency 981.466 ms 2023-12-08T21:04:35.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3914 0.05 MB/sec execute 310 sec latency 398.600 ms 2023-12-08T21:04:36.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3919 0.05 MB/sec execute 311 sec latency 955.553 ms 2023-12-08T21:04:37.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3923 0.05 MB/sec execute 312 sec latency 417.930 ms 2023-12-08T21:04:38.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3931 0.05 MB/sec execute 313 sec latency 362.800 ms 2023-12-08T21:04:39.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3936 0.05 MB/sec execute 314 sec latency 602.187 ms 2023-12-08T21:04:40.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3938 0.05 MB/sec execute 315 sec latency 527.306 ms 2023-12-08T21:04:41.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3941 0.05 MB/sec execute 316 sec latency 549.312 ms 2023-12-08T21:04:42.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3944 0.05 MB/sec execute 317 sec latency 544.352 ms 2023-12-08T21:04:43.322 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3948 0.05 MB/sec execute 318 sec latency 674.698 ms 2023-12-08T21:04:44.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3954 0.05 MB/sec execute 319 sec latency 490.891 ms 2023-12-08T21:04:45.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3959 0.05 MB/sec execute 320 sec latency 373.108 ms 2023-12-08T21:04:46.325 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3967 0.05 MB/sec execute 321 sec latency 380.829 ms 2023-12-08T21:04:47.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3971 0.05 MB/sec execute 322 sec latency 432.508 ms 2023-12-08T21:04:48.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3977 0.05 MB/sec execute 323 sec latency 431.096 ms 2023-12-08T21:04:49.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3983 0.05 MB/sec execute 324 sec latency 317.707 ms 2023-12-08T21:04:50.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3988 0.05 MB/sec execute 325 sec latency 405.177 ms 2023-12-08T21:04:51.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3994 0.05 MB/sec execute 326 sec latency 384.691 ms 2023-12-08T21:04:52.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4000 0.05 MB/sec execute 327 sec latency 410.398 ms 2023-12-08T21:04:53.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4006 0.05 MB/sec execute 328 sec latency 285.278 ms 2023-12-08T21:04:54.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4013 0.05 MB/sec execute 329 sec latency 438.346 ms 2023-12-08T21:04:55.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4018 0.05 MB/sec execute 330 sec latency 425.626 ms 2023-12-08T21:04:56.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4023 0.05 MB/sec execute 331 sec latency 454.403 ms 2023-12-08T21:04:57.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4027 0.05 MB/sec execute 332 sec latency 541.800 ms 2023-12-08T21:04:58.323 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4031 0.05 MB/sec execute 333 sec latency 965.386 ms 2023-12-08T21:04:59.104 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:04:59.107 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:04:59.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4032 0.05 MB/sec execute 334 sec latency 816.007 ms 2023-12-08T21:05:00.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4035 0.05 MB/sec execute 335 sec latency 1154.881 ms 2023-12-08T21:05:01.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4038 0.05 MB/sec execute 336 sec latency 957.852 ms 2023-12-08T21:05:02.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4044 0.05 MB/sec execute 337 sec latency 172.591 ms 2023-12-08T21:05:03.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4047 0.05 MB/sec execute 338 sec latency 773.569 ms 2023-12-08T21:05:04.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4058 0.05 MB/sec execute 339 sec latency 950.720 ms 2023-12-08T21:05:05.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4060 0.05 MB/sec execute 340 sec latency 938.909 ms 2023-12-08T21:05:06.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4066 0.05 MB/sec execute 341 sec latency 525.066 ms 2023-12-08T21:05:07.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4071 0.05 MB/sec execute 342 sec latency 539.350 ms 2023-12-08T21:05:08.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4082 0.05 MB/sec execute 343 sec latency 928.365 ms 2023-12-08T21:05:09.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4085 0.05 MB/sec execute 344 sec latency 1133.866 ms 2023-12-08T21:05:10.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4094 0.05 MB/sec execute 345 sec latency 369.192 ms 2023-12-08T21:05:11.324 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4105 0.05 MB/sec execute 346 sec latency 442.319 ms 2023-12-08T21:05:12.325 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4112 0.05 MB/sec execute 347 sec latency 492.996 ms 2023-12-08T21:05:13.325 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4120 0.05 MB/sec execute 348 sec latency 574.497 ms 2023-12-08T21:05:14.325 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4130 0.05 MB/sec execute 349 sec latency 171.972 ms 2023-12-08T21:05:15.325 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4142 0.05 MB/sec execute 350 sec latency 247.407 ms 2023-12-08T21:05:16.325 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4151 0.05 MB/sec execute 351 sec latency 402.948 ms 2023-12-08T21:05:17.325 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4155 0.05 MB/sec execute 352 sec latency 786.261 ms 2023-12-08T21:05:18.325 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4162 0.05 MB/sec execute 353 sec latency 414.628 ms 2023-12-08T21:05:19.325 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4172 0.05 MB/sec execute 354 sec latency 567.839 ms 2023-12-08T21:05:20.325 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4173 0.05 MB/sec execute 355 sec latency 562.271 ms 2023-12-08T21:05:21.325 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4176 0.05 MB/sec execute 356 sec latency 996.401 ms 2023-12-08T21:05:22.325 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4179 0.05 MB/sec execute 357 sec latency 999.741 ms 2023-12-08T21:05:23.326 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4181 0.05 MB/sec execute 358 sec latency 593.898 ms 2023-12-08T21:05:24.326 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4186 0.05 MB/sec execute 359 sec latency 980.330 ms 2023-12-08T21:05:25.326 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4216 0.05 MB/sec execute 360 sec latency 902.596 ms 2023-12-08T21:05:26.326 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4217 0.05 MB/sec execute 361 sec latency 1025.031 ms 2023-12-08T21:05:27.326 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4221 0.05 MB/sec execute 362 sec latency 980.165 ms 2023-12-08T21:05:28.326 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4225 0.05 MB/sec execute 363 sec latency 625.361 ms 2023-12-08T21:05:29.166 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:05:29.169 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:05:29.326 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4227 0.05 MB/sec execute 364 sec latency 1329.972 ms 2023-12-08T21:05:30.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4248 0.05 MB/sec execute 365 sec latency 266.951 ms 2023-12-08T21:05:31.326 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4252 0.05 MB/sec execute 366 sec latency 873.299 ms 2023-12-08T21:05:32.326 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4254 0.05 MB/sec execute 367 sec latency 955.663 ms 2023-12-08T21:05:33.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4276 0.05 MB/sec execute 368 sec latency 950.527 ms 2023-12-08T21:05:34.326 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4282 0.05 MB/sec execute 369 sec latency 638.618 ms 2023-12-08T21:05:35.326 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4301 0.05 MB/sec execute 370 sec latency 311.259 ms 2023-12-08T21:05:36.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4315 0.05 MB/sec execute 371 sec latency 213.220 ms 2023-12-08T21:05:37.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4317 0.05 MB/sec execute 372 sec latency 1011.652 ms 2023-12-08T21:05:38.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4323 0.05 MB/sec execute 373 sec latency 976.669 ms 2023-12-08T21:05:39.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4340 0.05 MB/sec execute 374 sec latency 506.848 ms 2023-12-08T21:05:40.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4350 0.05 MB/sec execute 375 sec latency 627.795 ms 2023-12-08T21:05:41.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4364 0.05 MB/sec execute 376 sec latency 337.247 ms 2023-12-08T21:05:42.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4382 0.05 MB/sec execute 377 sec latency 168.661 ms 2023-12-08T21:05:43.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4384 0.05 MB/sec execute 378 sec latency 941.091 ms 2023-12-08T21:05:44.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4384 0.05 MB/sec execute 379 sec latency 1038.241 ms 2023-12-08T21:05:45.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4388 0.05 MB/sec execute 380 sec latency 1086.444 ms 2023-12-08T21:05:46.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4393 0.05 MB/sec execute 381 sec latency 990.371 ms 2023-12-08T21:05:47.327 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4423 0.05 MB/sec execute 382 sec latency 895.984 ms 2023-12-08T21:05:48.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4424 0.05 MB/sec execute 383 sec latency 989.105 ms 2023-12-08T21:05:49.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4424 0.05 MB/sec execute 384 sec latency 1218.596 ms 2023-12-08T21:05:50.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4432 0.05 MB/sec execute 385 sec latency 1259.118 ms 2023-12-08T21:05:51.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4433 0.05 MB/sec execute 386 sec latency 945.519 ms 2023-12-08T21:05:52.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4450 0.05 MB/sec execute 387 sec latency 453.449 ms 2023-12-08T21:05:53.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4458 0.05 MB/sec execute 388 sec latency 952.204 ms 2023-12-08T21:05:54.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4472 0.05 MB/sec execute 389 sec latency 448.977 ms 2023-12-08T21:05:55.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4474 0.05 MB/sec execute 390 sec latency 663.349 ms 2023-12-08T21:05:56.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4495 0.05 MB/sec execute 391 sec latency 257.121 ms 2023-12-08T21:05:57.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4497 0.05 MB/sec execute 392 sec latency 797.805 ms 2023-12-08T21:05:58.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4498 0.05 MB/sec execute 393 sec latency 928.943 ms 2023-12-08T21:05:59.222 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:05:59.225 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:05:59.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4500 0.05 MB/sec execute 394 sec latency 966.692 ms 2023-12-08T21:06:00.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4501 0.04 MB/sec execute 395 sec latency 526.018 ms 2023-12-08T21:06:01.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4505 0.04 MB/sec execute 396 sec latency 989.888 ms 2023-12-08T21:06:02.328 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4506 0.04 MB/sec execute 397 sec latency 859.853 ms 2023-12-08T21:06:03.329 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4511 0.04 MB/sec execute 398 sec latency 994.336 ms 2023-12-08T21:06:04.329 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4536 0.04 MB/sec execute 399 sec latency 948.568 ms 2023-12-08T21:06:05.329 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4539 0.04 MB/sec execute 400 sec latency 737.395 ms 2023-12-08T21:06:06.329 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4557 0.04 MB/sec execute 401 sec latency 333.704 ms 2023-12-08T21:06:07.330 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4563 0.04 MB/sec execute 402 sec latency 655.917 ms 2023-12-08T21:06:08.329 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4594 0.05 MB/sec execute 403 sec latency 883.388 ms 2023-12-08T21:06:09.329 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4596 0.05 MB/sec execute 404 sec latency 788.219 ms 2023-12-08T21:06:10.329 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4600 0.05 MB/sec execute 405 sec latency 1289.624 ms 2023-12-08T21:06:11.329 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4602 0.05 MB/sec execute 406 sec latency 671.420 ms 2023-12-08T21:06:12.330 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4614 0.05 MB/sec execute 407 sec latency 924.306 ms 2023-12-08T21:06:13.330 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4615 0.05 MB/sec execute 408 sec latency 974.936 ms 2023-12-08T21:06:14.330 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4615 0.05 MB/sec execute 409 sec latency 1147.799 ms 2023-12-08T21:06:15.330 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4616 0.05 MB/sec execute 410 sec latency 1320.048 ms 2023-12-08T21:06:16.330 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4628 0.05 MB/sec execute 411 sec latency 981.750 ms 2023-12-08T21:06:17.330 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4632 0.05 MB/sec execute 412 sec latency 425.373 ms 2023-12-08T21:06:18.330 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4652 0.05 MB/sec execute 413 sec latency 385.874 ms 2023-12-08T21:06:19.330 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4656 0.05 MB/sec execute 414 sec latency 797.873 ms 2023-12-08T21:06:20.330 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4667 0.05 MB/sec execute 415 sec latency 1112.598 ms 2023-12-08T21:06:21.330 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4668 0.05 MB/sec execute 416 sec latency 927.560 ms 2023-12-08T21:06:22.331 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4681 0.05 MB/sec execute 417 sec latency 945.085 ms 2023-12-08T21:06:23.331 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4685 0.05 MB/sec execute 418 sec latency 966.940 ms 2023-12-08T21:06:24.331 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4701 0.05 MB/sec execute 419 sec latency 503.747 ms 2023-12-08T21:06:25.331 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4714 0.05 MB/sec execute 420 sec latency 352.537 ms 2023-12-08T21:06:26.331 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4724 0.05 MB/sec execute 421 sec latency 580.510 ms 2023-12-08T21:06:27.331 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4727 0.04 MB/sec execute 422 sec latency 950.930 ms 2023-12-08T21:06:28.331 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4734 0.04 MB/sec execute 423 sec latency 592.244 ms 2023-12-08T21:06:29.331 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4735 0.04 MB/sec execute 424 sec latency 890.576 ms 2023-12-08T21:06:29.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:06:29.422 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:06:30.331 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4736 0.04 MB/sec execute 425 sec latency 896.319 ms 2023-12-08T21:06:31.331 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4742 0.04 MB/sec execute 426 sec latency 1016.083 ms 2023-12-08T21:06:32.332 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4746 0.04 MB/sec execute 427 sec latency 487.086 ms 2023-12-08T21:06:33.332 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4766 0.04 MB/sec execute 428 sec latency 272.961 ms 2023-12-08T21:06:34.332 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4770 0.04 MB/sec execute 429 sec latency 822.539 ms 2023-12-08T21:06:35.332 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4777 0.04 MB/sec execute 430 sec latency 1368.988 ms 2023-12-08T21:06:36.332 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4791 0.04 MB/sec execute 431 sec latency 313.583 ms 2023-12-08T21:06:37.332 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4806 0.04 MB/sec execute 432 sec latency 359.716 ms 2023-12-08T21:06:38.332 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4814 0.04 MB/sec execute 433 sec latency 557.360 ms 2023-12-08T21:06:39.332 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4817 0.04 MB/sec execute 434 sec latency 1045.988 ms 2023-12-08T21:06:40.332 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4839 0.04 MB/sec execute 435 sec latency 342.700 ms 2023-12-08T21:06:41.333 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4844 0.04 MB/sec execute 436 sec latency 538.144 ms 2023-12-08T21:06:42.333 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4846 0.04 MB/sec execute 437 sec latency 1010.976 ms 2023-12-08T21:06:43.333 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4847 0.04 MB/sec execute 438 sec latency 1052.798 ms 2023-12-08T21:06:44.336 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4848 0.04 MB/sec execute 439 sec latency 1390.804 ms 2023-12-08T21:06:45.333 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4850 0.04 MB/sec execute 440 sec latency 904.394 ms 2023-12-08T21:06:46.333 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4942 0.05 MB/sec execute 441 sec latency 962.481 ms 2023-12-08T21:06:47.333 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4943 0.05 MB/sec execute 442 sec latency 979.192 ms 2023-12-08T21:06:48.333 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4947 0.05 MB/sec execute 443 sec latency 862.727 ms 2023-12-08T21:06:49.333 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4948 0.05 MB/sec execute 444 sec latency 975.579 ms 2023-12-08T21:06:50.333 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4951 0.05 MB/sec execute 445 sec latency 827.266 ms 2023-12-08T21:06:51.334 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4962 0.05 MB/sec execute 446 sec latency 959.683 ms 2023-12-08T21:06:52.334 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4963 0.05 MB/sec execute 447 sec latency 757.887 ms 2023-12-08T21:06:53.334 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4979 0.05 MB/sec execute 448 sec latency 936.615 ms 2023-12-08T21:06:54.334 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4983 0.05 MB/sec execute 449 sec latency 923.301 ms 2023-12-08T21:06:55.334 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4992 0.05 MB/sec execute 450 sec latency 1121.414 ms 2023-12-08T21:06:56.334 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5007 0.05 MB/sec execute 451 sec latency 446.464 ms 2023-12-08T21:06:57.334 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5014 0.05 MB/sec execute 452 sec latency 457.624 ms 2023-12-08T21:06:58.334 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5019 0.05 MB/sec execute 453 sec latency 951.675 ms 2023-12-08T21:06:59.334 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5031 0.05 MB/sec execute 454 sec latency 188.555 ms 2023-12-08T21:06:59.480 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:06:59.483 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:07:00.334 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5032 0.05 MB/sec execute 455 sec latency 758.138 ms 2023-12-08T21:07:01.334 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5051 0.05 MB/sec execute 456 sec latency 990.038 ms 2023-12-08T21:07:02.334 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5052 0.05 MB/sec execute 457 sec latency 1090.839 ms 2023-12-08T21:07:03.335 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5056 0.05 MB/sec execute 458 sec latency 481.295 ms 2023-12-08T21:07:04.335 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5056 0.05 MB/sec execute 459 sec latency 1001.422 ms 2023-12-08T21:07:05.335 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5067 0.05 MB/sec execute 460 sec latency 1116.675 ms 2023-12-08T21:07:06.335 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5078 0.05 MB/sec execute 461 sec latency 483.632 ms 2023-12-08T21:07:07.335 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5091 0.05 MB/sec execute 462 sec latency 518.381 ms 2023-12-08T21:07:08.336 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5092 0.05 MB/sec execute 463 sec latency 924.608 ms 2023-12-08T21:07:09.335 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5096 0.05 MB/sec execute 464 sec latency 1060.929 ms 2023-12-08T21:07:10.335 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5118 0.05 MB/sec execute 465 sec latency 931.620 ms 2023-12-08T21:07:11.335 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5120 0.05 MB/sec execute 466 sec latency 492.060 ms 2023-12-08T21:07:12.335 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5127 0.05 MB/sec execute 467 sec latency 939.587 ms 2023-12-08T21:07:13.335 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5141 0.05 MB/sec execute 468 sec latency 181.042 ms 2023-12-08T21:07:14.336 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5150 0.05 MB/sec execute 469 sec latency 242.496 ms 2023-12-08T21:07:15.336 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5154 0.05 MB/sec execute 470 sec latency 304.095 ms 2023-12-08T21:07:16.336 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5158 0.05 MB/sec execute 471 sec latency 1205.064 ms 2023-12-08T21:07:17.336 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5171 0.05 MB/sec execute 472 sec latency 549.748 ms 2023-12-08T21:07:18.336 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5174 0.05 MB/sec execute 473 sec latency 937.830 ms 2023-12-08T21:07:18.753 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:13:47.550 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:07:18.773 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:13:47.570 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:07:18.943 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:13:47.666 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:07:18.944 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:13:47.666 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:07:18.952 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:13:47.675 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:07:18.956 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:13:47.679 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:07:19.201 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:13:47.997 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:07:19.247 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:13:47.970 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:07:19.295 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:13:48.018 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:07:19.336 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5177 0.05 MB/sec execute 474 sec latency 942.423 ms 2023-12-08T21:07:20.338 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5182 0.05 MB/sec execute 475 sec latency 285.506 ms 2023-12-08T21:07:21.336 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5193 0.05 MB/sec execute 476 sec latency 874.464 ms 2023-12-08T21:07:22.336 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5206 0.05 MB/sec execute 477 sec latency 523.337 ms 2023-12-08T21:07:23.336 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5209 0.05 MB/sec execute 478 sec latency 945.033 ms 2023-12-08T21:07:24.336 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5209 0.05 MB/sec execute 479 sec latency 1110.297 ms 2023-12-08T21:07:25.337 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5227 0.05 MB/sec execute 480 sec latency 1199.779 ms 2023-12-08T21:07:26.337 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5251 0.05 MB/sec execute 481 sec latency 463.558 ms 2023-12-08T21:07:27.337 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5254 0.05 MB/sec execute 482 sec latency 628.917 ms 2023-12-08T21:07:28.337 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5264 0.05 MB/sec execute 483 sec latency 639.428 ms 2023-12-08T21:07:29.337 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5266 0.05 MB/sec execute 484 sec latency 681.009 ms 2023-12-08T21:07:29.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:07:29.664 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:07:30.337 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5272 0.05 MB/sec execute 485 sec latency 982.743 ms 2023-12-08T21:07:31.337 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5290 0.05 MB/sec execute 486 sec latency 980.425 ms 2023-12-08T21:07:32.337 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5329 0.05 MB/sec execute 487 sec latency 220.069 ms 2023-12-08T21:07:33.337 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5337 0.05 MB/sec execute 488 sec latency 485.352 ms 2023-12-08T21:07:34.337 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5337 0.05 MB/sec execute 489 sec latency 1167.883 ms 2023-12-08T21:07:35.338 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5364 0.05 MB/sec execute 490 sec latency 1212.461 ms 2023-12-08T21:07:36.338 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5370 0.05 MB/sec execute 491 sec latency 277.190 ms 2023-12-08T21:07:37.338 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5373 0.05 MB/sec execute 492 sec latency 966.644 ms 2023-12-08T21:07:38.338 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5387 0.05 MB/sec execute 493 sec latency 462.420 ms 2023-12-08T21:07:39.338 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5388 0.05 MB/sec execute 494 sec latency 977.497 ms 2023-12-08T21:07:40.338 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5391 0.05 MB/sec execute 495 sec latency 857.245 ms 2023-12-08T21:07:41.338 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5402 0.05 MB/sec execute 496 sec latency 939.838 ms 2023-12-08T21:07:42.338 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5406 0.04 MB/sec execute 497 sec latency 328.927 ms 2023-12-08T21:07:43.338 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5420 0.04 MB/sec execute 498 sec latency 990.280 ms 2023-12-08T21:07:44.338 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5423 0.04 MB/sec execute 499 sec latency 509.662 ms 2023-12-08T21:07:45.339 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5427 0.04 MB/sec execute 500 sec latency 1002.574 ms 2023-12-08T21:07:46.339 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5431 0.04 MB/sec execute 501 sec latency 915.040 ms 2023-12-08T21:07:47.339 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5434 0.04 MB/sec execute 502 sec latency 360.451 ms 2023-12-08T21:07:48.339 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5449 0.04 MB/sec execute 503 sec latency 994.196 ms 2023-12-08T21:07:49.339 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5463 0.04 MB/sec execute 504 sec latency 479.750 ms 2023-12-08T21:07:50.339 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5468 0.04 MB/sec execute 505 sec latency 944.608 ms 2023-12-08T21:07:51.339 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5474 0.04 MB/sec execute 506 sec latency 978.225 ms 2023-12-08T21:07:52.339 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5477 0.04 MB/sec execute 507 sec latency 557.503 ms 2023-12-08T21:07:53.339 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5485 0.04 MB/sec execute 508 sec latency 955.642 ms 2023-12-08T21:07:54.339 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5485 0.04 MB/sec execute 509 sec latency 1273.796 ms 2023-12-08T21:07:55.339 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5528 0.04 MB/sec execute 510 sec latency 1298.466 ms 2023-12-08T21:07:56.342 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5540 0.04 MB/sec execute 511 sec latency 500.483 ms 2023-12-08T21:07:57.340 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5541 0.04 MB/sec execute 512 sec latency 927.495 ms 2023-12-08T21:07:58.340 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5562 0.04 MB/sec execute 513 sec latency 152.889 ms 2023-12-08T21:07:59.340 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5563 0.04 MB/sec execute 514 sec latency 1013.610 ms 2023-12-08T21:07:59.701 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:07:59.704 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:08:00.340 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5585 0.04 MB/sec execute 515 sec latency 296.774 ms 2023-12-08T21:08:01.340 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5597 0.04 MB/sec execute 516 sec latency 183.469 ms 2023-12-08T21:08:02.340 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5598 0.04 MB/sec execute 517 sec latency 956.842 ms 2023-12-08T21:08:03.340 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5605 0.04 MB/sec execute 518 sec latency 760.942 ms 2023-12-08T21:08:04.342 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5613 0.04 MB/sec execute 519 sec latency 956.575 ms 2023-12-08T21:08:05.340 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5615 0.04 MB/sec execute 520 sec latency 1250.644 ms 2023-12-08T21:08:06.340 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5619 0.04 MB/sec execute 521 sec latency 981.941 ms 2023-12-08T21:08:07.340 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5623 0.04 MB/sec execute 522 sec latency 303.395 ms 2023-12-08T21:08:08.340 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5631 0.04 MB/sec execute 523 sec latency 1126.828 ms 2023-12-08T21:08:09.341 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5641 0.04 MB/sec execute 524 sec latency 739.004 ms 2023-12-08T21:08:10.341 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5643 0.04 MB/sec execute 525 sec latency 1288.649 ms 2023-12-08T21:08:11.341 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5650 0.04 MB/sec execute 526 sec latency 1005.003 ms 2023-12-08T21:08:12.341 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5655 0.04 MB/sec execute 527 sec latency 589.673 ms 2023-12-08T21:08:13.341 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5658 0.04 MB/sec execute 528 sec latency 972.181 ms 2023-12-08T21:08:14.341 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5667 0.04 MB/sec execute 529 sec latency 1014.404 ms 2023-12-08T21:08:15.341 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5701 0.04 MB/sec execute 530 sec latency 406.095 ms 2023-12-08T21:08:16.341 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5703 0.04 MB/sec execute 531 sec latency 912.394 ms 2023-12-08T21:08:17.341 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5708 0.04 MB/sec execute 532 sec latency 810.282 ms 2023-12-08T21:08:18.341 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5735 0.04 MB/sec execute 533 sec latency 955.234 ms 2023-12-08T21:08:19.342 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5736 0.04 MB/sec execute 534 sec latency 993.636 ms 2023-12-08T21:08:20.342 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5738 0.04 MB/sec execute 535 sec latency 926.561 ms 2023-12-08T21:08:21.342 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5742 0.04 MB/sec execute 536 sec latency 360.784 ms 2023-12-08T21:08:22.342 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5744 0.04 MB/sec execute 537 sec latency 621.134 ms 2023-12-08T21:08:23.343 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5759 0.04 MB/sec execute 538 sec latency 991.918 ms 2023-12-08T21:08:24.342 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5763 0.04 MB/sec execute 539 sec latency 551.182 ms 2023-12-08T21:08:25.342 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5782 0.04 MB/sec execute 540 sec latency 390.319 ms 2023-12-08T21:08:26.342 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5808 0.04 MB/sec execute 541 sec latency 991.457 ms 2023-12-08T21:08:27.342 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5825 0.04 MB/sec execute 542 sec latency 182.727 ms 2023-12-08T21:08:28.342 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5853 0.04 MB/sec execute 543 sec latency 610.016 ms 2023-12-08T21:08:29.343 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5857 0.04 MB/sec execute 544 sec latency 953.814 ms 2023-12-08T21:08:29.840 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:08:29.843 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:08:30.342 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5863 0.04 MB/sec execute 545 sec latency 375.136 ms 2023-12-08T21:08:31.343 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5866 0.04 MB/sec execute 546 sec latency 970.112 ms 2023-12-08T21:08:32.343 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5866 0.04 MB/sec execute 547 sec latency 1368.446 ms 2023-12-08T21:08:33.343 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5867 0.04 MB/sec execute 548 sec latency 1404.176 ms 2023-12-08T21:08:34.343 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5881 0.04 MB/sec execute 549 sec latency 1108.393 ms 2023-12-08T21:08:35.343 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5884 0.04 MB/sec execute 550 sec latency 1527.752 ms 2023-12-08T21:08:36.343 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5887 0.04 MB/sec execute 551 sec latency 944.047 ms 2023-12-08T21:08:37.343 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5895 0.04 MB/sec execute 552 sec latency 388.247 ms 2023-12-08T21:08:38.343 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5897 0.04 MB/sec execute 553 sec latency 944.230 ms 2023-12-08T21:08:39.343 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5900 0.04 MB/sec execute 554 sec latency 917.949 ms 2023-12-08T21:08:40.343 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5918 0.04 MB/sec execute 555 sec latency 1055.882 ms 2023-12-08T21:08:41.344 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5921 0.04 MB/sec execute 556 sec latency 497.460 ms 2023-12-08T21:08:42.344 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5922 0.04 MB/sec execute 557 sec latency 1154.565 ms 2023-12-08T21:08:43.344 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5924 0.04 MB/sec execute 558 sec latency 1046.964 ms 2023-12-08T21:08:44.344 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5924 0.04 MB/sec execute 559 sec latency 1296.111 ms 2023-12-08T21:08:45.344 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5926 0.04 MB/sec execute 560 sec latency 1340.904 ms 2023-12-08T21:08:46.344 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5931 0.04 MB/sec execute 561 sec latency 961.016 ms 2023-12-08T21:08:47.344 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5939 0.04 MB/sec execute 562 sec latency 1001.978 ms 2023-12-08T21:08:48.344 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5949 0.04 MB/sec execute 563 sec latency 604.838 ms 2023-12-08T21:08:49.344 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5951 0.04 MB/sec execute 564 sec latency 965.996 ms 2023-12-08T21:08:50.344 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5959 0.04 MB/sec execute 565 sec latency 1050.809 ms 2023-12-08T21:08:51.344 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5966 0.04 MB/sec execute 566 sec latency 441.362 ms 2023-12-08T21:08:52.345 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5970 0.04 MB/sec execute 567 sec latency 652.376 ms 2023-12-08T21:08:53.345 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5986 0.04 MB/sec execute 568 sec latency 905.850 ms 2023-12-08T21:08:54.345 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5989 0.04 MB/sec execute 569 sec latency 825.180 ms 2023-12-08T21:08:55.345 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5992 0.04 MB/sec execute 570 sec latency 938.538 ms 2023-12-08T21:08:56.345 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5994 0.04 MB/sec execute 571 sec latency 932.134 ms 2023-12-08T21:08:57.345 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6000 0.04 MB/sec execute 572 sec latency 315.189 ms 2023-12-08T21:08:58.345 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6008 0.04 MB/sec execute 573 sec latency 485.104 ms 2023-12-08T21:08:59.345 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6013 0.04 MB/sec execute 574 sec latency 435.035 ms 2023-12-08T21:08:59.963 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:08:59.966 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:09:00.345 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6028 0.04 MB/sec execute 575 sec latency 464.136 ms 2023-12-08T21:09:01.345 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6030 0.04 MB/sec execute 576 sec latency 994.563 ms 2023-12-08T21:09:02.345 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6049 0.04 MB/sec execute 577 sec latency 1015.357 ms 2023-12-08T21:09:03.346 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6052 0.04 MB/sec execute 578 sec latency 577.144 ms 2023-12-08T21:09:04.346 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6054 0.04 MB/sec execute 579 sec latency 1197.329 ms 2023-12-08T21:09:05.346 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6056 0.04 MB/sec execute 580 sec latency 1109.276 ms 2023-12-08T21:09:06.346 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6064 0.04 MB/sec execute 581 sec latency 266.421 ms 2023-12-08T21:09:07.346 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6066 0.04 MB/sec execute 582 sec latency 1033.057 ms 2023-12-08T21:09:08.346 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6109 0.04 MB/sec execute 583 sec latency 942.271 ms 2023-12-08T21:09:09.346 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6111 0.04 MB/sec execute 584 sec latency 846.059 ms 2023-12-08T21:09:10.346 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6118 0.04 MB/sec execute 585 sec latency 394.986 ms 2023-12-08T21:09:11.346 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6119 0.04 MB/sec execute 586 sec latency 933.234 ms 2023-12-08T21:09:12.346 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6132 0.04 MB/sec execute 587 sec latency 383.602 ms 2023-12-08T21:09:13.346 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6138 0.04 MB/sec execute 588 sec latency 462.510 ms 2023-12-08T21:09:14.346 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6139 0.04 MB/sec execute 589 sec latency 1014.583 ms 2023-12-08T21:09:15.347 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6140 0.04 MB/sec execute 590 sec latency 1229.864 ms 2023-12-08T21:09:16.347 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6154 0.04 MB/sec execute 591 sec latency 284.903 ms 2023-12-08T21:09:17.347 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6158 0.04 MB/sec execute 592 sec latency 668.912 ms 2023-12-08T21:09:18.347 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6161 0.04 MB/sec execute 593 sec latency 1023.556 ms 2023-12-08T21:09:19.347 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6166 0.04 MB/sec execute 594 sec latency 470.780 ms 2023-12-08T21:09:20.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6173 0.04 MB/sec execute 595 sec latency 623.378 ms 2023-12-08T21:09:21.347 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6175 0.04 MB/sec execute 596 sec latency 963.782 ms 2023-12-08T21:09:22.347 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6176 0.04 MB/sec execute 597 sec latency 997.171 ms 2023-12-08T21:09:23.347 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6179 0.04 MB/sec execute 598 sec latency 1001.079 ms 2023-12-08T21:09:24.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6271 0.05 MB/sec execute 599 sec latency 957.134 ms 2023-12-08T21:09:25.347 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 600 sec 2023-12-08T21:09:26.347 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 601 sec 2023-12-08T21:09:27.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 602 sec 2023-12-08T21:09:28.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 603 sec 2023-12-08T21:09:29.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 604 sec 2023-12-08T21:09:30.101 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:09:30.104 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:09:30.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 605 sec 2023-12-08T21:09:31.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 606 sec 2023-12-08T21:09:32.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 607 sec 2023-12-08T21:09:33.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 608 sec 2023-12-08T21:09:34.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 609 sec 2023-12-08T21:09:35.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 610 sec 2023-12-08T21:09:36.350 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 611 sec 2023-12-08T21:09:37.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 612 sec 2023-12-08T21:09:38.348 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 613 sec 2023-12-08T21:09:39.349 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 614 sec 2023-12-08T21:09:40.349 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 615 sec 2023-12-08T21:09:41.349 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 616 sec 2023-12-08T21:09:42.349 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 617 sec 2023-12-08T21:09:43.349 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 618 sec 2023-12-08T21:09:44.079 INFO:tasks.workunit.client.0.smithi053.stdout: 0 cleanup 619 sec 2023-12-08T21:09:44.079 INFO:tasks.workunit.client.0.smithi053.stdout: 2023-12-08T21:09:44.079 INFO:tasks.workunit.client.0.smithi053.stdout: Operation Count AvgLat MaxLat 2023-12-08T21:09:44.079 INFO:tasks.workunit.client.0.smithi053.stdout: ---------------------------------------- 2023-12-08T21:09:44.079 INFO:tasks.workunit.client.0.smithi053.stdout: NTCreateX 866 178.187 990.539 2023-12-08T21:09:44.079 INFO:tasks.workunit.client.0.smithi053.stdout: Close 654 3.964 27.502 2023-12-08T21:09:44.079 INFO:tasks.workunit.client.0.smithi053.stdout: Rename 33 530.355 825.159 2023-12-08T21:09:44.079 INFO:tasks.workunit.client.0.smithi053.stdout: Unlink 147 174.122 301.481 2023-12-08T21:09:44.079 INFO:tasks.workunit.client.0.smithi053.stdout: Qpathinfo 829 98.488 884.743 2023-12-08T21:09:44.079 INFO:tasks.workunit.client.0.smithi053.stdout: Qfileinfo 147 2.988 5.148 2023-12-08T21:09:44.080 INFO:tasks.workunit.client.0.smithi053.stdout: Qfsinfo 121 43.619 356.199 2023-12-08T21:09:44.080 INFO:tasks.workunit.client.0.smithi053.stdout: Sfileinfo 66 36.465 44.418 2023-12-08T21:09:44.080 INFO:tasks.workunit.client.0.smithi053.stdout: Find 300 995.298 1573.090 2023-12-08T21:09:44.080 INFO:tasks.workunit.client.0.smithi053.stdout: WriteX 426 11.844 190.723 2023-12-08T21:09:44.080 INFO:tasks.workunit.client.0.smithi053.stdout: ReadX 1350 0.085 5.334 2023-12-08T21:09:44.080 INFO:tasks.workunit.client.0.smithi053.stdout: LockX 2 77.055 117.187 2023-12-08T21:09:44.080 INFO:tasks.workunit.client.0.smithi053.stdout: UnlockX 2 51.294 62.956 2023-12-08T21:09:44.080 INFO:tasks.workunit.client.0.smithi053.stdout: Flush 53 140.664 273.483 2023-12-08T21:09:44.080 INFO:tasks.workunit.client.0.smithi053.stdout: 2023-12-08T21:09:44.080 INFO:tasks.workunit.client.0.smithi053.stdout:Throughput 0.0465862 MB/sec 1 clients 1 procs max_latency=1573.103 ms 2023-12-08T21:09:44.080 INFO:tasks.workunit.client.0.smithi053.stderr:+ dbench 10 2023-12-08T21:09:44.081 INFO:tasks.workunit.client.0.smithi053.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-12-08T21:09:44.081 INFO:tasks.workunit.client.0.smithi053.stdout: 2023-12-08T21:09:44.081 INFO:tasks.workunit.client.0.smithi053.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-12-08T21:09:44.082 INFO:tasks.workunit.client.0.smithi053.stdout:9 of 10 processes prepared for launch 0 sec 2023-12-08T21:09:44.182 INFO:tasks.workunit.client.0.smithi053.stdout:10 of 10 processes prepared for launch 0 sec 2023-12-08T21:09:44.182 INFO:tasks.workunit.client.0.smithi053.stdout:releasing clients 2023-12-08T21:09:45.182 INFO:tasks.workunit.client.0.smithi053.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.833 ms 2023-12-08T21:09:46.182 INFO:tasks.workunit.client.0.smithi053.stdout: 0 3 0.00 MB/sec warmup 2 sec latency 1999.931 ms 2023-12-08T21:09:47.182 INFO:tasks.workunit.client.0.smithi053.stdout: 0 3 0.00 MB/sec warmup 3 sec latency 3000.024 ms 2023-12-08T21:09:48.182 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6 0.26 MB/sec warmup 4 sec latency 4000.122 ms 2023-12-08T21:09:49.182 INFO:tasks.workunit.client.0.smithi053.stdout: 1 8 0.39 MB/sec warmup 5 sec latency 5000.207 ms 2023-12-08T21:09:50.183 INFO:tasks.workunit.client.0.smithi053.stdout: 1 10 0.35 MB/sec warmup 6 sec latency 6000.291 ms 2023-12-08T21:09:51.185 INFO:tasks.workunit.client.0.smithi053.stdout: 1 12 0.43 MB/sec warmup 7 sec latency 1474.158 ms 2023-12-08T21:09:52.183 INFO:tasks.workunit.client.0.smithi053.stdout: 1 14 0.39 MB/sec warmup 8 sec latency 1126.560 ms 2023-12-08T21:09:53.183 INFO:tasks.workunit.client.0.smithi053.stdout: 1 16 0.39 MB/sec warmup 9 sec latency 1513.408 ms 2023-12-08T21:09:54.183 INFO:tasks.workunit.client.0.smithi053.stdout: 4 20 0.55 MB/sec warmup 10 sec latency 1618.296 ms 2023-12-08T21:09:55.183 INFO:tasks.workunit.client.0.smithi053.stdout: 6 26 0.76 MB/sec warmup 11 sec latency 1295.441 ms 2023-12-08T21:09:56.183 INFO:tasks.workunit.client.0.smithi053.stdout: 6 30 0.86 MB/sec warmup 12 sec latency 1606.978 ms 2023-12-08T21:09:57.183 INFO:tasks.workunit.client.0.smithi053.stdout: 10 37 1.05 MB/sec warmup 13 sec latency 1626.170 ms 2023-12-08T21:09:58.183 INFO:tasks.workunit.client.0.smithi053.stdout: 10 45 1.28 MB/sec warmup 14 sec latency 1937.569 ms 2023-12-08T21:09:59.184 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49 1.33 MB/sec warmup 15 sec latency 1404.396 ms 2023-12-08T21:10:00.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:10:00.153 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:10:00.183 INFO:tasks.workunit.client.0.smithi053.stdout: 10 50 1.30 MB/sec warmup 16 sec latency 2404.464 ms 2023-12-08T21:10:01.184 INFO:tasks.workunit.client.0.smithi053.stdout: 10 57 1.39 MB/sec warmup 17 sec latency 2418.170 ms 2023-12-08T21:10:02.184 INFO:tasks.workunit.client.0.smithi053.stdout: 10 64 1.53 MB/sec warmup 18 sec latency 2225.221 ms 2023-12-08T21:10:03.184 INFO:tasks.workunit.client.0.smithi053.stdout: 10 69 1.59 MB/sec warmup 19 sec latency 2138.403 ms 2023-12-08T21:10:04.184 INFO:tasks.workunit.client.0.smithi053.stdout: 10 73 1.59 MB/sec warmup 20 sec latency 2090.407 ms 2023-12-08T21:10:05.184 INFO:tasks.workunit.client.0.smithi053.stdout: 10 79 1.68 MB/sec warmup 21 sec latency 2106.647 ms 2023-12-08T21:10:06.184 INFO:tasks.workunit.client.0.smithi053.stdout: 10 84 1.72 MB/sec warmup 22 sec latency 2516.437 ms 2023-12-08T21:10:07.184 INFO:tasks.workunit.client.0.smithi053.stdout: 10 89 1.76 MB/sec warmup 23 sec latency 1992.303 ms 2023-12-08T21:10:08.184 INFO:tasks.workunit.client.0.smithi053.stdout: 10 94 1.80 MB/sec warmup 24 sec latency 1993.843 ms 2023-12-08T21:10:09.184 INFO:tasks.workunit.client.0.smithi053.stdout: 10 100 1.84 MB/sec warmup 25 sec latency 2241.123 ms 2023-12-08T21:10:10.184 INFO:tasks.workunit.client.0.smithi053.stdout: 10 105 1.88 MB/sec warmup 26 sec latency 2185.985 ms 2023-12-08T21:10:11.184 INFO:tasks.workunit.client.0.smithi053.stdout: 10 110 1.89 MB/sec warmup 27 sec latency 2632.197 ms 2023-12-08T21:10:12.185 INFO:tasks.workunit.client.0.smithi053.stdout: 10 115 1.91 MB/sec warmup 28 sec latency 2412.482 ms 2023-12-08T21:10:13.185 INFO:tasks.workunit.client.0.smithi053.stdout: 10 117 1.85 MB/sec warmup 29 sec latency 2194.937 ms 2023-12-08T21:10:14.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 119 1.81 MB/sec warmup 30 sec latency 2423.846 ms 2023-12-08T21:10:15.185 INFO:tasks.workunit.client.0.smithi053.stdout: 10 123 1.80 MB/sec warmup 31 sec latency 2345.940 ms 2023-12-08T21:10:16.185 INFO:tasks.workunit.client.0.smithi053.stdout: 10 124 1.75 MB/sec warmup 32 sec latency 2449.638 ms 2023-12-08T21:10:17.185 INFO:tasks.workunit.client.0.smithi053.stdout: 10 129 1.74 MB/sec warmup 33 sec latency 2718.546 ms 2023-12-08T21:10:18.185 INFO:tasks.workunit.client.0.smithi053.stdout: 10 131 1.72 MB/sec warmup 34 sec latency 1746.818 ms 2023-12-08T21:10:19.185 INFO:tasks.workunit.client.0.smithi053.stdout: 10 133 1.68 MB/sec warmup 35 sec latency 2159.137 ms 2023-12-08T21:10:20.185 INFO:tasks.workunit.client.0.smithi053.stdout: 10 136 1.67 MB/sec warmup 36 sec latency 2854.450 ms 2023-12-08T21:10:21.185 INFO:tasks.workunit.client.0.smithi053.stdout: 10 139 1.64 MB/sec warmup 37 sec latency 3284.327 ms 2023-12-08T21:10:22.185 INFO:tasks.workunit.client.0.smithi053.stdout: 10 141 1.62 MB/sec warmup 38 sec latency 2930.685 ms 2023-12-08T21:10:23.185 INFO:tasks.workunit.client.0.smithi053.stdout: 10 143 1.58 MB/sec warmup 39 sec latency 3075.782 ms 2023-12-08T21:10:24.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 143 1.54 MB/sec warmup 40 sec latency 2510.430 ms 2023-12-08T21:10:25.185 INFO:tasks.workunit.client.0.smithi053.stdout: 10 145 1.52 MB/sec warmup 41 sec latency 3192.081 ms 2023-12-08T21:10:26.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 146 1.49 MB/sec warmup 42 sec latency 3698.816 ms 2023-12-08T21:10:27.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 149 1.47 MB/sec warmup 43 sec latency 4287.118 ms 2023-12-08T21:10:28.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 153 1.47 MB/sec warmup 44 sec latency 3386.002 ms 2023-12-08T21:10:29.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 156 1.46 MB/sec warmup 45 sec latency 3446.986 ms 2023-12-08T21:10:30.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 160 1.46 MB/sec warmup 46 sec latency 2299.570 ms 2023-12-08T21:10:30.220 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:10:30.222 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:10:31.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 162 1.44 MB/sec warmup 47 sec latency 2538.086 ms 2023-12-08T21:10:32.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 163 1.41 MB/sec warmup 48 sec latency 2732.086 ms 2023-12-08T21:10:33.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 167 1.40 MB/sec warmup 49 sec latency 2527.358 ms 2023-12-08T21:10:34.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 167 1.38 MB/sec warmup 50 sec latency 3527.442 ms 2023-12-08T21:10:35.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 171 1.37 MB/sec warmup 51 sec latency 3874.011 ms 2023-12-08T21:10:36.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 171 1.35 MB/sec warmup 52 sec latency 3626.152 ms 2023-12-08T21:10:37.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 174 1.34 MB/sec warmup 53 sec latency 4134.262 ms 2023-12-08T21:10:38.186 INFO:tasks.workunit.client.0.smithi053.stdout: 10 176 1.33 MB/sec warmup 54 sec latency 4232.360 ms 2023-12-08T21:10:39.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 180 1.33 MB/sec warmup 55 sec latency 3617.342 ms 2023-12-08T21:10:40.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 183 1.32 MB/sec warmup 56 sec latency 2438.253 ms 2023-12-08T21:10:41.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 185 1.31 MB/sec warmup 57 sec latency 2540.318 ms 2023-12-08T21:10:42.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 186 1.29 MB/sec warmup 58 sec latency 3540.392 ms 2023-12-08T21:10:43.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 189 1.29 MB/sec warmup 59 sec latency 4165.261 ms 2023-12-08T21:10:44.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 192 1.28 MB/sec warmup 60 sec latency 4074.660 ms 2023-12-08T21:10:45.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 195 1.28 MB/sec warmup 61 sec latency 3738.561 ms 2023-12-08T21:10:46.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 196 1.26 MB/sec warmup 62 sec latency 3196.545 ms 2023-12-08T21:10:46.900 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:17:15.695 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:10:46.917 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:17:15.713 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:10:47.097 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:17:15.819 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:10:47.104 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:17:15.826 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:10:47.107 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:17:15.829 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:10:47.110 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:17:15.832 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:10:47.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 201 1.26 MB/sec warmup 63 sec latency 2794.984 ms 2023-12-08T21:10:47.251 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:17:16.047 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:10:47.398 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:17:16.120 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:10:47.408 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:17:16.131 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:10:48.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 204 1.26 MB/sec warmup 64 sec latency 2182.748 ms 2023-12-08T21:10:49.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 207 1.25 MB/sec warmup 65 sec latency 2069.475 ms 2023-12-08T21:10:50.188 INFO:tasks.workunit.client.0.smithi053.stdout: 10 210 1.25 MB/sec warmup 66 sec latency 2060.851 ms 2023-12-08T21:10:51.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 211 1.23 MB/sec warmup 67 sec latency 2096.094 ms 2023-12-08T21:10:52.187 INFO:tasks.workunit.client.0.smithi053.stdout: 10 215 1.23 MB/sec warmup 68 sec latency 2303.158 ms 2023-12-08T21:10:53.188 INFO:tasks.workunit.client.0.smithi053.stdout: 10 219 1.23 MB/sec warmup 69 sec latency 2456.480 ms 2023-12-08T21:10:54.188 INFO:tasks.workunit.client.0.smithi053.stdout: 10 220 1.22 MB/sec warmup 70 sec latency 2504.236 ms 2023-12-08T21:10:55.188 INFO:tasks.workunit.client.0.smithi053.stdout: 10 226 1.23 MB/sec warmup 71 sec latency 2514.008 ms 2023-12-08T21:10:56.188 INFO:tasks.workunit.client.0.smithi053.stdout: 10 227 1.22 MB/sec warmup 72 sec latency 2126.457 ms 2023-12-08T21:10:57.188 INFO:tasks.workunit.client.0.smithi053.stdout: 10 230 1.21 MB/sec warmup 73 sec latency 2822.200 ms 2023-12-08T21:10:58.188 INFO:tasks.workunit.client.0.smithi053.stdout: 10 235 1.22 MB/sec warmup 74 sec latency 2322.807 ms 2023-12-08T21:10:59.188 INFO:tasks.workunit.client.0.smithi053.stdout: 10 235 1.20 MB/sec warmup 75 sec latency 2157.036 ms 2023-12-08T21:11:00.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 238 1.20 MB/sec warmup 76 sec latency 2608.722 ms 2023-12-08T21:11:00.329 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:11:00.332 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:11:01.188 INFO:tasks.workunit.client.0.smithi053.stdout: 10 241 1.19 MB/sec warmup 77 sec latency 3283.639 ms 2023-12-08T21:11:02.188 INFO:tasks.workunit.client.0.smithi053.stdout: 10 243 1.19 MB/sec warmup 78 sec latency 2957.908 ms 2023-12-08T21:11:03.188 INFO:tasks.workunit.client.0.smithi053.stdout: 10 243 1.17 MB/sec warmup 79 sec latency 3957.985 ms 2023-12-08T21:11:04.188 INFO:tasks.workunit.client.0.smithi053.stdout: 10 243 1.16 MB/sec warmup 80 sec latency 4958.063 ms 2023-12-08T21:11:05.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 246 1.16 MB/sec warmup 81 sec latency 5559.119 ms 2023-12-08T21:11:06.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 247 1.15 MB/sec warmup 82 sec latency 5063.807 ms 2023-12-08T21:11:07.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 250 1.15 MB/sec warmup 83 sec latency 5678.592 ms 2023-12-08T21:11:08.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 252 1.14 MB/sec warmup 84 sec latency 4027.324 ms 2023-12-08T21:11:09.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 253 1.13 MB/sec warmup 85 sec latency 4009.505 ms 2023-12-08T21:11:10.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 257 1.13 MB/sec warmup 86 sec latency 3092.165 ms 2023-12-08T21:11:11.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 260 1.13 MB/sec warmup 87 sec latency 3735.686 ms 2023-12-08T21:11:12.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 261 1.12 MB/sec warmup 88 sec latency 2869.109 ms 2023-12-08T21:11:13.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 262 1.11 MB/sec warmup 89 sec latency 3781.074 ms 2023-12-08T21:11:14.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 262 1.10 MB/sec warmup 90 sec latency 4781.134 ms 2023-12-08T21:11:15.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 267 1.10 MB/sec warmup 91 sec latency 5096.577 ms 2023-12-08T21:11:16.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 269 1.10 MB/sec warmup 92 sec latency 1684.685 ms 2023-12-08T21:11:17.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 270 1.09 MB/sec warmup 93 sec latency 2573.628 ms 2023-12-08T21:11:18.189 INFO:tasks.workunit.client.0.smithi053.stdout: 10 271 1.08 MB/sec warmup 94 sec latency 3347.560 ms 2023-12-08T21:11:19.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 277 1.09 MB/sec warmup 95 sec latency 3751.793 ms 2023-12-08T21:11:20.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 278 1.09 MB/sec warmup 96 sec latency 1889.066 ms 2023-12-08T21:11:21.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 281 1.08 MB/sec warmup 97 sec latency 2243.765 ms 2023-12-08T21:11:22.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 284 1.08 MB/sec warmup 98 sec latency 2835.466 ms 2023-12-08T21:11:23.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 286 1.08 MB/sec warmup 99 sec latency 3288.928 ms 2023-12-08T21:11:24.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 286 1.07 MB/sec warmup 100 sec latency 3395.360 ms 2023-12-08T21:11:25.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 291 1.07 MB/sec warmup 101 sec latency 3706.007 ms 2023-12-08T21:11:26.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 293 1.06 MB/sec warmup 102 sec latency 4076.618 ms 2023-12-08T21:11:27.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 296 1.06 MB/sec warmup 103 sec latency 2445.766 ms 2023-12-08T21:11:28.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 298 1.06 MB/sec warmup 104 sec latency 2589.160 ms 2023-12-08T21:11:29.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 301 1.06 MB/sec warmup 105 sec latency 2072.984 ms 2023-12-08T21:11:30.191 INFO:tasks.workunit.client.0.smithi053.stdout: 10 305 1.06 MB/sec warmup 106 sec latency 2259.495 ms 2023-12-08T21:11:30.475 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:11:30.478 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:11:30.758 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:17:59.553 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:11:30.773 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:17:59.569 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:11:30.905 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:17:59.700 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:11:30.963 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:17:59.685 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:11:30.969 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:17:59.692 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:11:30.980 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:17:59.702 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:11:30.984 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:17:59.706 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:11:31.079 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:17:59.801 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:11:31.110 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:17:59.832 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:11:31.190 INFO:tasks.workunit.client.0.smithi053.stdout: 10 308 1.06 MB/sec warmup 107 sec latency 2105.154 ms 2023-12-08T21:11:32.191 INFO:tasks.workunit.client.0.smithi053.stdout: 10 308 1.05 MB/sec warmup 108 sec latency 2532.199 ms 2023-12-08T21:11:33.191 INFO:tasks.workunit.client.0.smithi053.stdout: 10 308 1.04 MB/sec warmup 109 sec latency 3497.327 ms 2023-12-08T21:11:34.191 INFO:tasks.workunit.client.0.smithi053.stdout: 10 313 1.04 MB/sec warmup 110 sec latency 4309.500 ms 2023-12-08T21:11:35.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 315 1.04 MB/sec warmup 111 sec latency 4042.439 ms 2023-12-08T21:11:36.191 INFO:tasks.workunit.client.0.smithi053.stdout: 10 315 1.03 MB/sec warmup 112 sec latency 2850.505 ms 2023-12-08T21:11:37.191 INFO:tasks.workunit.client.0.smithi053.stdout: 10 318 1.03 MB/sec warmup 113 sec latency 3343.412 ms 2023-12-08T21:11:38.191 INFO:tasks.workunit.client.0.smithi053.stdout: 10 322 1.03 MB/sec warmup 114 sec latency 4060.027 ms 2023-12-08T21:11:39.191 INFO:tasks.workunit.client.0.smithi053.stdout: 10 322 1.02 MB/sec warmup 115 sec latency 2614.155 ms 2023-12-08T21:11:40.191 INFO:tasks.workunit.client.0.smithi053.stdout: 10 327 1.02 MB/sec warmup 116 sec latency 2758.805 ms 2023-12-08T21:11:41.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 329 1.02 MB/sec warmup 117 sec latency 1792.807 ms 2023-12-08T21:11:42.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 331 1.02 MB/sec warmup 118 sec latency 2694.216 ms 2023-12-08T21:11:43.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 332 1.01 MB/sec warmup 119 sec latency 3446.201 ms 2023-12-08T21:11:45.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 338 1.24 MB/sec execute 1 sec latency 3816.723 ms 2023-12-08T21:11:46.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 340 0.91 MB/sec execute 2 sec latency 2982.184 ms 2023-12-08T21:11:47.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 343 0.87 MB/sec execute 3 sec latency 2983.335 ms 2023-12-08T21:11:48.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 344 0.78 MB/sec execute 4 sec latency 3086.363 ms 2023-12-08T21:11:49.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 348 0.86 MB/sec execute 5 sec latency 3292.430 ms 2023-12-08T21:11:50.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 350 0.78 MB/sec execute 6 sec latency 2676.094 ms 2023-12-08T21:11:51.193 INFO:tasks.workunit.client.0.smithi053.stdout: 10 351 0.71 MB/sec execute 7 sec latency 2374.862 ms 2023-12-08T21:11:52.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 354 0.75 MB/sec execute 8 sec latency 2870.291 ms 2023-12-08T21:11:53.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 356 0.72 MB/sec execute 9 sec latency 3744.208 ms 2023-12-08T21:11:54.192 INFO:tasks.workunit.client.0.smithi053.stdout: 10 358 0.72 MB/sec execute 10 sec latency 4026.272 ms 2023-12-08T21:11:55.193 INFO:tasks.workunit.client.0.smithi053.stdout: 10 361 0.75 MB/sec execute 11 sec latency 4346.059 ms 2023-12-08T21:11:56.193 INFO:tasks.workunit.client.0.smithi053.stdout: 10 364 0.76 MB/sec execute 12 sec latency 2800.062 ms 2023-12-08T21:11:57.193 INFO:tasks.workunit.client.0.smithi053.stdout: 10 366 0.76 MB/sec execute 13 sec latency 2525.142 ms 2023-12-08T21:11:58.193 INFO:tasks.workunit.client.0.smithi053.stdout: 10 369 0.77 MB/sec execute 14 sec latency 2855.934 ms 2023-12-08T21:11:59.193 INFO:tasks.workunit.client.0.smithi053.stdout: 10 372 0.78 MB/sec execute 15 sec latency 3023.365 ms 2023-12-08T21:12:00.193 INFO:tasks.workunit.client.0.smithi053.stdout: 10 376 0.81 MB/sec execute 16 sec latency 2400.669 ms 2023-12-08T21:12:00.611 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:12:00.614 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:12:01.193 INFO:tasks.workunit.client.0.smithi053.stdout: 10 379 0.83 MB/sec execute 17 sec latency 2055.260 ms 2023-12-08T21:12:02.193 INFO:tasks.workunit.client.0.smithi053.stdout: 10 381 0.81 MB/sec execute 18 sec latency 2552.583 ms 2023-12-08T21:12:03.193 INFO:tasks.workunit.client.0.smithi053.stdout: 10 383 0.80 MB/sec execute 19 sec latency 3278.743 ms 2023-12-08T21:12:04.193 INFO:tasks.workunit.client.0.smithi053.stdout: 10 384 0.78 MB/sec execute 20 sec latency 3788.617 ms 2023-12-08T21:12:05.194 INFO:tasks.workunit.client.0.smithi053.stdout: 10 386 0.78 MB/sec execute 21 sec latency 4326.328 ms 2023-12-08T21:12:06.193 INFO:tasks.workunit.client.0.smithi053.stdout: 10 390 0.80 MB/sec execute 22 sec latency 4269.255 ms 2023-12-08T21:12:07.194 INFO:tasks.workunit.client.0.smithi053.stdout: 10 392 0.80 MB/sec execute 23 sec latency 2904.017 ms 2023-12-08T21:12:08.194 INFO:tasks.workunit.client.0.smithi053.stdout: 10 395 0.80 MB/sec execute 24 sec latency 2569.349 ms 2023-12-08T21:12:09.194 INFO:tasks.workunit.client.0.smithi053.stdout: 10 398 0.80 MB/sec execute 25 sec latency 2786.209 ms 2023-12-08T21:12:10.194 INFO:tasks.workunit.client.0.smithi053.stdout: 10 401 0.82 MB/sec execute 26 sec latency 2115.360 ms 2023-12-08T21:12:11.194 INFO:tasks.workunit.client.0.smithi053.stdout: 10 403 0.81 MB/sec execute 27 sec latency 2323.113 ms 2023-12-08T21:12:12.194 INFO:tasks.workunit.client.0.smithi053.stdout: 10 407 0.83 MB/sec execute 28 sec latency 2655.711 ms 2023-12-08T21:12:13.194 INFO:tasks.workunit.client.0.smithi053.stdout: 10 408 0.81 MB/sec execute 29 sec latency 3629.613 ms 2023-12-08T21:12:14.194 INFO:tasks.workunit.client.0.smithi053.stdout: 10 409 0.80 MB/sec execute 30 sec latency 4388.516 ms 2023-12-08T21:12:15.194 INFO:tasks.workunit.client.0.smithi053.stdout: 10 410 0.78 MB/sec execute 31 sec latency 4594.522 ms 2023-12-08T21:12:16.194 INFO:tasks.workunit.client.0.smithi053.stdout: 10 411 0.76 MB/sec execute 32 sec latency 4645.946 ms 2023-12-08T21:12:17.195 INFO:tasks.workunit.client.0.smithi053.stdout: 10 416 0.79 MB/sec execute 33 sec latency 4956.612 ms 2023-12-08T21:12:18.195 INFO:tasks.workunit.client.0.smithi053.stdout: 10 419 0.80 MB/sec execute 34 sec latency 3844.357 ms 2023-12-08T21:12:19.195 INFO:tasks.workunit.client.0.smithi053.stdout: 10 420 0.77 MB/sec execute 35 sec latency 2541.201 ms 2023-12-08T21:12:20.195 INFO:tasks.workunit.client.0.smithi053.stdout: 10 423 0.79 MB/sec execute 36 sec latency 3220.778 ms 2023-12-08T21:12:21.195 INFO:tasks.workunit.client.0.smithi053.stdout: 10 427 0.80 MB/sec execute 37 sec latency 3045.822 ms 2023-12-08T21:12:22.195 INFO:tasks.workunit.client.0.smithi053.stdout: 10 429 0.79 MB/sec execute 38 sec latency 2313.722 ms 2023-12-08T21:12:23.195 INFO:tasks.workunit.client.0.smithi053.stdout: 10 429 0.77 MB/sec execute 39 sec latency 3313.797 ms 2023-12-08T21:12:24.195 INFO:tasks.workunit.client.0.smithi053.stdout: 10 430 0.76 MB/sec execute 40 sec latency 4313.897 ms 2023-12-08T21:12:25.195 INFO:tasks.workunit.client.0.smithi053.stdout: 10 432 0.75 MB/sec execute 41 sec latency 4911.778 ms 2023-12-08T21:12:26.195 INFO:tasks.workunit.client.0.smithi053.stdout: 10 437 0.79 MB/sec execute 42 sec latency 4497.657 ms 2023-12-08T21:12:27.195 INFO:tasks.workunit.client.0.smithi053.stdout: 10 437 0.77 MB/sec execute 43 sec latency 2906.495 ms 2023-12-08T21:12:28.196 INFO:tasks.workunit.client.0.smithi053.stdout: 10 438 0.75 MB/sec execute 44 sec latency 3557.686 ms 2023-12-08T21:12:29.196 INFO:tasks.workunit.client.0.smithi053.stdout: 10 440 0.75 MB/sec execute 45 sec latency 3804.094 ms 2023-12-08T21:12:30.195 INFO:tasks.workunit.client.0.smithi053.stdout: 10 445 0.77 MB/sec execute 46 sec latency 3933.656 ms 2023-12-08T21:12:30.716 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:12:30.719 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:12:31.196 INFO:tasks.workunit.client.0.smithi053.stdout: 10 447 0.77 MB/sec execute 47 sec latency 2514.574 ms 2023-12-08T21:12:32.196 INFO:tasks.workunit.client.0.smithi053.stdout: 10 448 0.76 MB/sec execute 48 sec latency 2765.803 ms 2023-12-08T21:12:33.196 INFO:tasks.workunit.client.0.smithi053.stdout: 10 451 0.76 MB/sec execute 49 sec latency 3323.892 ms 2023-12-08T21:12:34.196 INFO:tasks.workunit.client.0.smithi053.stdout: 10 452 0.75 MB/sec execute 50 sec latency 4232.215 ms 2023-12-08T21:12:35.196 INFO:tasks.workunit.client.0.smithi053.stdout: 10 455 0.76 MB/sec execute 51 sec latency 4904.286 ms 2023-12-08T21:12:36.196 INFO:tasks.workunit.client.0.smithi053.stdout: 10 455 0.75 MB/sec execute 52 sec latency 4801.743 ms 2023-12-08T21:12:37.196 INFO:tasks.workunit.client.0.smithi053.stdout: 10 457 0.75 MB/sec execute 53 sec latency 5010.233 ms 2023-12-08T21:12:38.196 INFO:tasks.workunit.client.0.smithi053.stdout: 10 457 0.73 MB/sec execute 54 sec latency 5764.489 ms 2023-12-08T21:12:39.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 460 0.73 MB/sec execute 55 sec latency 6337.713 ms 2023-12-08T21:12:40.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 462 0.73 MB/sec execute 56 sec latency 6373.549 ms 2023-12-08T21:12:41.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 466 0.74 MB/sec execute 57 sec latency 4229.226 ms 2023-12-08T21:12:42.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 469 0.74 MB/sec execute 58 sec latency 2902.613 ms 2023-12-08T21:12:43.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 472 0.75 MB/sec execute 59 sec latency 3028.703 ms 2023-12-08T21:12:44.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 474 0.75 MB/sec execute 60 sec latency 3206.204 ms 2023-12-08T21:12:45.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 475 0.74 MB/sec execute 61 sec latency 3660.731 ms 2023-12-08T21:12:46.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 480 0.75 MB/sec execute 62 sec latency 3597.576 ms 2023-12-08T21:12:47.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 482 0.75 MB/sec execute 63 sec latency 2750.686 ms 2023-12-08T21:12:48.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 484 0.75 MB/sec execute 64 sec latency 2233.603 ms 2023-12-08T21:12:49.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 485 0.75 MB/sec execute 65 sec latency 3233.696 ms 2023-12-08T21:12:50.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 489 0.75 MB/sec execute 66 sec latency 3759.390 ms 2023-12-08T21:12:51.197 INFO:tasks.workunit.client.0.smithi053.stdout: 10 492 0.76 MB/sec execute 67 sec latency 3416.895 ms 2023-12-08T21:12:52.198 INFO:tasks.workunit.client.0.smithi053.stdout: 10 496 0.77 MB/sec execute 68 sec latency 2395.819 ms 2023-12-08T21:12:53.198 INFO:tasks.workunit.client.0.smithi053.stdout: 10 496 0.76 MB/sec execute 69 sec latency 3100.943 ms 2023-12-08T21:12:54.198 INFO:tasks.workunit.client.0.smithi053.stdout: 10 499 0.76 MB/sec execute 70 sec latency 3880.650 ms 2023-12-08T21:12:55.198 INFO:tasks.workunit.client.0.smithi053.stdout: 10 506 0.78 MB/sec execute 71 sec latency 3763.357 ms 2023-12-08T21:12:56.198 INFO:tasks.workunit.client.0.smithi053.stdout: 10 507 0.77 MB/sec execute 72 sec latency 4379.299 ms 2023-12-08T21:12:57.198 INFO:tasks.workunit.client.0.smithi053.stdout: 10 510 0.77 MB/sec execute 73 sec latency 5100.769 ms 2023-12-08T21:12:58.198 INFO:tasks.workunit.client.0.smithi053.stdout: 10 513 0.78 MB/sec execute 74 sec latency 3580.141 ms 2023-12-08T21:12:59.198 INFO:tasks.workunit.client.0.smithi053.stdout: 10 513 0.77 MB/sec execute 75 sec latency 3983.735 ms 2023-12-08T21:13:00.198 INFO:tasks.workunit.client.0.smithi053.stdout: 10 516 0.77 MB/sec execute 76 sec latency 4983.825 ms 2023-12-08T21:13:00.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:13:00.773 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:13:01.198 INFO:tasks.workunit.client.0.smithi053.stdout: 10 521 0.77 MB/sec execute 77 sec latency 5983.911 ms 2023-12-08T21:13:02.198 INFO:tasks.workunit.client.0.smithi053.stdout: 10 524 0.78 MB/sec execute 78 sec latency 6983.980 ms 2023-12-08T21:13:03.200 INFO:tasks.workunit.client.0.smithi053.stdout: 10 527 0.79 MB/sec execute 79 sec latency 7984.075 ms 2023-12-08T21:13:04.198 INFO:tasks.workunit.client.0.smithi053.stdout: 10 528 0.78 MB/sec execute 80 sec latency 8984.141 ms 2023-12-08T21:13:05.199 INFO:tasks.workunit.client.0.smithi053.stdout: 10 530 0.78 MB/sec execute 81 sec latency 9191.744 ms 2023-12-08T21:13:06.199 INFO:tasks.workunit.client.0.smithi053.stdout: 10 533 0.78 MB/sec execute 82 sec latency 5174.935 ms 2023-12-08T21:13:07.199 INFO:tasks.workunit.client.0.smithi053.stdout: 10 540 0.80 MB/sec execute 83 sec latency 5436.688 ms 2023-12-08T21:13:08.199 INFO:tasks.workunit.client.0.smithi053.stdout: 10 542 0.80 MB/sec execute 84 sec latency 6436.741 ms 2023-12-08T21:13:09.199 INFO:tasks.workunit.client.0.smithi053.stdout: 10 545 0.81 MB/sec execute 85 sec latency 7436.812 ms 2023-12-08T21:13:10.199 INFO:tasks.workunit.client.0.smithi053.stdout: 10 550 0.82 MB/sec execute 86 sec latency 7901.290 ms 2023-12-08T21:13:11.199 INFO:tasks.workunit.client.0.smithi053.stdout: 10 555 0.81 MB/sec execute 87 sec latency 4340.548 ms 2023-12-08T21:13:12.199 INFO:tasks.workunit.client.0.smithi053.stdout: 10 562 0.84 MB/sec execute 88 sec latency 5340.635 ms 2023-12-08T21:13:13.199 INFO:tasks.workunit.client.0.smithi053.stdout: 10 569 0.85 MB/sec execute 89 sec latency 5994.307 ms 2023-12-08T21:13:14.199 INFO:tasks.workunit.client.0.smithi053.stdout: 10 575 0.87 MB/sec execute 90 sec latency 2389.030 ms 2023-12-08T21:13:15.199 INFO:tasks.workunit.client.0.smithi053.stdout: 10 582 0.87 MB/sec execute 91 sec latency 3389.089 ms 2023-12-08T21:13:16.200 INFO:tasks.workunit.client.0.smithi053.stdout: 10 587 0.90 MB/sec execute 92 sec latency 4389.147 ms 2023-12-08T21:13:17.199 INFO:tasks.workunit.client.0.smithi053.stdout: 10 591 0.90 MB/sec execute 93 sec latency 4603.405 ms 2023-12-08T21:13:18.200 INFO:tasks.workunit.client.0.smithi053.stdout: 10 592 0.89 MB/sec execute 94 sec latency 4977.150 ms 2023-12-08T21:13:19.200 INFO:tasks.workunit.client.0.smithi053.stdout: 10 595 0.88 MB/sec execute 95 sec latency 4957.384 ms 2023-12-08T21:13:20.200 INFO:tasks.workunit.client.0.smithi053.stdout: 10 602 0.90 MB/sec execute 96 sec latency 5612.350 ms 2023-12-08T21:13:21.200 INFO:tasks.workunit.client.0.smithi053.stdout: 10 605 0.90 MB/sec execute 97 sec latency 4300.439 ms 2023-12-08T21:13:22.200 INFO:tasks.workunit.client.0.smithi053.stdout: 10 605 0.89 MB/sec execute 98 sec latency 5065.589 ms 2023-12-08T21:13:23.200 INFO:tasks.workunit.client.0.smithi053.stdout: 10 609 0.88 MB/sec execute 99 sec latency 6065.664 ms 2023-12-08T21:13:24.200 INFO:tasks.workunit.client.0.smithi053.stdout: 10 612 0.89 MB/sec execute 100 sec latency 6946.122 ms 2023-12-08T21:13:25.200 INFO:tasks.workunit.client.0.smithi053.stdout: 10 615 0.88 MB/sec execute 101 sec latency 6360.905 ms 2023-12-08T21:13:26.200 INFO:tasks.workunit.client.0.smithi053.stdout: 10 617 0.87 MB/sec execute 102 sec latency 5657.744 ms 2023-12-08T21:13:27.200 INFO:tasks.workunit.client.0.smithi053.stdout: 10 620 0.86 MB/sec execute 103 sec latency 5812.821 ms 2023-12-08T21:13:28.201 INFO:tasks.workunit.client.0.smithi053.stdout: 10 620 0.86 MB/sec execute 104 sec latency 6605.045 ms 2023-12-08T21:13:29.201 INFO:tasks.workunit.client.0.smithi053.stdout: 10 621 0.85 MB/sec execute 105 sec latency 4740.764 ms 2023-12-08T21:13:30.201 INFO:tasks.workunit.client.0.smithi053.stdout: 10 622 0.84 MB/sec execute 106 sec latency 4674.234 ms 2023-12-08T21:13:30.936 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:13:30.940 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:13:31.201 INFO:tasks.workunit.client.0.smithi053.stdout: 10 627 0.83 MB/sec execute 107 sec latency 4964.944 ms 2023-12-08T21:13:32.201 INFO:tasks.workunit.client.0.smithi053.stdout: 10 629 0.83 MB/sec execute 108 sec latency 4446.626 ms 2023-12-08T21:13:33.201 INFO:tasks.workunit.client.0.smithi053.stdout: 10 632 0.82 MB/sec execute 109 sec latency 4198.584 ms 2023-12-08T21:13:34.201 INFO:tasks.workunit.client.0.smithi053.stdout: 10 635 0.81 MB/sec execute 110 sec latency 4594.033 ms 2023-12-08T21:13:35.201 INFO:tasks.workunit.client.0.smithi053.stdout: 10 638 0.81 MB/sec execute 111 sec latency 4249.977 ms 2023-12-08T21:13:36.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 639 0.80 MB/sec execute 112 sec latency 4539.772 ms 2023-12-08T21:13:37.201 INFO:tasks.workunit.client.0.smithi053.stdout: 10 642 0.79 MB/sec execute 113 sec latency 4589.981 ms 2023-12-08T21:13:38.201 INFO:tasks.workunit.client.0.smithi053.stdout: 10 643 0.78 MB/sec execute 114 sec latency 4111.751 ms 2023-12-08T21:13:39.201 INFO:tasks.workunit.client.0.smithi053.stdout: 10 644 0.78 MB/sec execute 115 sec latency 5095.555 ms 2023-12-08T21:13:40.201 INFO:tasks.workunit.client.0.smithi053.stdout: 10 647 0.77 MB/sec execute 116 sec latency 4754.711 ms 2023-12-08T21:13:41.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 648 0.77 MB/sec execute 117 sec latency 5633.158 ms 2023-12-08T21:13:42.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 649 0.76 MB/sec execute 118 sec latency 5788.725 ms 2023-12-08T21:13:43.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 649 0.75 MB/sec execute 119 sec latency 6450.904 ms 2023-12-08T21:13:44.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 650 0.75 MB/sec execute 120 sec latency 7373.807 ms 2023-12-08T21:13:45.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 651 0.74 MB/sec execute 121 sec latency 6726.190 ms 2023-12-08T21:13:46.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 652 0.74 MB/sec execute 122 sec latency 5744.993 ms 2023-12-08T21:13:47.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 654 0.73 MB/sec execute 123 sec latency 6386.987 ms 2023-12-08T21:13:48.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 655 0.72 MB/sec execute 124 sec latency 3877.070 ms 2023-12-08T21:13:49.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 656 0.72 MB/sec execute 125 sec latency 4877.142 ms 2023-12-08T21:13:50.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 657 0.71 MB/sec execute 126 sec latency 5877.214 ms 2023-12-08T21:13:51.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 659 0.71 MB/sec execute 127 sec latency 6036.078 ms 2023-12-08T21:13:52.202 INFO:tasks.workunit.client.0.smithi053.stdout: 10 660 0.70 MB/sec execute 128 sec latency 5973.676 ms 2023-12-08T21:13:53.203 INFO:tasks.workunit.client.0.smithi053.stdout: 10 660 0.70 MB/sec execute 129 sec latency 6318.437 ms 2023-12-08T21:13:54.203 INFO:tasks.workunit.client.0.smithi053.stdout: 10 661 0.69 MB/sec execute 130 sec latency 6580.834 ms 2023-12-08T21:13:55.203 INFO:tasks.workunit.client.0.smithi053.stdout: 10 662 0.69 MB/sec execute 131 sec latency 5168.223 ms 2023-12-08T21:13:56.203 INFO:tasks.workunit.client.0.smithi053.stdout: 10 664 0.68 MB/sec execute 132 sec latency 5558.801 ms 2023-12-08T21:13:57.203 INFO:tasks.workunit.client.0.smithi053.stdout: 10 667 0.68 MB/sec execute 133 sec latency 5944.990 ms 2023-12-08T21:13:58.203 INFO:tasks.workunit.client.0.smithi053.stdout: 10 669 0.67 MB/sec execute 134 sec latency 4694.411 ms 2023-12-08T21:13:59.203 INFO:tasks.workunit.client.0.smithi053.stdout: 10 672 0.67 MB/sec execute 135 sec latency 5526.739 ms 2023-12-08T21:14:00.203 INFO:tasks.workunit.client.0.smithi053.stdout: 10 676 0.67 MB/sec execute 136 sec latency 3679.107 ms 2023-12-08T21:14:01.022 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:14:01.026 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:14:01.203 INFO:tasks.workunit.client.0.smithi053.stdout: 10 677 0.66 MB/sec execute 137 sec latency 4679.196 ms 2023-12-08T21:14:02.203 INFO:tasks.workunit.client.0.smithi053.stdout: 10 679 0.66 MB/sec execute 138 sec latency 5679.292 ms 2023-12-08T21:14:03.203 INFO:tasks.workunit.client.0.smithi053.stdout: 10 679 0.65 MB/sec execute 139 sec latency 5868.151 ms 2023-12-08T21:14:04.203 INFO:tasks.workunit.client.0.smithi053.stdout: 10 681 0.65 MB/sec execute 140 sec latency 6016.548 ms 2023-12-08T21:14:05.204 INFO:tasks.workunit.client.0.smithi053.stdout: 10 684 0.64 MB/sec execute 141 sec latency 5380.322 ms 2023-12-08T21:14:06.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 687 0.64 MB/sec execute 142 sec latency 5189.022 ms 2023-12-08T21:14:07.204 INFO:tasks.workunit.client.0.smithi053.stdout: 10 688 0.64 MB/sec execute 143 sec latency 5349.283 ms 2023-12-08T21:14:08.204 INFO:tasks.workunit.client.0.smithi053.stdout: 10 690 0.63 MB/sec execute 144 sec latency 5518.425 ms 2023-12-08T21:14:09.204 INFO:tasks.workunit.client.0.smithi053.stdout: 10 692 0.63 MB/sec execute 145 sec latency 3997.889 ms 2023-12-08T21:14:10.204 INFO:tasks.workunit.client.0.smithi053.stdout: 10 693 0.62 MB/sec execute 146 sec latency 4997.988 ms 2023-12-08T21:14:11.204 INFO:tasks.workunit.client.0.smithi053.stdout: 10 694 0.62 MB/sec execute 147 sec latency 5762.973 ms 2023-12-08T21:14:12.204 INFO:tasks.workunit.client.0.smithi053.stdout: 10 697 0.61 MB/sec execute 148 sec latency 5939.964 ms 2023-12-08T21:14:13.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 701 0.61 MB/sec execute 149 sec latency 3268.425 ms 2023-12-08T21:14:14.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 703 0.61 MB/sec execute 150 sec latency 4268.479 ms 2023-12-08T21:14:15.204 INFO:tasks.workunit.client.0.smithi053.stdout: 10 707 0.60 MB/sec execute 151 sec latency 4965.493 ms 2023-12-08T21:14:16.204 INFO:tasks.workunit.client.0.smithi053.stdout: 10 710 0.60 MB/sec execute 152 sec latency 4806.121 ms 2023-12-08T21:14:17.204 INFO:tasks.workunit.client.0.smithi053.stdout: 10 713 0.60 MB/sec execute 153 sec latency 5590.840 ms 2023-12-08T21:14:18.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 713 0.59 MB/sec execute 154 sec latency 6590.927 ms 2023-12-08T21:14:19.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 715 0.59 MB/sec execute 155 sec latency 6716.622 ms 2023-12-08T21:14:20.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 716 0.59 MB/sec execute 156 sec latency 4958.701 ms 2023-12-08T21:14:21.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 717 0.58 MB/sec execute 157 sec latency 5958.780 ms 2023-12-08T21:14:22.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 719 0.58 MB/sec execute 158 sec latency 6958.835 ms 2023-12-08T21:14:23.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 721 0.58 MB/sec execute 159 sec latency 7868.555 ms 2023-12-08T21:14:24.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 727 0.57 MB/sec execute 160 sec latency 5551.745 ms 2023-12-08T21:14:25.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 728 0.57 MB/sec execute 161 sec latency 6551.798 ms 2023-12-08T21:14:26.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 731 0.57 MB/sec execute 162 sec latency 7302.879 ms 2023-12-08T21:14:27.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 733 0.56 MB/sec execute 163 sec latency 7292.391 ms 2023-12-08T21:14:28.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 736 0.56 MB/sec execute 164 sec latency 8292.488 ms 2023-12-08T21:14:29.205 INFO:tasks.workunit.client.0.smithi053.stdout: 10 739 0.56 MB/sec execute 165 sec latency 8672.477 ms 2023-12-08T21:14:30.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 740 0.55 MB/sec execute 166 sec latency 4184.083 ms 2023-12-08T21:14:31.154 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:14:31.156 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:14:31.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 742 0.55 MB/sec execute 167 sec latency 5184.134 ms 2023-12-08T21:14:32.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 743 0.55 MB/sec execute 168 sec latency 6184.215 ms 2023-12-08T21:14:33.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 745 0.55 MB/sec execute 169 sec latency 6668.125 ms 2023-12-08T21:14:34.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 746 0.54 MB/sec execute 170 sec latency 5541.908 ms 2023-12-08T21:14:35.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 748 0.54 MB/sec execute 171 sec latency 6541.985 ms 2023-12-08T21:14:36.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 750 0.54 MB/sec execute 172 sec latency 7372.825 ms 2023-12-08T21:14:37.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 753 0.53 MB/sec execute 173 sec latency 8013.032 ms 2023-12-08T21:14:38.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 756 0.53 MB/sec execute 174 sec latency 7546.602 ms 2023-12-08T21:14:39.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 758 0.53 MB/sec execute 175 sec latency 7457.280 ms 2023-12-08T21:14:40.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 758 0.52 MB/sec execute 176 sec latency 4065.517 ms 2023-12-08T21:14:41.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 758 0.52 MB/sec execute 177 sec latency 5027.424 ms 2023-12-08T21:14:42.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 760 0.52 MB/sec execute 178 sec latency 4802.917 ms 2023-12-08T21:14:43.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 760 0.52 MB/sec execute 179 sec latency 5708.229 ms 2023-12-08T21:14:44.206 INFO:tasks.workunit.client.0.smithi053.stdout: 10 764 0.51 MB/sec execute 180 sec latency 5658.005 ms 2023-12-08T21:14:45.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 769 0.51 MB/sec execute 181 sec latency 5601.579 ms 2023-12-08T21:14:46.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 773 0.51 MB/sec execute 182 sec latency 4719.628 ms 2023-12-08T21:14:47.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 777 0.51 MB/sec execute 183 sec latency 2770.787 ms 2023-12-08T21:14:48.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 779 0.50 MB/sec execute 184 sec latency 3770.846 ms 2023-12-08T21:14:49.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 782 0.50 MB/sec execute 185 sec latency 4117.267 ms 2023-12-08T21:14:50.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 785 0.50 MB/sec execute 186 sec latency 1955.944 ms 2023-12-08T21:14:51.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 787 0.50 MB/sec execute 187 sec latency 2746.437 ms 2023-12-08T21:14:52.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 788 0.49 MB/sec execute 188 sec latency 3746.530 ms 2023-12-08T21:14:53.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 788 0.49 MB/sec execute 189 sec latency 4746.592 ms 2023-12-08T21:14:54.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 789 0.49 MB/sec execute 190 sec latency 5746.670 ms 2023-12-08T21:14:55.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 790 0.49 MB/sec execute 191 sec latency 6746.759 ms 2023-12-08T21:14:56.207 INFO:tasks.workunit.client.0.smithi053.stdout: 10 793 0.49 MB/sec execute 192 sec latency 7446.545 ms 2023-12-08T21:14:57.208 INFO:tasks.workunit.client.0.smithi053.stdout: 10 796 0.48 MB/sec execute 193 sec latency 6972.312 ms 2023-12-08T21:14:58.208 INFO:tasks.workunit.client.0.smithi053.stdout: 10 800 0.48 MB/sec execute 194 sec latency 6707.897 ms 2023-12-08T21:14:59.208 INFO:tasks.workunit.client.0.smithi053.stdout: 10 801 0.48 MB/sec execute 195 sec latency 3300.504 ms 2023-12-08T21:15:00.208 INFO:tasks.workunit.client.0.smithi053.stdout: 10 803 0.48 MB/sec execute 196 sec latency 4300.575 ms 2023-12-08T21:15:01.208 INFO:tasks.workunit.client.0.smithi053.stdout: 10 805 0.48 MB/sec execute 197 sec latency 5300.651 ms 2023-12-08T21:15:01.283 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:15:01.286 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:15:02.208 INFO:tasks.workunit.client.0.smithi053.stdout: 10 808 0.47 MB/sec execute 198 sec latency 6300.737 ms 2023-12-08T21:15:03.208 INFO:tasks.workunit.client.0.smithi053.stdout: 10 811 0.47 MB/sec execute 199 sec latency 6405.046 ms 2023-12-08T21:15:04.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 812 0.47 MB/sec execute 200 sec latency 6476.488 ms 2023-12-08T21:15:05.208 INFO:tasks.workunit.client.0.smithi053.stdout: 10 816 0.47 MB/sec execute 201 sec latency 5572.408 ms 2023-12-08T21:15:06.208 INFO:tasks.workunit.client.0.smithi053.stdout: 10 817 0.46 MB/sec execute 202 sec latency 6317.922 ms 2023-12-08T21:15:07.208 INFO:tasks.workunit.client.0.smithi053.stdout: 10 817 0.46 MB/sec execute 203 sec latency 5735.415 ms 2023-12-08T21:15:08.208 INFO:tasks.workunit.client.0.smithi053.stdout: 10 817 0.46 MB/sec execute 204 sec latency 4609.141 ms 2023-12-08T21:15:09.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 817 0.46 MB/sec execute 205 sec latency 5609.206 ms 2023-12-08T21:15:10.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 817 0.46 MB/sec execute 206 sec latency 6504.099 ms 2023-12-08T21:15:11.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 818 0.45 MB/sec execute 207 sec latency 6245.584 ms 2023-12-08T21:15:12.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 819 0.45 MB/sec execute 208 sec latency 5685.484 ms 2023-12-08T21:15:13.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 819 0.45 MB/sec execute 209 sec latency 3130.864 ms 2023-12-08T21:15:14.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 820 0.45 MB/sec execute 210 sec latency 4130.954 ms 2023-12-08T21:15:15.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 820 0.44 MB/sec execute 211 sec latency 5036.312 ms 2023-12-08T21:15:16.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 822 0.44 MB/sec execute 212 sec latency 4958.204 ms 2023-12-08T21:15:17.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 827 0.44 MB/sec execute 213 sec latency 3628.217 ms 2023-12-08T21:15:18.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 830 0.44 MB/sec execute 214 sec latency 3818.763 ms 2023-12-08T21:15:19.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 830 0.44 MB/sec execute 215 sec latency 2254.914 ms 2023-12-08T21:15:20.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 830 0.44 MB/sec execute 216 sec latency 3255.003 ms 2023-12-08T21:15:21.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 831 0.43 MB/sec execute 217 sec latency 4034.010 ms 2023-12-08T21:15:22.209 INFO:tasks.workunit.client.0.smithi053.stdout: 10 833 0.43 MB/sec execute 218 sec latency 4110.801 ms 2023-12-08T21:15:23.210 INFO:tasks.workunit.client.0.smithi053.stdout: 10 838 0.43 MB/sec execute 219 sec latency 3629.067 ms 2023-12-08T21:15:24.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 839 0.43 MB/sec execute 220 sec latency 3243.321 ms 2023-12-08T21:15:25.210 INFO:tasks.workunit.client.0.smithi053.stdout: 10 840 0.43 MB/sec execute 221 sec latency 4243.385 ms 2023-12-08T21:15:26.210 INFO:tasks.workunit.client.0.smithi053.stdout: 10 843 0.43 MB/sec execute 222 sec latency 4506.321 ms 2023-12-08T21:15:27.210 INFO:tasks.workunit.client.0.smithi053.stdout: 10 848 0.42 MB/sec execute 223 sec latency 4913.298 ms 2023-12-08T21:15:28.210 INFO:tasks.workunit.client.0.smithi053.stdout: 10 852 0.42 MB/sec execute 224 sec latency 5021.014 ms 2023-12-08T21:15:29.210 INFO:tasks.workunit.client.0.smithi053.stdout: 10 857 0.42 MB/sec execute 225 sec latency 2629.732 ms 2023-12-08T21:15:30.210 INFO:tasks.workunit.client.0.smithi053.stdout: 10 857 0.42 MB/sec execute 226 sec latency 3629.826 ms 2023-12-08T21:15:31.210 INFO:tasks.workunit.client.0.smithi053.stdout: 10 858 0.42 MB/sec execute 227 sec latency 4221.798 ms 2023-12-08T21:15:31.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:15:31.349 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:15:32.210 INFO:tasks.workunit.client.0.smithi053.stdout: 10 859 0.42 MB/sec execute 228 sec latency 4493.715 ms 2023-12-08T21:15:33.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 860 0.41 MB/sec execute 229 sec latency 5080.545 ms 2023-12-08T21:15:34.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 860 0.41 MB/sec execute 230 sec latency 5223.058 ms 2023-12-08T21:15:35.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 861 0.41 MB/sec execute 231 sec latency 5857.106 ms 2023-12-08T21:15:36.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 862 0.41 MB/sec execute 232 sec latency 5646.606 ms 2023-12-08T21:15:37.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 862 0.41 MB/sec execute 233 sec latency 5614.647 ms 2023-12-08T21:15:38.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 864 0.41 MB/sec execute 234 sec latency 6563.699 ms 2023-12-08T21:15:39.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 866 0.40 MB/sec execute 235 sec latency 6413.725 ms 2023-12-08T21:15:40.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 867 0.40 MB/sec execute 236 sec latency 7334.104 ms 2023-12-08T21:15:41.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 868 0.40 MB/sec execute 237 sec latency 7330.901 ms 2023-12-08T21:15:42.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 869 0.40 MB/sec execute 238 sec latency 5460.383 ms 2023-12-08T21:15:43.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 871 0.40 MB/sec execute 239 sec latency 5622.306 ms 2023-12-08T21:15:44.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 872 0.40 MB/sec execute 240 sec latency 4422.530 ms 2023-12-08T21:15:45.211 INFO:tasks.workunit.client.0.smithi053.stdout: 10 872 0.39 MB/sec execute 241 sec latency 5422.616 ms 2023-12-08T21:15:46.212 INFO:tasks.workunit.client.0.smithi053.stdout: 10 873 0.39 MB/sec execute 242 sec latency 6318.003 ms 2023-12-08T21:15:47.212 INFO:tasks.workunit.client.0.smithi053.stdout: 10 876 0.39 MB/sec execute 243 sec latency 5456.401 ms 2023-12-08T21:15:48.212 INFO:tasks.workunit.client.0.smithi053.stdout: 10 877 0.39 MB/sec execute 244 sec latency 6456.469 ms 2023-12-08T21:15:49.212 INFO:tasks.workunit.client.0.smithi053.stdout: 10 879 0.39 MB/sec execute 245 sec latency 7261.153 ms 2023-12-08T21:15:50.212 INFO:tasks.workunit.client.0.smithi053.stdout: 10 880 0.39 MB/sec execute 246 sec latency 7173.602 ms 2023-12-08T21:15:51.212 INFO:tasks.workunit.client.0.smithi053.stdout: 10 880 0.39 MB/sec execute 247 sec latency 8173.672 ms 2023-12-08T21:15:52.212 INFO:tasks.workunit.client.0.smithi053.stdout: 10 881 0.38 MB/sec execute 248 sec latency 8436.867 ms 2023-12-08T21:15:53.212 INFO:tasks.workunit.client.0.smithi053.stdout: 10 882 0.38 MB/sec execute 249 sec latency 3923.582 ms 2023-12-08T21:15:54.212 INFO:tasks.workunit.client.0.smithi053.stdout: 10 882 0.38 MB/sec execute 250 sec latency 4923.676 ms 2023-12-08T21:15:55.212 INFO:tasks.workunit.client.0.smithi053.stdout: 10 884 0.38 MB/sec execute 251 sec latency 5923.769 ms 2023-12-08T21:15:56.212 INFO:tasks.workunit.client.0.smithi053.stdout: 10 889 0.38 MB/sec execute 252 sec latency 6096.118 ms 2023-12-08T21:15:57.212 INFO:tasks.workunit.client.0.smithi053.stdout: 10 893 0.38 MB/sec execute 253 sec latency 4984.361 ms 2023-12-08T21:15:58.213 INFO:tasks.workunit.client.0.smithi053.stdout: 10 895 0.38 MB/sec execute 254 sec latency 3272.219 ms 2023-12-08T21:15:59.213 INFO:tasks.workunit.client.0.smithi053.stdout: 10 897 0.38 MB/sec execute 255 sec latency 4261.467 ms 2023-12-08T21:16:00.213 INFO:tasks.workunit.client.0.smithi053.stdout: 10 898 0.37 MB/sec execute 256 sec latency 2724.804 ms 2023-12-08T21:16:01.213 INFO:tasks.workunit.client.0.smithi053.stdout: 10 900 0.37 MB/sec execute 257 sec latency 3535.285 ms 2023-12-08T21:16:01.461 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:16:01.464 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:16:02.213 INFO:tasks.workunit.client.0.smithi053.stdout: 10 900 0.37 MB/sec execute 258 sec latency 4535.353 ms 2023-12-08T21:16:03.213 INFO:tasks.workunit.client.0.smithi053.stdout: 10 901 0.37 MB/sec execute 259 sec latency 5112.312 ms 2023-12-08T21:16:04.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 904 0.37 MB/sec execute 260 sec latency 5016.713 ms 2023-12-08T21:16:05.213 INFO:tasks.workunit.client.0.smithi053.stdout: 10 907 0.37 MB/sec execute 261 sec latency 4709.212 ms 2023-12-08T21:16:06.213 INFO:tasks.workunit.client.0.smithi053.stdout: 10 907 0.37 MB/sec execute 262 sec latency 5709.286 ms 2023-12-08T21:16:07.213 INFO:tasks.workunit.client.0.smithi053.stdout: 10 910 0.37 MB/sec execute 263 sec latency 6435.456 ms 2023-12-08T21:16:08.213 INFO:tasks.workunit.client.0.smithi053.stdout: 10 912 0.36 MB/sec execute 264 sec latency 5547.599 ms 2023-12-08T21:16:09.213 INFO:tasks.workunit.client.0.smithi053.stdout: 10 914 0.36 MB/sec execute 265 sec latency 5790.400 ms 2023-12-08T21:16:10.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 915 0.36 MB/sec execute 266 sec latency 6790.491 ms 2023-12-08T21:16:11.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 915 0.36 MB/sec execute 267 sec latency 7588.879 ms 2023-12-08T21:16:12.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 917 0.36 MB/sec execute 268 sec latency 5274.302 ms 2023-12-08T21:16:13.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 918 0.36 MB/sec execute 269 sec latency 6274.398 ms 2023-12-08T21:16:14.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 919 0.36 MB/sec execute 270 sec latency 7274.461 ms 2023-12-08T21:16:15.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 921 0.36 MB/sec execute 271 sec latency 8090.343 ms 2023-12-08T21:16:16.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 924 0.36 MB/sec execute 272 sec latency 6654.104 ms 2023-12-08T21:16:17.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 925 0.35 MB/sec execute 273 sec latency 5922.519 ms 2023-12-08T21:16:18.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 927 0.35 MB/sec execute 274 sec latency 6165.780 ms 2023-12-08T21:16:19.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 928 0.35 MB/sec execute 275 sec latency 3953.103 ms 2023-12-08T21:16:20.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 929 0.35 MB/sec execute 276 sec latency 4575.104 ms 2023-12-08T21:16:21.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 929 0.35 MB/sec execute 277 sec latency 5277.749 ms 2023-12-08T21:16:22.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 930 0.35 MB/sec execute 278 sec latency 5072.618 ms 2023-12-08T21:16:23.214 INFO:tasks.workunit.client.0.smithi053.stdout: 10 930 0.35 MB/sec execute 279 sec latency 5089.397 ms 2023-12-08T21:16:24.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 932 0.35 MB/sec execute 280 sec latency 5655.239 ms 2023-12-08T21:16:25.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 932 0.34 MB/sec execute 281 sec latency 4809.827 ms 2023-12-08T21:16:26.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 934 0.34 MB/sec execute 282 sec latency 4658.097 ms 2023-12-08T21:16:27.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 934 0.34 MB/sec execute 283 sec latency 5049.710 ms 2023-12-08T21:16:28.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 934 0.34 MB/sec execute 284 sec latency 4011.249 ms 2023-12-08T21:16:29.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 935 0.34 MB/sec execute 285 sec latency 4945.063 ms 2023-12-08T21:16:30.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 936 0.34 MB/sec execute 286 sec latency 5098.064 ms 2023-12-08T21:16:31.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 937 0.34 MB/sec execute 287 sec latency 4491.598 ms 2023-12-08T21:16:31.574 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:16:31.576 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:16:32.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 938 0.34 MB/sec execute 288 sec latency 4705.622 ms 2023-12-08T21:16:33.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 939 0.33 MB/sec execute 289 sec latency 4865.183 ms 2023-12-08T21:16:34.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 941 0.33 MB/sec execute 290 sec latency 4350.067 ms 2023-12-08T21:16:35.215 INFO:tasks.workunit.client.0.smithi053.stdout: 10 942 0.33 MB/sec execute 291 sec latency 4699.396 ms 2023-12-08T21:16:36.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 943 0.33 MB/sec execute 292 sec latency 3928.780 ms 2023-12-08T21:16:37.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 944 0.33 MB/sec execute 293 sec latency 4413.321 ms 2023-12-08T21:16:38.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 945 0.33 MB/sec execute 294 sec latency 5034.328 ms 2023-12-08T21:16:39.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 947 0.33 MB/sec execute 295 sec latency 4701.918 ms 2023-12-08T21:16:40.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 950 0.33 MB/sec execute 296 sec latency 4606.070 ms 2023-12-08T21:16:41.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 952 0.33 MB/sec execute 297 sec latency 3694.421 ms 2023-12-08T21:16:42.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 955 0.33 MB/sec execute 298 sec latency 3917.380 ms 2023-12-08T21:16:43.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 957 0.33 MB/sec execute 299 sec latency 4440.483 ms 2023-12-08T21:16:44.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 958 0.33 MB/sec execute 300 sec latency 3879.753 ms 2023-12-08T21:16:45.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 958 0.33 MB/sec execute 301 sec latency 4879.851 ms 2023-12-08T21:16:46.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 961 0.32 MB/sec execute 302 sec latency 5613.177 ms 2023-12-08T21:16:47.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 962 0.32 MB/sec execute 303 sec latency 5460.583 ms 2023-12-08T21:16:48.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 966 0.32 MB/sec execute 304 sec latency 5769.236 ms 2023-12-08T21:16:49.216 INFO:tasks.workunit.client.0.smithi053.stdout: 10 968 0.32 MB/sec execute 305 sec latency 5824.384 ms 2023-12-08T21:16:50.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 971 0.32 MB/sec execute 306 sec latency 4703.401 ms 2023-12-08T21:16:51.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 973 0.32 MB/sec execute 307 sec latency 2255.855 ms 2023-12-08T21:16:52.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 975 0.32 MB/sec execute 308 sec latency 3255.955 ms 2023-12-08T21:16:53.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 976 0.32 MB/sec execute 309 sec latency 4256.049 ms 2023-12-08T21:16:54.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 978 0.32 MB/sec execute 310 sec latency 5234.029 ms 2023-12-08T21:16:55.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 982 0.32 MB/sec execute 311 sec latency 5325.467 ms 2023-12-08T21:16:56.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 984 0.32 MB/sec execute 312 sec latency 5984.254 ms 2023-12-08T21:16:57.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 987 0.32 MB/sec execute 313 sec latency 5721.548 ms 2023-12-08T21:16:58.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 989 0.32 MB/sec execute 314 sec latency 1984.936 ms 2023-12-08T21:16:59.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 993 0.32 MB/sec execute 315 sec latency 1927.677 ms 2023-12-08T21:17:00.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 996 0.32 MB/sec execute 316 sec latency 2749.681 ms 2023-12-08T21:17:01.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 997 0.32 MB/sec execute 317 sec latency 2683.267 ms 2023-12-08T21:17:01.771 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:17:01.775 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:17:02.217 INFO:tasks.workunit.client.0.smithi053.stdout: 10 998 0.32 MB/sec execute 318 sec latency 3683.348 ms 2023-12-08T21:17:03.218 INFO:tasks.workunit.client.0.smithi053.stdout: 10 999 0.32 MB/sec execute 319 sec latency 4683.447 ms 2023-12-08T21:17:04.218 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1001 0.32 MB/sec execute 320 sec latency 5683.499 ms 2023-12-08T21:17:05.218 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1003 0.31 MB/sec execute 321 sec latency 6683.566 ms 2023-12-08T21:17:06.218 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1004 0.31 MB/sec execute 322 sec latency 7683.646 ms 2023-12-08T21:17:07.218 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1006 0.31 MB/sec execute 323 sec latency 7958.856 ms 2023-12-08T21:17:08.218 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1008 0.31 MB/sec execute 324 sec latency 7035.812 ms 2023-12-08T21:17:09.218 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1011 0.31 MB/sec execute 325 sec latency 6327.735 ms 2023-12-08T21:17:10.218 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1016 0.32 MB/sec execute 326 sec latency 6604.243 ms 2023-12-08T21:17:11.218 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1019 0.32 MB/sec execute 327 sec latency 6641.226 ms 2023-12-08T21:17:12.218 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1021 0.32 MB/sec execute 328 sec latency 5584.666 ms 2023-12-08T21:17:13.220 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1023 0.32 MB/sec execute 329 sec latency 5339.999 ms 2023-12-08T21:17:14.218 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1026 0.32 MB/sec execute 330 sec latency 4325.215 ms 2023-12-08T21:17:15.218 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1028 0.32 MB/sec execute 331 sec latency 4743.378 ms 2023-12-08T21:17:16.219 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1031 0.32 MB/sec execute 332 sec latency 5743.445 ms 2023-12-08T21:17:17.219 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1032 0.32 MB/sec execute 333 sec latency 6250.046 ms 2023-12-08T21:17:18.219 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1033 0.32 MB/sec execute 334 sec latency 5554.849 ms 2023-12-08T21:17:19.219 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1034 0.32 MB/sec execute 335 sec latency 6527.670 ms 2023-12-08T21:17:20.219 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1035 0.32 MB/sec execute 336 sec latency 5958.224 ms 2023-12-08T21:17:21.219 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1035 0.32 MB/sec execute 337 sec latency 6112.619 ms 2023-12-08T21:17:22.219 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1037 0.32 MB/sec execute 338 sec latency 5460.714 ms 2023-12-08T21:17:23.222 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1038 0.32 MB/sec execute 339 sec latency 6103.126 ms 2023-12-08T21:17:24.219 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1039 0.32 MB/sec execute 340 sec latency 4632.273 ms 2023-12-08T21:17:25.219 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1039 0.32 MB/sec execute 341 sec latency 5212.526 ms 2023-12-08T21:17:26.219 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1041 0.32 MB/sec execute 342 sec latency 5605.105 ms 2023-12-08T21:17:27.219 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1042 0.31 MB/sec execute 343 sec latency 4276.870 ms 2023-12-08T21:17:28.220 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1045 0.31 MB/sec execute 344 sec latency 5276.937 ms 2023-12-08T21:17:29.220 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1047 0.31 MB/sec execute 345 sec latency 5399.830 ms 2023-12-08T21:17:30.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1047 0.31 MB/sec execute 346 sec latency 4209.660 ms 2023-12-08T21:17:31.220 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1049 0.31 MB/sec execute 347 sec latency 5209.745 ms 2023-12-08T21:17:31.817 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:17:31.820 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:17:32.220 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1051 0.31 MB/sec execute 348 sec latency 5418.886 ms 2023-12-08T21:17:33.220 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1052 0.31 MB/sec execute 349 sec latency 4882.780 ms 2023-12-08T21:17:34.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1052 0.31 MB/sec execute 350 sec latency 5825.752 ms 2023-12-08T21:17:35.220 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1052 0.31 MB/sec execute 351 sec latency 5808.672 ms 2023-12-08T21:17:36.220 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1052 0.31 MB/sec execute 352 sec latency 5027.563 ms 2023-12-08T21:17:37.220 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1055 0.31 MB/sec execute 353 sec latency 5481.302 ms 2023-12-08T21:17:38.220 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1057 0.30 MB/sec execute 354 sec latency 5425.534 ms 2023-12-08T21:17:39.220 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1057 0.30 MB/sec execute 355 sec latency 5282.194 ms 2023-12-08T21:17:40.220 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1058 0.30 MB/sec execute 356 sec latency 5752.091 ms 2023-12-08T21:17:41.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1058 0.30 MB/sec execute 357 sec latency 4310.313 ms 2023-12-08T21:17:42.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1058 0.30 MB/sec execute 358 sec latency 5310.412 ms 2023-12-08T21:17:42.730 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:24:11.523 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:17:42.751 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:24:11.544 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:17:42.873 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:24:11.594 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:17:42.878 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:24:11.600 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:17:42.902 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:24:11.623 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:17:42.946 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:24:11.667 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:17:43.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1061 0.30 MB/sec execute 359 sec latency 5483.583 ms 2023-12-08T21:17:43.566 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:24:12.287 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:17:43.571 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:24:12.293 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:17:43.593 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:24:12.387 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:17:44.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1061 0.30 MB/sec execute 360 sec latency 4411.305 ms 2023-12-08T21:17:45.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1064 0.30 MB/sec execute 361 sec latency 4863.354 ms 2023-12-08T21:17:46.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1065 0.30 MB/sec execute 362 sec latency 3697.868 ms 2023-12-08T21:17:47.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1068 0.30 MB/sec execute 363 sec latency 4671.331 ms 2023-12-08T21:17:48.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1069 0.30 MB/sec execute 364 sec latency 4676.183 ms 2023-12-08T21:17:49.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1070 0.30 MB/sec execute 365 sec latency 4598.979 ms 2023-12-08T21:17:50.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1071 0.30 MB/sec execute 366 sec latency 4995.449 ms 2023-12-08T21:17:51.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1075 0.29 MB/sec execute 367 sec latency 4945.280 ms 2023-12-08T21:17:52.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1078 0.29 MB/sec execute 368 sec latency 5762.299 ms 2023-12-08T21:17:53.221 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1080 0.29 MB/sec execute 369 sec latency 1817.377 ms 2023-12-08T21:17:54.222 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1081 0.29 MB/sec execute 370 sec latency 2379.235 ms 2023-12-08T21:17:55.222 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1081 0.29 MB/sec execute 371 sec latency 2872.456 ms 2023-12-08T21:17:56.222 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1084 0.29 MB/sec execute 372 sec latency 2723.472 ms 2023-12-08T21:17:57.222 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1086 0.29 MB/sec execute 373 sec latency 3703.950 ms 2023-12-08T21:17:58.222 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1087 0.29 MB/sec execute 374 sec latency 4704.035 ms 2023-12-08T21:17:59.222 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1091 0.29 MB/sec execute 375 sec latency 5487.883 ms 2023-12-08T21:18:00.222 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1093 0.29 MB/sec execute 376 sec latency 5143.178 ms 2023-12-08T21:18:01.222 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1097 0.29 MB/sec execute 377 sec latency 4673.728 ms 2023-12-08T21:18:01.864 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:18:01.868 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:18:02.222 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1099 0.29 MB/sec execute 378 sec latency 1915.262 ms 2023-12-08T21:18:03.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1101 0.29 MB/sec execute 379 sec latency 2915.360 ms 2023-12-08T21:18:04.222 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1103 0.29 MB/sec execute 380 sec latency 3915.411 ms 2023-12-08T21:18:05.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1103 0.28 MB/sec execute 381 sec latency 4870.064 ms 2023-12-08T21:18:06.222 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1104 0.28 MB/sec execute 382 sec latency 5720.178 ms 2023-12-08T21:18:07.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1107 0.28 MB/sec execute 383 sec latency 5115.440 ms 2023-12-08T21:18:08.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1108 0.28 MB/sec execute 384 sec latency 6115.507 ms 2023-12-08T21:18:09.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1109 0.28 MB/sec execute 385 sec latency 6350.867 ms 2023-12-08T21:18:10.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1111 0.28 MB/sec execute 386 sec latency 5926.845 ms 2023-12-08T21:18:11.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1115 0.28 MB/sec execute 387 sec latency 5940.484 ms 2023-12-08T21:18:12.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1116 0.28 MB/sec execute 388 sec latency 4766.230 ms 2023-12-08T21:18:13.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1117 0.28 MB/sec execute 389 sec latency 5766.309 ms 2023-12-08T21:18:14.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1118 0.28 MB/sec execute 390 sec latency 5902.567 ms 2023-12-08T21:18:15.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1121 0.28 MB/sec execute 391 sec latency 4581.286 ms 2023-12-08T21:18:16.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1121 0.28 MB/sec execute 392 sec latency 5581.359 ms 2023-12-08T21:18:17.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1123 0.28 MB/sec execute 393 sec latency 6082.248 ms 2023-12-08T21:18:18.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1124 0.28 MB/sec execute 394 sec latency 5992.854 ms 2023-12-08T21:18:19.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1128 0.28 MB/sec execute 395 sec latency 5822.660 ms 2023-12-08T21:18:20.223 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1130 0.27 MB/sec execute 396 sec latency 4166.427 ms 2023-12-08T21:18:21.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1131 0.27 MB/sec execute 397 sec latency 5166.484 ms 2023-12-08T21:18:22.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1133 0.27 MB/sec execute 398 sec latency 5603.295 ms 2023-12-08T21:18:23.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1133 0.27 MB/sec execute 399 sec latency 5401.408 ms 2023-12-08T21:18:24.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1134 0.27 MB/sec execute 400 sec latency 4361.059 ms 2023-12-08T21:18:25.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1138 0.27 MB/sec execute 401 sec latency 5361.149 ms 2023-12-08T21:18:26.050 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:24:54.844 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:18:26.087 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:24:54.881 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:18:26.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1138 0.27 MB/sec execute 402 sec latency 6162.284 ms 2023-12-08T21:18:26.239 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:24:54.960 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:18:26.242 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:24:54.964 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:18:26.248 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:24:54.970 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:18:26.265 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:24:54.986 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:18:26.280 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:24:55.070 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:18:26.382 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:24:55.103 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:18:26.419 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:24:55.141 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:18:27.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1140 0.27 MB/sec execute 403 sec latency 5938.395 ms 2023-12-08T21:18:28.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1142 0.27 MB/sec execute 404 sec latency 2559.116 ms 2023-12-08T21:18:29.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1144 0.27 MB/sec execute 405 sec latency 3155.626 ms 2023-12-08T21:18:30.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1146 0.27 MB/sec execute 406 sec latency 2773.702 ms 2023-12-08T21:18:31.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1149 0.27 MB/sec execute 407 sec latency 2699.333 ms 2023-12-08T21:18:32.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:18:32.134 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:18:32.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1151 0.27 MB/sec execute 408 sec latency 3699.416 ms 2023-12-08T21:18:33.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1153 0.27 MB/sec execute 409 sec latency 4403.881 ms 2023-12-08T21:18:34.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1155 0.27 MB/sec execute 410 sec latency 4496.544 ms 2023-12-08T21:18:35.224 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1157 0.27 MB/sec execute 411 sec latency 3914.478 ms 2023-12-08T21:18:36.225 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1158 0.26 MB/sec execute 412 sec latency 4914.564 ms 2023-12-08T21:18:37.225 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1159 0.26 MB/sec execute 413 sec latency 5132.992 ms 2023-12-08T21:18:38.225 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1161 0.26 MB/sec execute 414 sec latency 4925.377 ms 2023-12-08T21:18:39.225 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1163 0.26 MB/sec execute 415 sec latency 5275.127 ms 2023-12-08T21:18:40.225 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1163 0.26 MB/sec execute 416 sec latency 3864.832 ms 2023-12-08T21:18:41.225 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1164 0.26 MB/sec execute 417 sec latency 4864.890 ms 2023-12-08T21:18:42.225 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1167 0.26 MB/sec execute 418 sec latency 5864.952 ms 2023-12-08T21:18:43.225 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1169 0.26 MB/sec execute 419 sec latency 6133.537 ms 2023-12-08T21:18:44.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1169 0.26 MB/sec execute 420 sec latency 2982.029 ms 2023-12-08T21:18:45.225 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1171 0.26 MB/sec execute 421 sec latency 3982.109 ms 2023-12-08T21:18:46.225 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1172 0.26 MB/sec execute 422 sec latency 4553.467 ms 2023-12-08T21:18:47.225 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1172 0.26 MB/sec execute 423 sec latency 4790.905 ms 2023-12-08T21:18:48.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1173 0.26 MB/sec execute 424 sec latency 5614.732 ms 2023-12-08T21:18:49.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1174 0.26 MB/sec execute 425 sec latency 5976.456 ms 2023-12-08T21:18:50.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1175 0.26 MB/sec execute 426 sec latency 3212.232 ms 2023-12-08T21:18:51.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1176 0.26 MB/sec execute 427 sec latency 4212.316 ms 2023-12-08T21:18:52.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1178 0.26 MB/sec execute 428 sec latency 4983.044 ms 2023-12-08T21:18:53.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1178 0.25 MB/sec execute 429 sec latency 4718.697 ms 2023-12-08T21:18:54.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1180 0.25 MB/sec execute 430 sec latency 5106.428 ms 2023-12-08T21:18:55.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1181 0.25 MB/sec execute 431 sec latency 3560.509 ms 2023-12-08T21:18:56.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1181 0.25 MB/sec execute 432 sec latency 4560.584 ms 2023-12-08T21:18:57.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1182 0.25 MB/sec execute 433 sec latency 5527.612 ms 2023-12-08T21:18:58.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1184 0.25 MB/sec execute 434 sec latency 5332.053 ms 2023-12-08T21:18:59.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1186 0.25 MB/sec execute 435 sec latency 5612.735 ms 2023-12-08T21:19:00.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1188 0.25 MB/sec execute 436 sec latency 6612.790 ms 2023-12-08T21:19:01.226 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1189 0.25 MB/sec execute 437 sec latency 6674.352 ms 2023-12-08T21:19:02.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:19:02.184 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:19:02.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1191 0.25 MB/sec execute 438 sec latency 5033.380 ms 2023-12-08T21:19:03.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1194 0.25 MB/sec execute 439 sec latency 5299.522 ms 2023-12-08T21:19:04.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1196 0.25 MB/sec execute 440 sec latency 3940.622 ms 2023-12-08T21:19:05.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1196 0.25 MB/sec execute 441 sec latency 4563.140 ms 2023-12-08T21:19:06.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1197 0.25 MB/sec execute 442 sec latency 4393.888 ms 2023-12-08T21:19:07.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1198 0.25 MB/sec execute 443 sec latency 5393.999 ms 2023-12-08T21:19:08.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1198 0.25 MB/sec execute 444 sec latency 5924.063 ms 2023-12-08T21:19:09.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1200 0.25 MB/sec execute 445 sec latency 5927.869 ms 2023-12-08T21:19:10.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1204 0.25 MB/sec execute 446 sec latency 5939.647 ms 2023-12-08T21:19:11.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1204 0.24 MB/sec execute 447 sec latency 6098.913 ms 2023-12-08T21:19:12.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1207 0.24 MB/sec execute 448 sec latency 5156.246 ms 2023-12-08T21:19:13.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1210 0.24 MB/sec execute 449 sec latency 1389.937 ms 2023-12-08T21:19:14.227 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1212 0.24 MB/sec execute 450 sec latency 1824.152 ms 2023-12-08T21:19:15.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1215 0.24 MB/sec execute 451 sec latency 2600.591 ms 2023-12-08T21:19:16.228 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1218 0.24 MB/sec execute 452 sec latency 3600.640 ms 2023-12-08T21:19:17.228 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1220 0.24 MB/sec execute 453 sec latency 4600.703 ms 2023-12-08T21:19:18.228 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1222 0.24 MB/sec execute 454 sec latency 5600.783 ms 2023-12-08T21:19:19.228 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1224 0.24 MB/sec execute 455 sec latency 6600.879 ms 2023-12-08T21:19:20.228 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1226 0.24 MB/sec execute 456 sec latency 6773.052 ms 2023-12-08T21:19:21.228 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1229 0.24 MB/sec execute 457 sec latency 5607.781 ms 2023-12-08T21:19:22.228 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1230 0.24 MB/sec execute 458 sec latency 6395.136 ms 2023-12-08T21:19:23.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1233 0.24 MB/sec execute 459 sec latency 5808.387 ms 2023-12-08T21:19:24.228 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1234 0.24 MB/sec execute 460 sec latency 5915.750 ms 2023-12-08T21:19:25.228 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1235 0.24 MB/sec execute 461 sec latency 4496.090 ms 2023-12-08T21:19:26.228 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1237 0.24 MB/sec execute 462 sec latency 5496.189 ms 2023-12-08T21:19:27.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1237 0.24 MB/sec execute 463 sec latency 6496.285 ms 2023-12-08T21:19:28.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1238 0.24 MB/sec execute 464 sec latency 7009.695 ms 2023-12-08T21:19:29.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1240 0.24 MB/sec execute 465 sec latency 6217.909 ms 2023-12-08T21:19:30.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1241 0.24 MB/sec execute 466 sec latency 6632.595 ms 2023-12-08T21:19:31.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1243 0.24 MB/sec execute 467 sec latency 7028.841 ms 2023-12-08T21:19:32.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1246 0.23 MB/sec execute 468 sec latency 7476.489 ms 2023-12-08T21:19:32.338 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:19:32.342 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:19:33.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1248 0.23 MB/sec execute 469 sec latency 6397.564 ms 2023-12-08T21:19:34.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1249 0.23 MB/sec execute 470 sec latency 5753.786 ms 2023-12-08T21:19:35.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1251 0.23 MB/sec execute 471 sec latency 4604.122 ms 2023-12-08T21:19:36.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1254 0.23 MB/sec execute 472 sec latency 5604.169 ms 2023-12-08T21:19:37.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1255 0.23 MB/sec execute 473 sec latency 6426.580 ms 2023-12-08T21:19:38.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1258 0.23 MB/sec execute 474 sec latency 3721.394 ms 2023-12-08T21:19:39.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1259 0.23 MB/sec execute 475 sec latency 4721.473 ms 2023-12-08T21:19:40.229 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1261 0.23 MB/sec execute 476 sec latency 5721.577 ms 2023-12-08T21:19:41.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1263 0.23 MB/sec execute 477 sec latency 6690.832 ms 2023-12-08T21:19:42.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1263 0.23 MB/sec execute 478 sec latency 7461.482 ms 2023-12-08T21:19:43.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1267 0.23 MB/sec execute 479 sec latency 7984.370 ms 2023-12-08T21:19:44.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1275 0.24 MB/sec execute 480 sec latency 6362.872 ms 2023-12-08T21:19:45.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1283 0.24 MB/sec execute 481 sec latency 5622.953 ms 2023-12-08T21:19:46.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1285 0.24 MB/sec execute 482 sec latency 6623.007 ms 2023-12-08T21:19:47.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1286 0.24 MB/sec execute 483 sec latency 7623.066 ms 2023-12-08T21:19:48.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1288 0.24 MB/sec execute 484 sec latency 7988.291 ms 2023-12-08T21:19:49.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1289 0.24 MB/sec execute 485 sec latency 5939.336 ms 2023-12-08T21:19:50.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1291 0.24 MB/sec execute 486 sec latency 5997.887 ms 2023-12-08T21:19:51.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1292 0.24 MB/sec execute 487 sec latency 5776.294 ms 2023-12-08T21:19:52.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1293 0.24 MB/sec execute 488 sec latency 4586.783 ms 2023-12-08T21:19:52.490 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:26:21.282 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:19:52.498 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:26:21.292 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:19:52.679 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:26:21.400 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:19:52.689 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:26:21.411 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:19:52.694 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:26:21.416 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:19:52.707 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:26:21.429 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:19:52.714 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:26:21.508 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:19:52.871 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:26:21.593 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:19:52.883 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:26:21.604 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:19:53.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1293 0.24 MB/sec execute 489 sec latency 5586.855 ms 2023-12-08T21:19:54.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1294 0.24 MB/sec execute 490 sec latency 6303.515 ms 2023-12-08T21:19:55.231 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1298 0.24 MB/sec execute 491 sec latency 6019.944 ms 2023-12-08T21:19:56.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1298 0.24 MB/sec execute 492 sec latency 5687.373 ms 2023-12-08T21:19:57.230 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1299 0.24 MB/sec execute 493 sec latency 6687.432 ms 2023-12-08T21:19:58.231 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1299 0.23 MB/sec execute 494 sec latency 7073.170 ms 2023-12-08T21:19:59.231 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1300 0.23 MB/sec execute 495 sec latency 6140.851 ms 2023-12-08T21:20:00.231 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1301 0.23 MB/sec execute 496 sec latency 5912.316 ms 2023-12-08T21:20:01.231 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1302 0.23 MB/sec execute 497 sec latency 6001.435 ms 2023-12-08T21:20:02.231 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1310 0.24 MB/sec execute 498 sec latency 6585.263 ms 2023-12-08T21:20:02.428 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:20:02.431 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:20:03.231 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1310 0.24 MB/sec execute 499 sec latency 5196.736 ms 2023-12-08T21:20:04.231 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1311 0.24 MB/sec execute 500 sec latency 4435.417 ms 2023-12-08T21:20:05.231 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1312 0.24 MB/sec execute 501 sec latency 4795.290 ms 2023-12-08T21:20:06.231 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1314 0.24 MB/sec execute 502 sec latency 4334.245 ms 2023-12-08T21:20:07.231 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1330 0.25 MB/sec execute 503 sec latency 4713.153 ms 2023-12-08T21:20:08.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1331 0.25 MB/sec execute 504 sec latency 5436.140 ms 2023-12-08T21:20:09.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1331 0.25 MB/sec execute 505 sec latency 4760.503 ms 2023-12-08T21:20:10.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1332 0.25 MB/sec execute 506 sec latency 5422.923 ms 2023-12-08T21:20:11.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1333 0.25 MB/sec execute 507 sec latency 5870.331 ms 2023-12-08T21:20:12.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1338 0.25 MB/sec execute 508 sec latency 4144.342 ms 2023-12-08T21:20:13.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1353 0.26 MB/sec execute 509 sec latency 4586.601 ms 2023-12-08T21:20:14.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1362 0.26 MB/sec execute 510 sec latency 3291.548 ms 2023-12-08T21:20:15.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1362 0.26 MB/sec execute 511 sec latency 4291.648 ms 2023-12-08T21:20:16.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1363 0.26 MB/sec execute 512 sec latency 5084.975 ms 2023-12-08T21:20:17.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1371 0.27 MB/sec execute 513 sec latency 4871.334 ms 2023-12-08T21:20:18.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1372 0.26 MB/sec execute 514 sec latency 5342.412 ms 2023-12-08T21:20:19.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1377 0.27 MB/sec execute 515 sec latency 5149.056 ms 2023-12-08T21:20:20.232 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1383 0.27 MB/sec execute 516 sec latency 5163.914 ms 2023-12-08T21:20:21.233 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1385 0.27 MB/sec execute 517 sec latency 5451.721 ms 2023-12-08T21:20:22.233 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1385 0.27 MB/sec execute 518 sec latency 4842.742 ms 2023-12-08T21:20:23.233 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1386 0.27 MB/sec execute 519 sec latency 5060.241 ms 2023-12-08T21:20:24.233 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1387 0.27 MB/sec execute 520 sec latency 4942.706 ms 2023-12-08T21:20:25.233 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1388 0.27 MB/sec execute 521 sec latency 5225.610 ms 2023-12-08T21:20:26.233 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1389 0.27 MB/sec execute 522 sec latency 4339.998 ms 2023-12-08T21:20:27.233 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1389 0.27 MB/sec execute 523 sec latency 4965.808 ms 2023-12-08T21:20:28.233 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1390 0.27 MB/sec execute 524 sec latency 4140.781 ms 2023-12-08T21:20:29.233 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1391 0.26 MB/sec execute 525 sec latency 5140.860 ms 2023-12-08T21:20:30.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1392 0.26 MB/sec execute 526 sec latency 5293.919 ms 2023-12-08T21:20:31.233 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1395 0.26 MB/sec execute 527 sec latency 4014.748 ms 2023-12-08T21:20:32.233 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1396 0.26 MB/sec execute 528 sec latency 5014.825 ms 2023-12-08T21:20:32.490 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:20:32.494 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:20:33.233 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1397 0.26 MB/sec execute 529 sec latency 5070.793 ms 2023-12-08T21:20:34.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1398 0.26 MB/sec execute 530 sec latency 4987.918 ms 2023-12-08T21:20:35.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1399 0.26 MB/sec execute 531 sec latency 4614.633 ms 2023-12-08T21:20:36.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1399 0.26 MB/sec execute 532 sec latency 4657.010 ms 2023-12-08T21:20:37.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1402 0.26 MB/sec execute 533 sec latency 4762.583 ms 2023-12-08T21:20:38.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1404 0.26 MB/sec execute 534 sec latency 5463.349 ms 2023-12-08T21:20:39.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1405 0.26 MB/sec execute 535 sec latency 4995.805 ms 2023-12-08T21:20:40.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1406 0.26 MB/sec execute 536 sec latency 5368.065 ms 2023-12-08T21:20:41.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1408 0.26 MB/sec execute 537 sec latency 4952.363 ms 2023-12-08T21:20:42.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1409 0.26 MB/sec execute 538 sec latency 3353.666 ms 2023-12-08T21:20:43.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1411 0.26 MB/sec execute 539 sec latency 3989.070 ms 2023-12-08T21:20:44.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1413 0.26 MB/sec execute 540 sec latency 3687.216 ms 2023-12-08T21:20:45.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1415 0.26 MB/sec execute 541 sec latency 4687.266 ms 2023-12-08T21:20:46.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1415 0.26 MB/sec execute 542 sec latency 5687.327 ms 2023-12-08T21:20:47.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1416 0.26 MB/sec execute 543 sec latency 6251.212 ms 2023-12-08T21:20:48.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1418 0.26 MB/sec execute 544 sec latency 6102.760 ms 2023-12-08T21:20:49.234 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1419 0.26 MB/sec execute 545 sec latency 6287.637 ms 2023-12-08T21:20:50.235 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1421 0.25 MB/sec execute 546 sec latency 5307.743 ms 2023-12-08T21:20:51.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1423 0.25 MB/sec execute 547 sec latency 3410.940 ms 2023-12-08T21:20:52.235 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1424 0.25 MB/sec execute 548 sec latency 4410.989 ms 2023-12-08T21:20:53.235 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1425 0.25 MB/sec execute 549 sec latency 5411.084 ms 2023-12-08T21:20:54.235 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1428 0.25 MB/sec execute 550 sec latency 5705.575 ms 2023-12-08T21:20:55.235 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1430 0.25 MB/sec execute 551 sec latency 5602.387 ms 2023-12-08T21:20:56.235 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1431 0.25 MB/sec execute 552 sec latency 5479.912 ms 2023-12-08T21:20:57.235 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1435 0.25 MB/sec execute 553 sec latency 5634.911 ms 2023-12-08T21:20:58.235 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1437 0.25 MB/sec execute 554 sec latency 3502.963 ms 2023-12-08T21:20:59.235 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1439 0.25 MB/sec execute 555 sec latency 4503.013 ms 2023-12-08T21:21:00.235 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1441 0.25 MB/sec execute 556 sec latency 4995.638 ms 2023-12-08T21:21:01.235 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1441 0.25 MB/sec execute 557 sec latency 4042.589 ms 2023-12-08T21:21:02.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1441 0.25 MB/sec execute 558 sec latency 5042.675 ms 2023-12-08T21:21:02.629 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:21:02.641 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:21:03.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1442 0.25 MB/sec execute 559 sec latency 6042.767 ms 2023-12-08T21:21:04.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1445 0.25 MB/sec execute 560 sec latency 6833.340 ms 2023-12-08T21:21:05.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1447 0.25 MB/sec execute 561 sec latency 6691.310 ms 2023-12-08T21:21:06.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1448 0.25 MB/sec execute 562 sec latency 6823.522 ms 2023-12-08T21:21:07.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1448 0.25 MB/sec execute 563 sec latency 7041.229 ms 2023-12-08T21:21:08.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1450 0.25 MB/sec execute 564 sec latency 7885.735 ms 2023-12-08T21:21:09.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1451 0.25 MB/sec execute 565 sec latency 2289.099 ms 2023-12-08T21:21:10.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1453 0.25 MB/sec execute 566 sec latency 3289.170 ms 2023-12-08T21:21:10.718 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:27:39.512 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:21:10.730 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:27:39.524 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:21:10.862 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:27:39.584 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:21:10.881 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:27:39.603 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:21:11.008 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:27:39.802 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:21:11.028 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:27:39.749 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:21:11.042 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:27:39.764 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:21:11.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1455 0.25 MB/sec execute 567 sec latency 4289.226 ms 2023-12-08T21:21:11.242 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:27:39.964 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:21:11.289 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:27:40.011 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:21:12.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1456 0.25 MB/sec execute 568 sec latency 5289.315 ms 2023-12-08T21:21:13.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1457 0.24 MB/sec execute 569 sec latency 6122.446 ms 2023-12-08T21:21:14.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1459 0.24 MB/sec execute 570 sec latency 6158.316 ms 2023-12-08T21:21:15.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1461 0.24 MB/sec execute 571 sec latency 6710.304 ms 2023-12-08T21:21:16.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1463 0.24 MB/sec execute 572 sec latency 6758.862 ms 2023-12-08T21:21:17.236 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1464 0.24 MB/sec execute 573 sec latency 3790.626 ms 2023-12-08T21:21:18.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1465 0.24 MB/sec execute 574 sec latency 4790.725 ms 2023-12-08T21:21:19.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1466 0.24 MB/sec execute 575 sec latency 5003.762 ms 2023-12-08T21:21:20.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1467 0.24 MB/sec execute 576 sec latency 3919.148 ms 2023-12-08T21:21:21.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1468 0.24 MB/sec execute 577 sec latency 4919.235 ms 2023-12-08T21:21:22.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1468 0.24 MB/sec execute 578 sec latency 5919.290 ms 2023-12-08T21:21:23.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1470 0.24 MB/sec execute 579 sec latency 6562.476 ms 2023-12-08T21:21:24.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1471 0.24 MB/sec execute 580 sec latency 6613.264 ms 2023-12-08T21:21:25.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1473 0.24 MB/sec execute 581 sec latency 6919.759 ms 2023-12-08T21:21:26.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1476 0.24 MB/sec execute 582 sec latency 1171.750 ms 2023-12-08T21:21:27.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1478 0.24 MB/sec execute 583 sec latency 1479.357 ms 2023-12-08T21:21:28.237 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1480 0.24 MB/sec execute 584 sec latency 1766.406 ms 2023-12-08T21:21:29.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1480 0.24 MB/sec execute 585 sec latency 1794.958 ms 2023-12-08T21:21:30.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1481 0.24 MB/sec execute 586 sec latency 2795.035 ms 2023-12-08T21:21:31.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1481 0.24 MB/sec execute 587 sec latency 3795.103 ms 2023-12-08T21:21:32.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1482 0.24 MB/sec execute 588 sec latency 4795.181 ms 2023-12-08T21:21:32.702 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:21:32.704 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:21:33.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1483 0.24 MB/sec execute 589 sec latency 5618.806 ms 2023-12-08T21:21:34.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1486 0.24 MB/sec execute 590 sec latency 5647.310 ms 2023-12-08T21:21:35.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1488 0.24 MB/sec execute 591 sec latency 2112.717 ms 2023-12-08T21:21:36.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1490 0.24 MB/sec execute 592 sec latency 3112.805 ms 2023-12-08T21:21:37.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1492 0.24 MB/sec execute 593 sec latency 4112.868 ms 2023-12-08T21:21:38.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1493 0.23 MB/sec execute 594 sec latency 4172.607 ms 2023-12-08T21:21:39.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1495 0.23 MB/sec execute 595 sec latency 3926.597 ms 2023-12-08T21:21:40.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1497 0.23 MB/sec execute 596 sec latency 3652.156 ms 2023-12-08T21:21:41.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1499 0.23 MB/sec execute 597 sec latency 4331.223 ms 2023-12-08T21:21:42.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1500 0.23 MB/sec execute 598 sec latency 4847.593 ms 2023-12-08T21:21:43.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1501 0.23 MB/sec execute 599 sec latency 5009.964 ms 2023-12-08T21:21:44.238 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 600 sec 2023-12-08T21:21:45.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 601 sec 2023-12-08T21:21:46.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 602 sec 2023-12-08T21:21:47.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 603 sec 2023-12-08T21:21:48.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 604 sec 2023-12-08T21:21:49.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 605 sec 2023-12-08T21:21:50.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 606 sec 2023-12-08T21:21:51.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 607 sec 2023-12-08T21:21:52.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 608 sec 2023-12-08T21:21:53.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 609 sec 2023-12-08T21:21:54.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 610 sec 2023-12-08T21:21:55.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 611 sec 2023-12-08T21:21:56.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 612 sec 2023-12-08T21:21:57.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 613 sec 2023-12-08T21:21:58.240 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 614 sec 2023-12-08T21:21:59.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 615 sec 2023-12-08T21:22:00.239 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 616 sec 2023-12-08T21:22:01.240 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 617 sec 2023-12-08T21:22:02.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 618 sec 2023-12-08T21:22:02.831 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:22:02.834 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:22:03.240 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 619 sec 2023-12-08T21:22:04.240 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 620 sec 2023-12-08T21:22:05.240 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 621 sec 2023-12-08T21:22:06.240 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 622 sec 2023-12-08T21:22:07.240 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 623 sec 2023-12-08T21:22:08.240 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 624 sec 2023-12-08T21:22:09.240 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 625 sec 2023-12-08T21:22:10.240 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 626 sec 2023-12-08T21:22:11.240 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 627 sec 2023-12-08T21:22:12.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 628 sec 2023-12-08T21:22:13.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 629 sec 2023-12-08T21:22:14.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 630 sec 2023-12-08T21:22:15.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 631 sec 2023-12-08T21:22:16.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 632 sec 2023-12-08T21:22:17.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 633 sec 2023-12-08T21:22:18.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 634 sec 2023-12-08T21:22:19.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 635 sec 2023-12-08T21:22:20.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 636 sec 2023-12-08T21:22:21.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 637 sec 2023-12-08T21:22:22.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 638 sec 2023-12-08T21:22:23.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 639 sec 2023-12-08T21:22:24.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 640 sec 2023-12-08T21:22:25.241 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 641 sec 2023-12-08T21:22:26.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 642 sec 2023-12-08T21:22:27.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 643 sec 2023-12-08T21:22:28.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 644 sec 2023-12-08T21:22:29.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 645 sec 2023-12-08T21:22:30.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 646 sec 2023-12-08T21:22:31.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 647 sec 2023-12-08T21:22:32.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 648 sec 2023-12-08T21:22:32.962 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:22:32.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:22:33.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 649 sec 2023-12-08T21:22:34.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 650 sec 2023-12-08T21:22:35.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 651 sec 2023-12-08T21:22:36.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 652 sec 2023-12-08T21:22:37.242 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 653 sec 2023-12-08T21:22:38.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 654 sec 2023-12-08T21:22:39.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 655 sec 2023-12-08T21:22:40.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 656 sec 2023-12-08T21:22:41.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 657 sec 2023-12-08T21:22:42.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 658 sec 2023-12-08T21:22:43.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 659 sec 2023-12-08T21:22:44.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 660 sec 2023-12-08T21:22:45.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 661 sec 2023-12-08T21:22:46.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 662 sec 2023-12-08T21:22:47.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 663 sec 2023-12-08T21:22:48.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 664 sec 2023-12-08T21:22:49.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 665 sec 2023-12-08T21:22:50.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 666 sec 2023-12-08T21:22:51.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 667 sec 2023-12-08T21:22:52.243 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 668 sec 2023-12-08T21:22:53.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 669 sec 2023-12-08T21:22:54.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 670 sec 2023-12-08T21:22:55.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 671 sec 2023-12-08T21:22:56.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 672 sec 2023-12-08T21:22:57.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 673 sec 2023-12-08T21:22:58.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 674 sec 2023-12-08T21:22:59.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 675 sec 2023-12-08T21:23:00.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 676 sec 2023-12-08T21:23:01.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 677 sec 2023-12-08T21:23:02.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 678 sec 2023-12-08T21:23:03.016 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:23:03.019 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:23:03.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 679 sec 2023-12-08T21:23:04.245 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 680 sec 2023-12-08T21:23:05.244 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 681 sec 2023-12-08T21:23:06.245 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 682 sec 2023-12-08T21:23:07.245 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 683 sec 2023-12-08T21:23:08.245 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 684 sec 2023-12-08T21:23:09.245 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 685 sec 2023-12-08T21:23:10.245 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 686 sec 2023-12-08T21:23:11.245 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 687 sec 2023-12-08T21:23:12.245 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 688 sec 2023-12-08T21:23:13.245 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 689 sec 2023-12-08T21:23:14.245 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 690 sec 2023-12-08T21:23:15.245 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 691 sec 2023-12-08T21:23:16.245 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 692 sec 2023-12-08T21:23:17.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 693 sec 2023-12-08T21:23:18.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 694 sec 2023-12-08T21:23:19.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 695 sec 2023-12-08T21:23:20.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 696 sec 2023-12-08T21:23:21.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 697 sec 2023-12-08T21:23:22.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 698 sec 2023-12-08T21:23:23.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 699 sec 2023-12-08T21:23:24.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 700 sec 2023-12-08T21:23:25.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 701 sec 2023-12-08T21:23:26.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 702 sec 2023-12-08T21:23:27.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 703 sec 2023-12-08T21:23:28.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 704 sec 2023-12-08T21:23:29.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 705 sec 2023-12-08T21:23:30.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 706 sec 2023-12-08T21:23:31.246 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 707 sec 2023-12-08T21:23:32.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 708 sec 2023-12-08T21:23:33.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:23:33.133 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:23:33.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 709 sec 2023-12-08T21:23:34.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 710 sec 2023-12-08T21:23:35.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 711 sec 2023-12-08T21:23:36.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 712 sec 2023-12-08T21:23:37.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 713 sec 2023-12-08T21:23:38.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 714 sec 2023-12-08T21:23:39.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 715 sec 2023-12-08T21:23:40.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 716 sec 2023-12-08T21:23:41.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 717 sec 2023-12-08T21:23:42.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 718 sec 2023-12-08T21:23:43.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 719 sec 2023-12-08T21:23:44.247 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 720 sec 2023-12-08T21:23:45.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 721 sec 2023-12-08T21:23:46.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 722 sec 2023-12-08T21:23:47.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 723 sec 2023-12-08T21:23:48.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 724 sec 2023-12-08T21:23:49.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 725 sec 2023-12-08T21:23:50.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 726 sec 2023-12-08T21:23:51.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 727 sec 2023-12-08T21:23:52.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 728 sec 2023-12-08T21:23:53.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 729 sec 2023-12-08T21:23:54.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 730 sec 2023-12-08T21:23:55.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 731 sec 2023-12-08T21:23:56.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 732 sec 2023-12-08T21:23:57.248 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 733 sec 2023-12-08T21:23:58.249 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 734 sec 2023-12-08T21:23:59.249 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 735 sec 2023-12-08T21:24:00.249 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 736 sec 2023-12-08T21:24:01.249 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 737 sec 2023-12-08T21:24:02.249 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 738 sec 2023-12-08T21:24:03.169 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:24:03.172 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:24:03.249 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 739 sec 2023-12-08T21:24:04.249 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 740 sec 2023-12-08T21:24:05.249 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 741 sec 2023-12-08T21:24:06.249 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 742 sec 2023-12-08T21:24:07.249 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 743 sec 2023-12-08T21:24:08.249 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 744 sec 2023-12-08T21:24:09.249 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 745 sec 2023-12-08T21:24:10.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 746 sec 2023-12-08T21:24:11.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 747 sec 2023-12-08T21:24:12.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 748 sec 2023-12-08T21:24:13.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 749 sec 2023-12-08T21:24:14.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 750 sec 2023-12-08T21:24:15.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 751 sec 2023-12-08T21:24:16.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 752 sec 2023-12-08T21:24:17.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 753 sec 2023-12-08T21:24:18.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 754 sec 2023-12-08T21:24:19.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 755 sec 2023-12-08T21:24:20.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 756 sec 2023-12-08T21:24:21.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 757 sec 2023-12-08T21:24:22.250 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 758 sec 2023-12-08T21:24:23.251 INFO:tasks.workunit.client.0.smithi053.stdout: 9 cleanup 759 sec 2023-12-08T21:24:24.251 INFO:tasks.workunit.client.0.smithi053.stdout: 7 cleanup 760 sec 2023-12-08T21:24:25.251 INFO:tasks.workunit.client.0.smithi053.stdout: 5 cleanup 761 sec 2023-12-08T21:24:26.251 INFO:tasks.workunit.client.0.smithi053.stdout: 4 cleanup 762 sec 2023-12-08T21:24:27.251 INFO:tasks.workunit.client.0.smithi053.stdout: 4 cleanup 763 sec 2023-12-08T21:24:28.251 INFO:tasks.workunit.client.0.smithi053.stdout: 4 cleanup 764 sec 2023-12-08T21:24:29.251 INFO:tasks.workunit.client.0.smithi053.stdout: 2 cleanup 765 sec 2023-12-08T21:24:30.251 INFO:tasks.workunit.client.0.smithi053.stdout: 2 cleanup 766 sec 2023-12-08T21:24:30.850 INFO:tasks.workunit.client.0.smithi053.stdout: 0 cleanup 767 sec 2023-12-08T21:24:30.850 INFO:tasks.workunit.client.0.smithi053.stdout: 2023-12-08T21:24:30.850 INFO:tasks.workunit.client.0.smithi053.stdout: Operation Count AvgLat MaxLat 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: ---------------------------------------- 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: NTCreateX 1692 1097.686 6373.535 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: Close 1489 7.886 98.960 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: Rename 100 1995.195 3498.973 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: Unlink 194 709.367 2002.614 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: Qpathinfo 1168 528.985 3700.736 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: Qfileinfo 603 25.249 187.761 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: Qfsinfo 330 134.686 1974.681 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: Sfileinfo 340 153.277 417.423 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: Find 519 5455.276 9191.733 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: WriteX 2674 41.197 774.379 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: ReadX 2324 0.284 36.860 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: Flush 250 614.569 1943.058 2023-12-08T21:24:30.851 INFO:tasks.workunit.client.0.smithi053.stdout: 2023-12-08T21:24:30.852 INFO:tasks.workunit.client.0.smithi053.stdout:Throughput 0.232936 MB/sec 10 clients 10 procs max_latency=9191.744 ms 2023-12-08T21:24:30.853 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-08T21:24:30.853 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-08T21:24:33.299 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:24:33.302 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:24:39.040 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:31:07.835 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:24:39.131 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:31:07.853 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:24:39.187 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:31:07.982 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:24:39.225 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:31:07.947 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:24:39.226 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:31:07.948 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:24:39.231 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:31:07.953 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:24:39.512 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:31:08.234 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:24:39.532 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:31:08.255 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:24:39.580 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:31:08.375 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:25:03.371 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:25:03.374 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:25:27.046 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-12-08T21:25:27.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-08T21:25:27.354 DEBUG:teuthology.parallel:result is None 2023-12-08T21:25:27.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-08T21:25:27.748 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-08T21:25:27.749 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-08T21:25:27.758 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-08T21:25:27.758 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T21:25:27.758 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T21:25:27.764 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T21:25:27.765 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T21:25:27.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T21:25:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.987+0000 7fb352065640 1 Processor -- start 2023-12-08T21:25:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.987+0000 7fb352065640 1 -- start start 2023-12-08T21:25:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.987+0000 7fb352065640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb34c0c4ab0 0x7fb34c0c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.987+0000 7fb352065640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb34c0c2450 0x7fb34c155a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.987+0000 7fb352065640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb34c155fb0 0x7fb34c060fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.987+0000 7fb352065640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c0c3f80 con 0x7fb34c0c2450 2023-12-08T21:25:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.987+0000 7fb352065640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c0c2a50 con 0x7fb34c155fb0 2023-12-08T21:25:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.987+0000 7fb352065640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0c79e0 con 0x7fb34c0c4ab0 2023-12-08T21:25:27.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.991+0000 7fb34affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb34c0c2450 0x7fb34c155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:27.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.991+0000 7fb34affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb34c0c2450 0x7fb34c155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47562/0 (socket says 172.21.15.53:47562) 2023-12-08T21:25:27.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.991+0000 7fb34affd640 1 -- 172.21.15.53:0/636252239 learned_addr learned my addr 172.21.15.53:0/636252239 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:27.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.991+0000 7fb34b7fe640 1 --2- 172.21.15.53:0/636252239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb34c0c4ab0 0x7fb34c0c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:27.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.991+0000 7fb34bfff640 1 --2- 172.21.15.53:0/636252239 >> v2:172.21.15.146:3300/0 conn(0x7fb34c155fb0 0x7fb34c060fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:27.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.991+0000 7fb34affd640 1 -- 172.21.15.53:0/636252239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb34c0c4ab0 msgr2=0x7fb34c0c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:27.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.991+0000 7fb34affd640 1 --2- 172.21.15.53:0/636252239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb34c0c4ab0 0x7fb34c0c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:27.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.991+0000 7fb34affd640 1 -- 172.21.15.53:0/636252239 >> v2:172.21.15.146:3300/0 conn(0x7fb34c155fb0 msgr2=0x7fb34c060fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:27.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.991+0000 7fb34affd640 1 --2- 172.21.15.53:0/636252239 >> v2:172.21.15.146:3300/0 conn(0x7fb34c155fb0 0x7fb34c060fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:27.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.991+0000 7fb34affd640 1 -- 172.21.15.53:0/636252239 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c0c7740 con 0x7fb34c0c2450 2023-12-08T21:25:28.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:27.999+0000 7fb34affd640 1 --2- 172.21.15.53:0/636252239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb34c0c2450 0x7fb34c155a70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0701c0 tx=0x7fb34001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c01512424ef218 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:28.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb34a7fc640 1 -- 172.21.15.53:0/636252239 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400ab600 con 0x7fb34c0c2450 2023-12-08T21:25:28.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb34a7fc640 1 -- 172.21.15.53:0/636252239 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3400a7050 con 0x7fb34c0c2450 2023-12-08T21:25:28.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb34a7fc640 1 -- 172.21.15.53:0/636252239 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400ab980 con 0x7fb34c0c2450 2023-12-08T21:25:28.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 -- 172.21.15.53:0/636252239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb34c0c2450 msgr2=0x7fb34c155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:28.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 --2- 172.21.15.53:0/636252239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb34c0c2450 0x7fb34c155a70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0701c0 tx=0x7fb34001c210 comp rx=0 tx=0).stop 2023-12-08T21:25:28.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 -- 172.21.15.53:0/636252239 shutdown_connections 2023-12-08T21:25:28.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 --2- 172.21.15.53:0/636252239 >> v2:172.21.15.146:3300/0 conn(0x7fb34c155fb0 0x7fb34c060fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 --2- 172.21.15.53:0/636252239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb34c0c2450 0x7fb34c155a70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 --2- 172.21.15.53:0/636252239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb34c0c4ab0 0x7fb34c0c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 -- 172.21.15.53:0/636252239 >> 172.21.15.53:0/636252239 conn(0x7fb34c0cbb50 msgr2=0x7fb34c06f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 -- 172.21.15.53:0/636252239 shutdown_connections 2023-12-08T21:25:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 -- 172.21.15.53:0/636252239 wait complete. 2023-12-08T21:25:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 Processor -- start 2023-12-08T21:25:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 -- start start 2023-12-08T21:25:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb34c0c2450 0x7fb34c14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb34c0c4ab0 0x7fb34c13c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb34c155fb0 0x7fb34c140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c13c550 con 0x7fb34c155fb0 2023-12-08T21:25:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c14b9f0 con 0x7fb34c0c2450 2023-12-08T21:25:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.003+0000 7fb352065640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c14b100 con 0x7fb34c0c4ab0 2023-12-08T21:25:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.007+0000 7fb34bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb34c155fb0 0x7fb34c140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.007+0000 7fb34bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb34c155fb0 0x7fb34c140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47566/0 (socket says 172.21.15.53:47566) 2023-12-08T21:25:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.007+0000 7fb34bfff640 1 -- 172.21.15.53:0/1005949590 learned_addr learned my addr 172.21.15.53:0/1005949590 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:28.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.007+0000 7fb34affd640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb34c0c4ab0 0x7fb34c13c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:28.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.007+0000 7fb34b7fe640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb34c0c2450 0x7fb34c14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.011+0000 7fb34bfff640 1 -- 172.21.15.53:0/1005949590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb34c0c4ab0 msgr2=0x7fb34c13c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.011+0000 7fb34bfff640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb34c0c4ab0 0x7fb34c13c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.011+0000 7fb34bfff640 1 -- 172.21.15.53:0/1005949590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb34c0c2450 msgr2=0x7fb34c14be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.011+0000 7fb34bfff640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb34c0c2450 0x7fb34c14be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.011+0000 7fb34bfff640 1 -- 172.21.15.53:0/1005949590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3400094d0 con 0x7fb34c155fb0 2023-12-08T21:25:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.011+0000 7fb34bfff640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb34c155fb0 0x7fb34c140890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb34400ef90 tx=0x7fb34400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:28.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.015+0000 7fb333fff640 1 -- 172.21.15.53:0/1005949590 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344009b20 con 0x7fb34c155fb0 2023-12-08T21:25:28.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.015+0000 7fb333fff640 1 -- 172.21.15.53:0/1005949590 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34400f040 con 0x7fb34c155fb0 2023-12-08T21:25:28.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.015+0000 7fb333fff640 1 -- 172.21.15.53:0/1005949590 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3440146c0 con 0x7fb34c155fb0 2023-12-08T21:25:28.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.015+0000 7fb352065640 1 -- 172.21.15.53:0/1005949590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c0c3340 con 0x7fb34c155fb0 2023-12-08T21:25:28.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.015+0000 7fb352065640 1 -- 172.21.15.53:0/1005949590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c14b3a0 con 0x7fb34c155fb0 2023-12-08T21:25:28.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.019+0000 7fb352065640 1 -- 172.21.15.53:0/1005949590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c14c3c0 con 0x7fb34c155fb0 2023-12-08T21:25:28.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.039+0000 7fb333fff640 1 -- 172.21.15.53:0/1005949590 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb344014820 con 0x7fb34c155fb0 2023-12-08T21:25:28.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.039+0000 7fb333fff640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb3380664f0 0x7fb3380689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:28.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.039+0000 7fb34b7fe640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb3380664f0 0x7fb3380689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:28.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.039+0000 7fb34b7fe640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb3380664f0 0x7fb3380689b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009ae0 tx=0x7fb33c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:28.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.347+0000 7fb333fff640 1 -- 172.21.15.53:0/1005949590 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fb3440561d0 con 0x7fb34c155fb0 2023-12-08T21:25:28.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.347+0000 7fb333fff640 1 -- 172.21.15.53:0/1005949590 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb344052510 con 0x7fb34c155fb0 2023-12-08T21:25:28.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.523+0000 7fb352065640 1 -- 172.21.15.53:0/1005949590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb34c074190 con 0x7fb34c155fb0 2023-12-08T21:25:28.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.699+0000 7fb333fff640 1 -- 172.21.15.53:0/1005949590 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18446 (secure 0 0 0) 0x7fb344018090 con 0x7fb34c155fb0 2023-12-08T21:25:28.703 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:25:28.703 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:59.702174+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T21:25:28.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.699+0000 7fb352065640 1 -- 172.21.15.53:0/1005949590 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb3380664f0 msgr2=0x7fb3380689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:28.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.699+0000 7fb352065640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb3380664f0 0x7fb3380689b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009ae0 tx=0x7fb33c009190 comp rx=0 tx=0).stop 2023-12-08T21:25:28.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.699+0000 7fb352065640 1 -- 172.21.15.53:0/1005949590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb34c155fb0 msgr2=0x7fb34c140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:28.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.699+0000 7fb352065640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb34c155fb0 0x7fb34c140890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb34400ef90 tx=0x7fb34400c490 comp rx=0 tx=0).stop 2023-12-08T21:25:28.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.703+0000 7fb352065640 1 -- 172.21.15.53:0/1005949590 shutdown_connections 2023-12-08T21:25:28.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.703+0000 7fb352065640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb3380664f0 0x7fb3380689b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.703+0000 7fb352065640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb34c155fb0 0x7fb34c140890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.703+0000 7fb352065640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb34c0c4ab0 0x7fb34c13c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.703+0000 7fb352065640 1 --2- 172.21.15.53:0/1005949590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb34c0c2450 0x7fb34c14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.703+0000 7fb352065640 1 -- 172.21.15.53:0/1005949590 >> 172.21.15.53:0/1005949590 conn(0x7fb34c0cbb50 msgr2=0x7fb34c0c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:28.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.703+0000 7fb352065640 1 -- 172.21.15.53:0/1005949590 shutdown_connections 2023-12-08T21:25:28.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.703+0000 7fb352065640 1 -- 172.21.15.53:0/1005949590 wait complete. 2023-12-08T21:25:28.730 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T20:54:13.707275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T20:54:52.929484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T20:54:54.529440+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T20:55:01.908380+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T21:25:28.730 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T21:25:28.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.859+0000 7fd5ba8ca640 1 Processor -- start 2023-12-08T21:25:28.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.859+0000 7fd5ba8ca640 1 -- start start 2023-12-08T21:25:28.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.859+0000 7fd5ba8ca640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5b4157fc0 0x7fd5b4161010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:28.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.859+0000 7fd5ba8ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5b4161550 0x7fd5b406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:28.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.859+0000 7fd5ba8ca640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b406e330 con 0x7fd5b40c2de0 2023-12-08T21:25:28.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.859+0000 7fd5ba8ca640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b40b20e0 con 0x7fd5b4161550 2023-12-08T21:25:28.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.859+0000 7fd5ba8ca640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b40706c0 con 0x7fd5b4157fc0 2023-12-08T21:25:28.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.859+0000 7fd5b37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5b4161550 0x7fd5b406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:28.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.859+0000 7fd5b8e67640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd5b40c2de0 0x7fd5b415da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36554/0 (socket says 172.21.15.53:36554) 2023-12-08T21:25:28.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.859+0000 7fd5b8e67640 1 -- 172.21.15.53:0/888731286 learned_addr learned my addr 172.21.15.53:0/888731286 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:28.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.859+0000 7fd5b3fff640 1 --2- 172.21.15.53:0/888731286 >> v2:172.21.15.146:3300/0 conn(0x7fd5b4157fc0 0x7fd5b4161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:28.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.867+0000 7fd5b37fe640 1 -- 172.21.15.53:0/888731286 >> v2:172.21.15.146:3300/0 conn(0x7fd5b4157fc0 msgr2=0x7fd5b4161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:28.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.867+0000 7fd5b37fe640 1 --2- 172.21.15.53:0/888731286 >> v2:172.21.15.146:3300/0 conn(0x7fd5b4157fc0 0x7fd5b4161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.867+0000 7fd5b37fe640 1 -- 172.21.15.53:0/888731286 >> v1:172.21.15.53:6789/0 conn(0x7fd5b40c2de0 legacy=0x7fd5b415da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:28.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.867+0000 7fd5b37fe640 1 -- 172.21.15.53:0/888731286 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b406e050 con 0x7fd5b4161550 2023-12-08T21:25:28.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.871+0000 7fd5b37fe640 1 --2- 172.21.15.53:0/888731286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4161550 0x7fd5b406a5b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd5b404eea0 tx=0x7fd5a801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d41017db8c4e74 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:28.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5b2ffd640 1 -- 172.21.15.53:0/888731286 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80ab610 con 0x7fd5b4161550 2023-12-08T21:25:28.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5b2ffd640 1 -- 172.21.15.53:0/888731286 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a80ab770 con 0x7fd5b4161550 2023-12-08T21:25:28.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5b2ffd640 1 -- 172.21.15.53:0/888731286 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80abb00 con 0x7fd5b4161550 2023-12-08T21:25:28.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/888731286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4161550 msgr2=0x7fd5b406a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:28.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5ba8ca640 1 --2- 172.21.15.53:0/888731286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4161550 0x7fd5b406a5b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd5b404eea0 tx=0x7fd5a801c410 comp rx=0 tx=0).stop 2023-12-08T21:25:28.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/888731286 shutdown_connections 2023-12-08T21:25:28.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5ba8ca640 1 --2- 172.21.15.53:0/888731286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4161550 0x7fd5b406a5b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5ba8ca640 1 --2- 172.21.15.53:0/888731286 >> v2:172.21.15.146:3300/0 conn(0x7fd5b4157fc0 0x7fd5b4161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/888731286 >> 172.21.15.53:0/888731286 conn(0x7fd5b40c8a00 msgr2=0x7fd5b40c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:28.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/888731286 shutdown_connections 2023-12-08T21:25:28.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/888731286 wait complete. 2023-12-08T21:25:28.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5ba8ca640 1 Processor -- start 2023-12-08T21:25:28.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.879+0000 7fd5ba8ca640 1 -- start start 2023-12-08T21:25:28.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.883+0000 7fd5ba8ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b40c2de0 0x7fd5b41f7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:28.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.883+0000 7fd5ba8ca640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5b4157fc0 0x7fd5b414f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:28.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.883+0000 7fd5ba8ca640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5b4161550 0x7fd5b41fa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:28.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.883+0000 7fd5ba8ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4154d10 con 0x7fd5b40c2de0 2023-12-08T21:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.883+0000 7fd5ba8ca640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b41fa0a0 con 0x7fd5b4157fc0 2023-12-08T21:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.883+0000 7fd5ba8ca640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b41f7840 con 0x7fd5b4161550 2023-12-08T21:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.883+0000 7fd5b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b40c2de0 0x7fd5b41f7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.883+0000 7fd5b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b40c2de0 0x7fd5b41f7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47584/0 (socket says 172.21.15.53:47584) 2023-12-08T21:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.883+0000 7fd5b3fff640 1 -- 172.21.15.53:0/1937864177 learned_addr learned my addr 172.21.15.53:0/1937864177 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.883+0000 7fd5b8e67640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5b4161550 0x7fd5b41fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.883+0000 7fd5b37fe640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5b4157fc0 0x7fd5b414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:28.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.887+0000 7fd5b3fff640 1 -- 172.21.15.53:0/1937864177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5b4161550 msgr2=0x7fd5b41fa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:28.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.887+0000 7fd5b3fff640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5b4161550 0x7fd5b41fa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.887+0000 7fd5b3fff640 1 -- 172.21.15.53:0/1937864177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5b4157fc0 msgr2=0x7fd5b414f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:28.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.887+0000 7fd5b3fff640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5b4157fc0 0x7fd5b414f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:28.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.887+0000 7fd5b3fff640 1 -- 172.21.15.53:0/1937864177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a80093b0 con 0x7fd5b40c2de0 2023-12-08T21:25:28.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.891+0000 7fd5b3fff640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b40c2de0 0x7fd5b41f7300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009db0 tx=0x7fd5ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:28.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.895+0000 7fd5b0ff9640 1 -- 172.21.15.53:0/1937864177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac014480 con 0x7fd5b40c2de0 2023-12-08T21:25:28.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.895+0000 7fd5b0ff9640 1 -- 172.21.15.53:0/1937864177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac00f040 con 0x7fd5b40c2de0 2023-12-08T21:25:28.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.895+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/1937864177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b4155ac0 con 0x7fd5b40c2de0 2023-12-08T21:25:28.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.895+0000 7fd5b0ff9640 1 -- 172.21.15.53:0/1937864177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac014800 con 0x7fd5b40c2de0 2023-12-08T21:25:28.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.895+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/1937864177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b4155220 con 0x7fd5b40c2de0 2023-12-08T21:25:28.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.899+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/1937864177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b41f9e70 con 0x7fd5b40c2de0 2023-12-08T21:25:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.919+0000 7fd5b0ff9640 1 -- 172.21.15.53:0/1937864177 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd5ac014960 con 0x7fd5b40c2de0 2023-12-08T21:25:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.919+0000 7fd5b0ff9640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd5a00664c0 0x7fd5a0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.919+0000 7fd5b37fe640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd5a00664c0 0x7fd5a0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:28.923+0000 7fd5b37fe640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd5a00664c0 0x7fd5a0068980 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80af000 tx=0x7fd5a80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:29.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.211+0000 7fd5b0ff9640 1 -- 172.21.15.53:0/1937864177 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fd5ac056400 con 0x7fd5b40c2de0 2023-12-08T21:25:29.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.211+0000 7fd5b0ff9640 1 -- 172.21.15.53:0/1937864177 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5ac052740 con 0x7fd5b40c2de0 2023-12-08T21:25:29.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.387+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/1937864177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5b41594b0 con 0x7fd5b40c2de0 2023-12-08T21:25:29.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.403+0000 7fd5b0ff9640 1 -- 172.21.15.53:0/1937864177 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5ac055d60 con 0x7fd5b40c2de0 2023-12-08T21:25:29.408 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-12-08T21:25:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.407+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/1937864177 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd5a00664c0 msgr2=0x7fd5a0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.407+0000 7fd5ba8ca640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd5a00664c0 0x7fd5a0068980 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80af000 tx=0x7fd5a80a7000 comp rx=0 tx=0).stop 2023-12-08T21:25:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.407+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/1937864177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b40c2de0 msgr2=0x7fd5b41f7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.407+0000 7fd5ba8ca640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b40c2de0 0x7fd5b41f7300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009db0 tx=0x7fd5ac00c490 comp rx=0 tx=0).stop 2023-12-08T21:25:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.407+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/1937864177 shutdown_connections 2023-12-08T21:25:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.407+0000 7fd5ba8ca640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd5a00664c0 0x7fd5a0068980 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.407+0000 7fd5ba8ca640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5b4161550 0x7fd5b41fa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.407+0000 7fd5ba8ca640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5b4157fc0 0x7fd5b414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.407+0000 7fd5ba8ca640 1 --2- 172.21.15.53:0/1937864177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b40c2de0 0x7fd5b41f7300 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.407+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/1937864177 >> 172.21.15.53:0/1937864177 conn(0x7fd5b40c8a00 msgr2=0x7fd5b415ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:29.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.407+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/1937864177 shutdown_connections 2023-12-08T21:25:29.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.407+0000 7fd5ba8ca640 1 -- 172.21.15.53:0/1937864177 wait complete. 2023-12-08T21:25:29.428 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T21:25:29.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.559+0000 7fa6b494a640 1 Processor -- start 2023-12-08T21:25:29.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.559+0000 7fa6b494a640 1 -- start start 2023-12-08T21:25:29.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.559+0000 7fa6b494a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6b0153870 0x7fa6b015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:29.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.559+0000 7fa6b494a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6b0153c50 0x7fa6b015a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:29.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.559+0000 7fa6b494a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b015d270 con 0x7fa6b00c4740 2023-12-08T21:25:29.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.559+0000 7fa6b494a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b0159740 con 0x7fa6b0153c50 2023-12-08T21:25:29.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.559+0000 7fa6b494a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b015d4e0 con 0x7fa6b0153870 2023-12-08T21:25:29.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.599+0000 7fa6aed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa6b00c4740 0x7fa6b00cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36564/0 (socket says 172.21.15.53:36564) 2023-12-08T21:25:29.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.599+0000 7fa6aed9d640 1 -- 172.21.15.53:0/2481588484 learned_addr learned my addr 172.21.15.53:0/2481588484 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:29.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.603+0000 7fa6add9b640 1 --2- 172.21.15.53:0/2481588484 >> v2:172.21.15.53:3300/0 conn(0x7fa6b0153c50 0x7fa6b015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:29.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.607+0000 7fa6add9b640 1 -- 172.21.15.53:0/2481588484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6b0153870 msgr2=0x7fa6b015cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:29.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.607+0000 7fa6add9b640 1 --2- 172.21.15.53:0/2481588484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6b0153870 0x7fa6b015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:29.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.607+0000 7fa6add9b640 1 -- 172.21.15.53:0/2481588484 >> v1:172.21.15.53:6789/0 conn(0x7fa6b00c4740 legacy=0x7fa6b00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:29.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.607+0000 7fa6add9b640 1 -- 172.21.15.53:0/2481588484 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b015d7c0 con 0x7fa6b0153c50 2023-12-08T21:25:29.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.611+0000 7fa6add9b640 1 --2- 172.21.15.53:0/2481588484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b0153c50 0x7fa6b015a150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00097c0 tx=0x7fa6a001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20175cd03b3fe857 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:29.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.615+0000 7fa6ad59a640 1 -- 172.21.15.53:0/2481588484 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00a8970 con 0x7fa6b0153c50 2023-12-08T21:25:29.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.615+0000 7fa6ad59a640 1 -- 172.21.15.53:0/2481588484 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a00a8ad0 con 0x7fa6b0153c50 2023-12-08T21:25:29.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.615+0000 7fa6ad59a640 1 -- 172.21.15.53:0/2481588484 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00a8e60 con 0x7fa6b0153c50 2023-12-08T21:25:29.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.619+0000 7fa6b494a640 1 -- 172.21.15.53:0/2481588484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b0153c50 msgr2=0x7fa6b015a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.619+0000 7fa6b494a640 1 --2- 172.21.15.53:0/2481588484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b0153c50 0x7fa6b015a150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00097c0 tx=0x7fa6a001ec70 comp rx=0 tx=0).stop 2023-12-08T21:25:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.619+0000 7fa6b494a640 1 -- 172.21.15.53:0/2481588484 shutdown_connections 2023-12-08T21:25:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.619+0000 7fa6b494a640 1 --2- 172.21.15.53:0/2481588484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b0153c50 0x7fa6b015a150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.619+0000 7fa6b494a640 1 --2- 172.21.15.53:0/2481588484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6b0153870 0x7fa6b015cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.619+0000 7fa6b494a640 1 -- 172.21.15.53:0/2481588484 >> 172.21.15.53:0/2481588484 conn(0x7fa6b006bab0 msgr2=0x7fa6b006bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:29.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.619+0000 7fa6b494a640 1 -- 172.21.15.53:0/2481588484 shutdown_connections 2023-12-08T21:25:29.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.619+0000 7fa6b494a640 1 -- 172.21.15.53:0/2481588484 wait complete. 2023-12-08T21:25:29.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.619+0000 7fa6b494a640 1 Processor -- start 2023-12-08T21:25:29.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.619+0000 7fa6b494a640 1 -- start start 2023-12-08T21:25:29.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.623+0000 7fa6b494a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00c4740 0x7fa6b00b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:29.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.623+0000 7fa6b494a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6b0153870 0x7fa6b01eef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:29.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.623+0000 7fa6b494a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6b0153c50 0x7fa6b01ef480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:29.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.623+0000 7fa6b494a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b01f32b0 con 0x7fa6b00c4740 2023-12-08T21:25:29.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.623+0000 7fa6b494a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b014dcc0 con 0x7fa6b0153c50 2023-12-08T21:25:29.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.623+0000 7fa6b494a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b014df60 con 0x7fa6b0153870 2023-12-08T21:25:29.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.623+0000 7fa6ae59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00c4740 0x7fa6b00b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:29.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.623+0000 7fa6ae59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00c4740 0x7fa6b00b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47602/0 (socket says 172.21.15.53:47602) 2023-12-08T21:25:29.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.623+0000 7fa6ae59c640 1 -- 172.21.15.53:0/2759865326 learned_addr learned my addr 172.21.15.53:0/2759865326 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:29.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.627+0000 7fa6ae59c640 1 -- 172.21.15.53:0/2759865326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6b0153870 msgr2=0x7fa6b01eef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:29.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.627+0000 7fa6ae59c640 1 --2- 172.21.15.53:0/2759865326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6b0153870 0x7fa6b01eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:29.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.627+0000 7fa6ae59c640 1 -- 172.21.15.53:0/2759865326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6b0153c50 msgr2=0x7fa6b01ef480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:29.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.627+0000 7fa6ae59c640 1 --2- 172.21.15.53:0/2759865326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6b0153c50 0x7fa6b01ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:29.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.627+0000 7fa6ae59c640 1 -- 172.21.15.53:0/2759865326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a0009420 con 0x7fa6b00c4740 2023-12-08T21:25:29.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.631+0000 7fa6ae59c640 1 --2- 172.21.15.53:0/2759865326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00c4740 0x7fa6b00b4260 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400b550 tx=0x7fa6a400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.635+0000 7fa69effd640 1 -- 172.21.15.53:0/2759865326 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4010870 con 0x7fa6b00c4740 2023-12-08T21:25:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.635+0000 7fa69effd640 1 -- 172.21.15.53:0/2759865326 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a40109f0 con 0x7fa6b00c4740 2023-12-08T21:25:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.635+0000 7fa69effd640 1 -- 172.21.15.53:0/2759865326 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4010da0 con 0x7fa6b00c4740 2023-12-08T21:25:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.635+0000 7fa6b494a640 1 -- 172.21.15.53:0/2759865326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b014e240 con 0x7fa6b00c4740 2023-12-08T21:25:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.635+0000 7fa6b494a640 1 -- 172.21.15.53:0/2759865326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b014e800 con 0x7fa6b00c4740 2023-12-08T21:25:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.635+0000 7fa6b494a640 1 -- 172.21.15.53:0/2759865326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b014e9f0 con 0x7fa6b00c4740 2023-12-08T21:25:29.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.939+0000 7fa69effd640 1 -- 172.21.15.53:0/2759865326 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa6a4023480 con 0x7fa6b00c4740 2023-12-08T21:25:29.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.939+0000 7fa69effd640 1 --2- 172.21.15.53:0/2759865326 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa6900664c0 0x7fa690068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.939+0000 7fa6add9b640 1 --2- 172.21.15.53:0/2759865326 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa6900664c0 0x7fa690068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.943+0000 7fa6add9b640 1 --2- 172.21.15.53:0/2759865326 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa6900664c0 0x7fa690068980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00b2000 tx=0x7fa6a0004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:29.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.979+0000 7fa69effd640 1 -- 172.21.15.53:0/2759865326 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fa6a4055ad0 con 0x7fa6b00c4740 2023-12-08T21:25:29.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:29.979+0000 7fa69effd640 1 -- 172.21.15.53:0/2759865326 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6a4051710 con 0x7fa6b00c4740 2023-12-08T21:25:30.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.159+0000 7fa6b494a640 1 -- 172.21.15.53:0/2759865326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6b00caac0 con 0x7fa6b00c4740 2023-12-08T21:25:30.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa69effd640 1 -- 172.21.15.53:0/2759865326 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6a401e0a0 con 0x7fa6b00c4740 2023-12-08T21:25:30.171 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-12-08T21:25:30.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa6b494a640 1 -- 172.21.15.53:0/2759865326 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa6900664c0 msgr2=0x7fa690068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:30.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa6b494a640 1 --2- 172.21.15.53:0/2759865326 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa6900664c0 0x7fa690068980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00b2000 tx=0x7fa6a0004740 comp rx=0 tx=0).stop 2023-12-08T21:25:30.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa6b494a640 1 -- 172.21.15.53:0/2759865326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00c4740 msgr2=0x7fa6b00b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:30.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa6b494a640 1 --2- 172.21.15.53:0/2759865326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00c4740 0x7fa6b00b4260 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400b550 tx=0x7fa6a400ba10 comp rx=0 tx=0).stop 2023-12-08T21:25:30.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa6b494a640 1 -- 172.21.15.53:0/2759865326 shutdown_connections 2023-12-08T21:25:30.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa6b494a640 1 --2- 172.21.15.53:0/2759865326 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa6900664c0 0x7fa690068980 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa6b494a640 1 --2- 172.21.15.53:0/2759865326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6b0153c50 0x7fa6b01ef480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa6b494a640 1 --2- 172.21.15.53:0/2759865326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6b0153870 0x7fa6b01eef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa6b494a640 1 --2- 172.21.15.53:0/2759865326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00c4740 0x7fa6b00b4260 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa6b494a640 1 -- 172.21.15.53:0/2759865326 >> 172.21.15.53:0/2759865326 conn(0x7fa6b006bab0 msgr2=0x7fa6b0158420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa6b494a640 1 -- 172.21.15.53:0/2759865326 shutdown_connections 2023-12-08T21:25:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.167+0000 7fa6b494a640 1 -- 172.21.15.53:0/2759865326 wait complete. 2023-12-08T21:25:30.191 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T21:25:30.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.319+0000 7f848543b640 1 Processor -- start 2023-12-08T21:25:30.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.319+0000 7f848543b640 1 -- start start 2023-12-08T21:25:30.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.319+0000 7f848543b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8480070d40 0x7f84800ca250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:30.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.319+0000 7f848543b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8480071120 0x7f848014db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:30.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.319+0000 7f848543b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84800cd240 con 0x7f84800c7920 2023-12-08T21:25:30.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.319+0000 7f848543b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84800cddc0 con 0x7f8480071120 2023-12-08T21:25:30.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.319+0000 7f848543b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8480158470 con 0x7f8480070d40 2023-12-08T21:25:30.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.319+0000 7f84767fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8480071120 0x7f848014db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:30.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.319+0000 7f847f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f84800c7920 0x7f84800c2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36572/0 (socket says 172.21.15.53:36572) 2023-12-08T21:25:30.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.319+0000 7f847f7fe640 1 -- 172.21.15.53:0/1420906596 learned_addr learned my addr 172.21.15.53:0/1420906596 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:30.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.319+0000 7f847effd640 1 --2- 172.21.15.53:0/1420906596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8480070d40 0x7f84800ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:30.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.323+0000 7f84767fc640 1 -- 172.21.15.53:0/1420906596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8480070d40 msgr2=0x7f84800ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:30.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.323+0000 7f84767fc640 1 --2- 172.21.15.53:0/1420906596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8480070d40 0x7f84800ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.323+0000 7f84767fc640 1 -- 172.21.15.53:0/1420906596 >> v1:172.21.15.53:6789/0 conn(0x7f84800c7920 legacy=0x7f84800c2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:30.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.323+0000 7f84767fc640 1 -- 172.21.15.53:0/1420906596 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84800cd520 con 0x7f8480071120 2023-12-08T21:25:30.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.331+0000 7f84767fc640 1 --2- 172.21.15.53:0/1420906596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8480071120 0x7f848014db20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f84680097c0 tx=0x7f846801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235531174ebf9d30 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:30.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.335+0000 7f847e7fc640 1 -- 172.21.15.53:0/1420906596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680a8970 con 0x7f8480071120 2023-12-08T21:25:30.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.335+0000 7f847e7fc640 1 -- 172.21.15.53:0/1420906596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84680a8ad0 con 0x7f8480071120 2023-12-08T21:25:30.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.335+0000 7f847e7fc640 1 -- 172.21.15.53:0/1420906596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680a8e60 con 0x7f8480071120 2023-12-08T21:25:30.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.335+0000 7f848543b640 1 -- 172.21.15.53:0/1420906596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8480071120 msgr2=0x7f848014db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:30.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.335+0000 7f848543b640 1 --2- 172.21.15.53:0/1420906596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8480071120 0x7f848014db20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f84680097c0 tx=0x7f846801ec70 comp rx=0 tx=0).stop 2023-12-08T21:25:30.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.335+0000 7f848543b640 1 -- 172.21.15.53:0/1420906596 shutdown_connections 2023-12-08T21:25:30.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.335+0000 7f848543b640 1 --2- 172.21.15.53:0/1420906596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8480071120 0x7f848014db20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.335+0000 7f848543b640 1 --2- 172.21.15.53:0/1420906596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8480070d40 0x7f84800ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.335+0000 7f848543b640 1 -- 172.21.15.53:0/1420906596 >> 172.21.15.53:0/1420906596 conn(0x7f8480070320 msgr2=0x7f848006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:30.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.335+0000 7f848543b640 1 -- 172.21.15.53:0/1420906596 shutdown_connections 2023-12-08T21:25:30.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.335+0000 7f848543b640 1 -- 172.21.15.53:0/1420906596 wait complete. 2023-12-08T21:25:30.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f848543b640 1 Processor -- start 2023-12-08T21:25:30.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f848543b640 1 -- start start 2023-12-08T21:25:30.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f848543b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8480070d40 0x7f848015a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:30.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f848543b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8480071120 0x7f84801f1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:30.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f848543b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84800c7920 0x7f8480151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:30.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f848543b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84801f09b0 con 0x7f8480071120 2023-12-08T21:25:30.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f848543b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84800c4e80 con 0x7f84800c7920 2023-12-08T21:25:30.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f848543b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84800c5160 con 0x7f8480070d40 2023-12-08T21:25:30.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f84767fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8480071120 0x7f84801f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:30.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f84767fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8480071120 0x7f84801f1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47612/0 (socket says 172.21.15.53:47612) 2023-12-08T21:25:30.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f84767fc640 1 -- 172.21.15.53:0/3653199118 learned_addr learned my addr 172.21.15.53:0/3653199118 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:30.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f847effd640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8480070d40 0x7f848015a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:30.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.339+0000 7f847f7fe640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84800c7920 0x7f8480151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:30.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.343+0000 7f84767fc640 1 -- 172.21.15.53:0/3653199118 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8480070d40 msgr2=0x7f848015a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:30.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.343+0000 7f84767fc640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8480070d40 0x7f848015a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.343+0000 7f84767fc640 1 -- 172.21.15.53:0/3653199118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84800c7920 msgr2=0x7f8480151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:30.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.343+0000 7f84767fc640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84800c7920 0x7f8480151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.343+0000 7f84767fc640 1 -- 172.21.15.53:0/3653199118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8468009420 con 0x7f8480071120 2023-12-08T21:25:30.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.347+0000 7f84767fc640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8480071120 0x7f84801f1140 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f846801b880 tx=0x7f846801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:30.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.351+0000 7f8477fff640 1 -- 172.21.15.53:0/3653199118 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680b1dc0 con 0x7f8480071120 2023-12-08T21:25:30.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.351+0000 7f8477fff640 1 -- 172.21.15.53:0/3653199118 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84680b9410 con 0x7f8480071120 2023-12-08T21:25:30.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.351+0000 7f848543b640 1 -- 172.21.15.53:0/3653199118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84800c5440 con 0x7f8480071120 2023-12-08T21:25:30.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.351+0000 7f8477fff640 1 -- 172.21.15.53:0/3653199118 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680b97c0 con 0x7f8480071120 2023-12-08T21:25:30.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.351+0000 7f848543b640 1 -- 172.21.15.53:0/3653199118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848015a810 con 0x7f8480071120 2023-12-08T21:25:30.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.351+0000 7f848543b640 1 -- 172.21.15.53:0/3653199118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8480074190 con 0x7f8480071120 2023-12-08T21:25:30.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.375+0000 7f8477fff640 1 -- 172.21.15.53:0/3653199118 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f84680b7040 con 0x7f8480071120 2023-12-08T21:25:30.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.375+0000 7f8477fff640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f84600664c0 0x7f8460068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:30.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.375+0000 7f847effd640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f84600664c0 0x7f8460068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:30.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.375+0000 7f847effd640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f84600664c0 0x7f8460068980 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8470009b60 tx=0x7f8470009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:30.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.699+0000 7f8477fff640 1 -- 172.21.15.53:0/3653199118 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f84680f3460 con 0x7f8480071120 2023-12-08T21:25:30.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.699+0000 7f8477fff640 1 -- 172.21.15.53:0/3653199118 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f84680ef7a0 con 0x7f8480071120 2023-12-08T21:25:30.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.867+0000 7f848543b640 1 -- 172.21.15.53:0/3653199118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84801f0df0 con 0x7f8480071120 2023-12-08T21:25:30.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.927+0000 7f8477fff640 1 -- 172.21.15.53:0/3653199118 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84680b5020 con 0x7f8480071120 2023-12-08T21:25:30.931 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-12-08T21:25:30.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.931+0000 7f848543b640 1 -- 172.21.15.53:0/3653199118 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f84600664c0 msgr2=0x7f8460068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:30.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.931+0000 7f848543b640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f84600664c0 0x7f8460068980 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8470009b60 tx=0x7f8470009190 comp rx=0 tx=0).stop 2023-12-08T21:25:30.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.931+0000 7f848543b640 1 -- 172.21.15.53:0/3653199118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8480071120 msgr2=0x7f84801f1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:30.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.931+0000 7f848543b640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8480071120 0x7f84801f1140 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f846801b880 tx=0x7f846801ba10 comp rx=0 tx=0).stop 2023-12-08T21:25:30.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.931+0000 7f848543b640 1 -- 172.21.15.53:0/3653199118 shutdown_connections 2023-12-08T21:25:30.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.931+0000 7f848543b640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f84600664c0 0x7f8460068980 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.931+0000 7f848543b640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84800c7920 0x7f8480151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.931+0000 7f848543b640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8480071120 0x7f84801f1140 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.931+0000 7f848543b640 1 --2- 172.21.15.53:0/3653199118 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8480070d40 0x7f848015a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:30.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.931+0000 7f848543b640 1 -- 172.21.15.53:0/3653199118 >> 172.21.15.53:0/3653199118 conn(0x7f8480070320 msgr2=0x7f84801570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:30.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.931+0000 7f848543b640 1 -- 172.21.15.53:0/3653199118 shutdown_connections 2023-12-08T21:25:30.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:30.931+0000 7f848543b640 1 -- 172.21.15.53:0/3653199118 wait complete. 2023-12-08T21:25:30.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T21:25:31.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.091+0000 7fcad8e28640 1 Processor -- start 2023-12-08T21:25:31.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.091+0000 7fcad8e28640 1 -- start start 2023-12-08T21:25:31.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.091+0000 7fcad8e28640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcad406a810 0x7fcad4060fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:31.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.091+0000 7fcad8e28640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcad41519b0 0x7fcad4071a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:31.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.091+0000 7fcad8e28640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad40c7d60 con 0x7fcad406abf0 2023-12-08T21:25:31.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.091+0000 7fcad8e28640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad4157490 con 0x7fcad41519b0 2023-12-08T21:25:31.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.091+0000 7fcad8e28640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad4157680 con 0x7fcad406a810 2023-12-08T21:25:31.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.091+0000 7fcad2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcad41519b0 0x7fcad4071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:31.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.091+0000 7fcad2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcad41519b0 0x7fcad4071a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59754/0 (socket says 172.21.15.53:59754) 2023-12-08T21:25:31.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.091+0000 7fcad2d9d640 1 -- 172.21.15.53:0/4035621669 learned_addr learned my addr 172.21.15.53:0/4035621669 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:31.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.095+0000 7fcad2d9d640 1 -- 172.21.15.53:0/4035621669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcad406a810 msgr2=0x7fcad4060fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:31.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.095+0000 7fcad2d9d640 1 --2- 172.21.15.53:0/4035621669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcad406a810 0x7fcad4060fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.095+0000 7fcad2d9d640 1 -- 172.21.15.53:0/4035621669 >> v1:172.21.15.146:6789/0 conn(0x7fcad406abf0 legacy=0x7fcad41512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:31.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.095+0000 7fcad2d9d640 1 -- 172.21.15.53:0/4035621669 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad4157960 con 0x7fcad41519b0 2023-12-08T21:25:31.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.099+0000 7fcad2d9d640 1 --2- 172.21.15.53:0/4035621669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcad41519b0 0x7fcad4071a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009e50 tx=0x7fcacc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250b52108044d391 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:31.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.103+0000 7fcad159a640 1 -- 172.21.15.53:0/4035621669 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0a5820 con 0x7fcad41519b0 2023-12-08T21:25:31.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.103+0000 7fcad159a640 1 -- 172.21.15.53:0/4035621669 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc0a5980 con 0x7fcad41519b0 2023-12-08T21:25:31.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.103+0000 7fcad159a640 1 -- 172.21.15.53:0/4035621669 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0a5d10 con 0x7fcad41519b0 2023-12-08T21:25:31.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.103+0000 7fcad8e28640 1 -- 172.21.15.53:0/4035621669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcad41519b0 msgr2=0x7fcad4071a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:31.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.103+0000 7fcad8e28640 1 --2- 172.21.15.53:0/4035621669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcad41519b0 0x7fcad4071a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009e50 tx=0x7fcacc01c9a0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.103+0000 7fcad8e28640 1 -- 172.21.15.53:0/4035621669 shutdown_connections 2023-12-08T21:25:31.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.103+0000 7fcad8e28640 1 --2- 172.21.15.53:0/4035621669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcad41519b0 0x7fcad4071a50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.103+0000 7fcad8e28640 1 --2- 172.21.15.53:0/4035621669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcad406a810 0x7fcad4060fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.103+0000 7fcad8e28640 1 -- 172.21.15.53:0/4035621669 >> 172.21.15.53:0/4035621669 conn(0x7fcad40c7f70 msgr2=0x7fcad40c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:31.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.103+0000 7fcad8e28640 1 -- 172.21.15.53:0/4035621669 shutdown_connections 2023-12-08T21:25:31.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.103+0000 7fcad8e28640 1 -- 172.21.15.53:0/4035621669 wait complete. 2023-12-08T21:25:31.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.107+0000 7fcad8e28640 1 Processor -- start 2023-12-08T21:25:31.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.107+0000 7fcad8e28640 1 -- start start 2023-12-08T21:25:31.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.107+0000 7fcad8e28640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcad406a810 0x7fcad41f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:31.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.107+0000 7fcad8e28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcad406abf0 0x7fcad413f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:31.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.107+0000 7fcad8e28640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcad41519b0 0x7fcad413e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:31.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.107+0000 7fcad8e28640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad413d360 con 0x7fcad406abf0 2023-12-08T21:25:31.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.107+0000 7fcad8e28640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad41f31a0 con 0x7fcad406a810 2023-12-08T21:25:31.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.107+0000 7fcad8e28640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad413da50 con 0x7fcad41519b0 2023-12-08T21:25:31.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.107+0000 7fcad1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcad406abf0 0x7fcad413f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:31.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.107+0000 7fcad1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcad406abf0 0x7fcad413f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59770/0 (socket says 172.21.15.53:59770) 2023-12-08T21:25:31.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.107+0000 7fcad1d9b640 1 -- 172.21.15.53:0/419160408 learned_addr learned my addr 172.21.15.53:0/419160408 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.111+0000 7fcad1d9b640 1 -- 172.21.15.53:0/419160408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcad41519b0 msgr2=0x7fcad413e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.111+0000 7fcad1d9b640 1 --2- 172.21.15.53:0/419160408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcad41519b0 0x7fcad413e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.111+0000 7fcad1d9b640 1 -- 172.21.15.53:0/419160408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcad406a810 msgr2=0x7fcad41f3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.111+0000 7fcad1d9b640 1 --2- 172.21.15.53:0/419160408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcad406a810 0x7fcad41f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.111+0000 7fcad1d9b640 1 -- 172.21.15.53:0/419160408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc009b30 con 0x7fcad406abf0 2023-12-08T21:25:31.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.115+0000 7fcad1d9b640 1 --2- 172.21.15.53:0/419160408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcad406abf0 0x7fcad413f560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcac400b3e0 tx=0x7fcac400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:31.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.115+0000 7fcac2ffd640 1 -- 172.21.15.53:0/419160408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4011830 con 0x7fcad406abf0 2023-12-08T21:25:31.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.119+0000 7fcac2ffd640 1 -- 172.21.15.53:0/419160408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4011990 con 0x7fcad406abf0 2023-12-08T21:25:31.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.119+0000 7fcad8e28640 1 -- 172.21.15.53:0/419160408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad413dd30 con 0x7fcad406abf0 2023-12-08T21:25:31.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.119+0000 7fcac2ffd640 1 -- 172.21.15.53:0/419160408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4011d20 con 0x7fcad406abf0 2023-12-08T21:25:31.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.119+0000 7fcad8e28640 1 -- 172.21.15.53:0/419160408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad41f2e30 con 0x7fcad406abf0 2023-12-08T21:25:31.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.119+0000 7fcad8e28640 1 -- 172.21.15.53:0/419160408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad4074190 con 0x7fcad406abf0 2023-12-08T21:25:31.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.419+0000 7fcac2ffd640 1 -- 172.21.15.53:0/419160408 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcac401a400 con 0x7fcad406abf0 2023-12-08T21:25:31.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.419+0000 7fcac2ffd640 1 --2- 172.21.15.53:0/419160408 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fcab40664c0 0x7fcab4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:31.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.419+0000 7fcad259c640 1 --2- 172.21.15.53:0/419160408 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fcab40664c0 0x7fcab4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:31.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.419+0000 7fcad259c640 1 --2- 172.21.15.53:0/419160408 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fcab40664c0 0x7fcab4068980 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009690 tx=0x7fcac8006c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:31.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.455+0000 7fcac2ffd640 1 -- 172.21.15.53:0/419160408 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fcac4055e50 con 0x7fcad406abf0 2023-12-08T21:25:31.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.455+0000 7fcac2ffd640 1 -- 172.21.15.53:0/419160408 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcac4051a90 con 0x7fcad406abf0 2023-12-08T21:25:31.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.623+0000 7fcad8e28640 1 -- 172.21.15.53:0/419160408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcad406b700 con 0x7fcad406abf0 2023-12-08T21:25:31.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.679+0000 7fcac2ffd640 1 -- 172.21.15.53:0/419160408 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcac40550b0 con 0x7fcad406abf0 2023-12-08T21:25:31.684 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-12-08T21:25:31.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.683+0000 7fcad8e28640 1 -- 172.21.15.53:0/419160408 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fcab40664c0 msgr2=0x7fcab4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:31.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.683+0000 7fcad8e28640 1 --2- 172.21.15.53:0/419160408 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fcab40664c0 0x7fcab4068980 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009690 tx=0x7fcac8006c00 comp rx=0 tx=0).stop 2023-12-08T21:25:31.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.683+0000 7fcad8e28640 1 -- 172.21.15.53:0/419160408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcad406abf0 msgr2=0x7fcad413f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:31.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.683+0000 7fcad8e28640 1 --2- 172.21.15.53:0/419160408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcad406abf0 0x7fcad413f560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcac400b3e0 tx=0x7fcac400b8a0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.683+0000 7fcad8e28640 1 -- 172.21.15.53:0/419160408 shutdown_connections 2023-12-08T21:25:31.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.683+0000 7fcad8e28640 1 --2- 172.21.15.53:0/419160408 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fcab40664c0 0x7fcab4068980 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.683+0000 7fcad8e28640 1 --2- 172.21.15.53:0/419160408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcad41519b0 0x7fcad413e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.683+0000 7fcad8e28640 1 --2- 172.21.15.53:0/419160408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcad406abf0 0x7fcad413f560 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.683+0000 7fcad8e28640 1 --2- 172.21.15.53:0/419160408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcad406a810 0x7fcad41f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.683+0000 7fcad8e28640 1 -- 172.21.15.53:0/419160408 >> 172.21.15.53:0/419160408 conn(0x7fcad40c7f70 msgr2=0x7fcad413fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:31.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.683+0000 7fcad8e28640 1 -- 172.21.15.53:0/419160408 shutdown_connections 2023-12-08T21:25:31.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.683+0000 7fcad8e28640 1 -- 172.21.15.53:0/419160408 wait complete. 2023-12-08T21:25:31.709 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T21:25:31.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.839+0000 7fef1e66f640 1 Processor -- start 2023-12-08T21:25:31.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.839+0000 7fef1e66f640 1 -- start start 2023-12-08T21:25:31.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.839+0000 7fef1e66f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef18153800 0x7fef180c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:31.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.839+0000 7fef1e66f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef180c3960 0x7fef180cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:31.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.839+0000 7fef1e66f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1806d3e0 con 0x7fef1806b7e0 2023-12-08T21:25:31.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.839+0000 7fef1e66f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef181596a0 con 0x7fef180c3960 2023-12-08T21:25:31.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.839+0000 7fef1e66f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1815a4c0 con 0x7fef18153800 2023-12-08T21:25:31.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.843+0000 7fef177fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef180c3960 0x7fef180cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:31.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.847+0000 7fef177fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef180c3960 0x7fef180cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:44446/0 (socket says 172.21.15.53:44446) 2023-12-08T21:25:31.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.847+0000 7fef177fe640 1 -- 172.21.15.53:0/592426756 learned_addr learned my addr 172.21.15.53:0/592426756 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:31.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.919+0000 7fef17fff640 1 --2- 172.21.15.53:0/592426756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef18153800 0x7fef180c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:31.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.935+0000 7fef17fff640 1 -- 172.21.15.53:0/592426756 >> v2:172.21.15.146:3300/0 conn(0x7fef180c3960 msgr2=0x7fef180cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:31.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.935+0000 7fef17fff640 1 --2- 172.21.15.53:0/592426756 >> v2:172.21.15.146:3300/0 conn(0x7fef180c3960 0x7fef180cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.935+0000 7fef17fff640 1 -- 172.21.15.53:0/592426756 >> v1:172.21.15.146:6789/0 conn(0x7fef1806b7e0 legacy=0x7fef1806be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:31.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.935+0000 7fef17fff640 1 -- 172.21.15.53:0/592426756 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef181598b0 con 0x7fef18153800 2023-12-08T21:25:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.951+0000 7fef17fff640 1 --2- 172.21.15.53:0/592426756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef18153800 0x7fef180c7d20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fef080097f0 tx=0x7fef0801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4d2eeb21520cbb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:31.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.959+0000 7fef16ffd640 1 -- 172.21.15.53:0/592426756 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef080ac640 con 0x7fef18153800 2023-12-08T21:25:31.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.959+0000 7fef16ffd640 1 -- 172.21.15.53:0/592426756 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef080ac7a0 con 0x7fef18153800 2023-12-08T21:25:31.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.959+0000 7fef16ffd640 1 -- 172.21.15.53:0/592426756 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef080acb30 con 0x7fef18153800 2023-12-08T21:25:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.959+0000 7fef1e66f640 1 -- 172.21.15.53:0/592426756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef18153800 msgr2=0x7fef180c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.959+0000 7fef1e66f640 1 --2- 172.21.15.53:0/592426756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef18153800 0x7fef180c7d20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fef080097f0 tx=0x7fef0801c440 comp rx=0 tx=0).stop 2023-12-08T21:25:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.959+0000 7fef1e66f640 1 -- 172.21.15.53:0/592426756 shutdown_connections 2023-12-08T21:25:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.959+0000 7fef1e66f640 1 --2- 172.21.15.53:0/592426756 >> v2:172.21.15.146:3300/0 conn(0x7fef180c3960 0x7fef180cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.959+0000 7fef1e66f640 1 --2- 172.21.15.53:0/592426756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef18153800 0x7fef180c7d20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.959+0000 7fef1e66f640 1 -- 172.21.15.53:0/592426756 >> 172.21.15.53:0/592426756 conn(0x7fef18060fd0 msgr2=0x7fef180613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.959+0000 7fef1e66f640 1 -- 172.21.15.53:0/592426756 shutdown_connections 2023-12-08T21:25:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.959+0000 7fef1e66f640 1 -- 172.21.15.53:0/592426756 wait complete. 2023-12-08T21:25:31.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.963+0000 7fef1e66f640 1 Processor -- start 2023-12-08T21:25:31.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.963+0000 7fef1e66f640 1 -- start start 2023-12-08T21:25:31.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.963+0000 7fef1e66f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef1806b7e0 0x7fef18152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:31.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.963+0000 7fef1e66f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef180c3960 0x7fef1813ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:31.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.963+0000 7fef1e66f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef18153800 0x7fef1814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:31.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.963+0000 7fef1e66f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18152990 con 0x7fef1806b7e0 2023-12-08T21:25:31.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.963+0000 7fef1e66f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18153360 con 0x7fef18153800 2023-12-08T21:25:31.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.963+0000 7fef1e66f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef18157f90 con 0x7fef180c3960 2023-12-08T21:25:31.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.967+0000 7fef17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef1806b7e0 0x7fef18152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:31.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.967+0000 7fef17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef1806b7e0 0x7fef18152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59772/0 (socket says 172.21.15.53:59772) 2023-12-08T21:25:31.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.967+0000 7fef17fff640 1 -- 172.21.15.53:0/2075692893 learned_addr learned my addr 172.21.15.53:0/2075692893 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:31.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.967+0000 7fef177fe640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef180c3960 0x7fef1813ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:31.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.967+0000 7fef1cc0c640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef18153800 0x7fef1814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:31.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.971+0000 7fef17fff640 1 -- 172.21.15.53:0/2075692893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef180c3960 msgr2=0x7fef1813ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:31.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.971+0000 7fef17fff640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef180c3960 0x7fef1813ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.971+0000 7fef17fff640 1 -- 172.21.15.53:0/2075692893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef18153800 msgr2=0x7fef1814c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:31.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.971+0000 7fef17fff640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef18153800 0x7fef1814c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:31.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.971+0000 7fef17fff640 1 -- 172.21.15.53:0/2075692893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef08009420 con 0x7fef1806b7e0 2023-12-08T21:25:31.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.971+0000 7fef17fff640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef1806b7e0 0x7fef18152e20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fef0801aaf0 tx=0x7fef080191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:31.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.975+0000 7fef14ff9640 1 -- 172.21.15.53:0/2075692893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef080b5600 con 0x7fef1806b7e0 2023-12-08T21:25:31.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.975+0000 7fef14ff9640 1 -- 172.21.15.53:0/2075692893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef080b5780 con 0x7fef1806b7e0 2023-12-08T21:25:31.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.975+0000 7fef1e66f640 1 -- 172.21.15.53:0/2075692893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef18152060 con 0x7fef1806b7e0 2023-12-08T21:25:31.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.975+0000 7fef14ff9640 1 -- 172.21.15.53:0/2075692893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef080b5b30 con 0x7fef1806b7e0 2023-12-08T21:25:31.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.975+0000 7fef1e66f640 1 -- 172.21.15.53:0/2075692893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef18152620 con 0x7fef1806b7e0 2023-12-08T21:25:31.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:31.979+0000 7fef1e66f640 1 -- 172.21.15.53:0/2075692893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef18074190 con 0x7fef1806b7e0 2023-12-08T21:25:32.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.283+0000 7fef14ff9640 1 -- 172.21.15.53:0/2075692893 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fef080b3040 con 0x7fef1806b7e0 2023-12-08T21:25:32.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.283+0000 7fef14ff9640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fef040664f0 0x7fef040689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:32.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.287+0000 7fef177fe640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fef040664f0 0x7fef040689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:32.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.287+0000 7fef177fe640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fef040664f0 0x7fef040689b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fef18061790 tx=0x7fef0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:32.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.311+0000 7fef14ff9640 1 -- 172.21.15.53:0/2075692893 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fef080aae20 con 0x7fef1806b7e0 2023-12-08T21:25:32.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.311+0000 7fef14ff9640 1 -- 172.21.15.53:0/2075692893 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef080ebf30 con 0x7fef1806b7e0 2023-12-08T21:25:32.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.495+0000 7fef1e66f640 1 -- 172.21.15.53:0/2075692893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fef18074190 con 0x7fef1806b7e0 2023-12-08T21:25:32.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.503+0000 7fef14ff9640 1 -- 172.21.15.53:0/2075692893 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7fef080b1020 con 0x7fef1806b7e0 2023-12-08T21:25:32.508 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-12-08T21:25:32.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.507+0000 7fef1e66f640 1 -- 172.21.15.53:0/2075692893 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fef040664f0 msgr2=0x7fef040689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:32.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.507+0000 7fef1e66f640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fef040664f0 0x7fef040689b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fef18061790 tx=0x7fef0c008040 comp rx=0 tx=0).stop 2023-12-08T21:25:32.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.507+0000 7fef1e66f640 1 -- 172.21.15.53:0/2075692893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef1806b7e0 msgr2=0x7fef18152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:32.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.507+0000 7fef1e66f640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef1806b7e0 0x7fef18152e20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fef0801aaf0 tx=0x7fef080191e0 comp rx=0 tx=0).stop 2023-12-08T21:25:32.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.507+0000 7fef1e66f640 1 -- 172.21.15.53:0/2075692893 shutdown_connections 2023-12-08T21:25:32.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.507+0000 7fef1e66f640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fef040664f0 0x7fef040689b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:32.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.507+0000 7fef1e66f640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef18153800 0x7fef1814c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:32.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.507+0000 7fef1e66f640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef180c3960 0x7fef1813ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:32.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.507+0000 7fef1e66f640 1 --2- 172.21.15.53:0/2075692893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef1806b7e0 0x7fef18152e20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:32.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.507+0000 7fef1e66f640 1 -- 172.21.15.53:0/2075692893 >> 172.21.15.53:0/2075692893 conn(0x7fef18060fd0 msgr2=0x7fef180c7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:32.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.507+0000 7fef1e66f640 1 -- 172.21.15.53:0/2075692893 shutdown_connections 2023-12-08T21:25:32.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.507+0000 7fef1e66f640 1 -- 172.21.15.53:0/2075692893 wait complete. 2023-12-08T21:25:32.529 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-12-08T21:25:32.529 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T21:25:32.535 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T21:25:32.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.695+0000 7fe1b7627640 1 Processor -- start 2023-12-08T21:25:32.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.695+0000 7fe1b7627640 1 -- start start 2023-12-08T21:25:32.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.695+0000 7fe1b7627640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1b014d020 0x7fe1b00c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:32.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.695+0000 7fe1b7627640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1b0061210 0x7fe1b00c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:32.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.695+0000 7fe1b7627640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b0157110 con 0x7fe1b00c5480 2023-12-08T21:25:32.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.695+0000 7fe1b7627640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b00c48f0 con 0x7fe1b014d020 2023-12-08T21:25:32.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.695+0000 7fe1b7627640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0156240 con 0x7fe1b0061210 2023-12-08T21:25:32.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.695+0000 7fe1b53c3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1b014d020 0x7fe1b00c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:32.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.695+0000 7fe1b4bc2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1b0061210 0x7fe1b00c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:32.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.699+0000 7fe1b4bc2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1b0061210 0x7fe1b00c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:42004/0 (socket says 172.21.15.53:42004) 2023-12-08T21:25:32.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.699+0000 7fe1b4bc2640 1 -- 172.21.15.53:0/931271174 learned_addr learned my addr 172.21.15.53:0/931271174 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:32.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.703+0000 7fe1b4bc2640 1 -- 172.21.15.53:0/931271174 >> v2:172.21.15.146:3300/0 conn(0x7fe1b014d020 msgr2=0x7fe1b00c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:32.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.703+0000 7fe1b4bc2640 1 --2- 172.21.15.53:0/931271174 >> v2:172.21.15.146:3300/0 conn(0x7fe1b014d020 0x7fe1b00c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:32.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.703+0000 7fe1b4bc2640 1 -- 172.21.15.53:0/931271174 >> v1:172.21.15.146:6789/0 conn(0x7fe1b00c5480 legacy=0x7fe1b00c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:32.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.703+0000 7fe1b4bc2640 1 -- 172.21.15.53:0/931271174 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b0156500 con 0x7fe1b0061210 2023-12-08T21:25:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.707+0000 7fe1b4bc2640 1 --2- 172.21.15.53:0/931271174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1b0061210 0x7fe1b00c4f40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009870 tx=0x7fe1a001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22fd4b6e3ad1befc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:32.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.719+0000 7fe1a7fff640 1 -- 172.21.15.53:0/931271174 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00a8a30 con 0x7fe1b0061210 2023-12-08T21:25:32.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.719+0000 7fe1a7fff640 1 -- 172.21.15.53:0/931271174 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a00a8b90 con 0x7fe1b0061210 2023-12-08T21:25:32.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.719+0000 7fe1a7fff640 1 -- 172.21.15.53:0/931271174 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00b0440 con 0x7fe1b0061210 2023-12-08T21:25:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.719+0000 7fe1b7627640 1 -- 172.21.15.53:0/931271174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1b0061210 msgr2=0x7fe1b00c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.719+0000 7fe1b7627640 1 --2- 172.21.15.53:0/931271174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1b0061210 0x7fe1b00c4f40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009870 tx=0x7fe1a001ed30 comp rx=0 tx=0).stop 2023-12-08T21:25:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.719+0000 7fe1b7627640 1 -- 172.21.15.53:0/931271174 shutdown_connections 2023-12-08T21:25:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.719+0000 7fe1b7627640 1 --2- 172.21.15.53:0/931271174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1b0061210 0x7fe1b00c4f40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.719+0000 7fe1b7627640 1 --2- 172.21.15.53:0/931271174 >> v2:172.21.15.146:3300/0 conn(0x7fe1b014d020 0x7fe1b00c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.719+0000 7fe1b7627640 1 -- 172.21.15.53:0/931271174 >> 172.21.15.53:0/931271174 conn(0x7fe1b00c7f70 msgr2=0x7fe1b00c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.719+0000 7fe1b7627640 1 -- 172.21.15.53:0/931271174 shutdown_connections 2023-12-08T21:25:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.719+0000 7fe1b7627640 1 -- 172.21.15.53:0/931271174 wait complete. 2023-12-08T21:25:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.719+0000 7fe1b7627640 1 Processor -- start 2023-12-08T21:25:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.723+0000 7fe1b7627640 1 -- start start 2023-12-08T21:25:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.723+0000 7fe1b7627640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b0061210 0x7fe1b01f0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.723+0000 7fe1b7627640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1b00c5480 0x7fe1b01527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.723+0000 7fe1b7627640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b014d020 0x7fe1b006f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.723+0000 7fe1b7627640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0150f90 con 0x7fe1b0061210 2023-12-08T21:25:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.723+0000 7fe1b7627640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0151250 con 0x7fe1b014d020 2023-12-08T21:25:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.723+0000 7fe1b7627640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0151530 con 0x7fe1b00c5480 2023-12-08T21:25:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.723+0000 7fe1b53c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b0061210 0x7fe1b01f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.723+0000 7fe1b53c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b0061210 0x7fe1b01f0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59778/0 (socket says 172.21.15.53:59778) 2023-12-08T21:25:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.723+0000 7fe1b53c3640 1 -- 172.21.15.53:0/2559756703 learned_addr learned my addr 172.21.15.53:0/2559756703 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.723+0000 7fe1b5bc4640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b014d020 0x7fe1b006f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.723+0000 7fe1b4bc2640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1b00c5480 0x7fe1b01527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.727+0000 7fe1b53c3640 1 -- 172.21.15.53:0/2559756703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1b00c5480 msgr2=0x7fe1b01527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.727+0000 7fe1b53c3640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1b00c5480 0x7fe1b01527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:32.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.727+0000 7fe1b53c3640 1 -- 172.21.15.53:0/2559756703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b014d020 msgr2=0x7fe1b006f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:32.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.727+0000 7fe1b53c3640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b014d020 0x7fe1b006f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:32.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.727+0000 7fe1b53c3640 1 -- 172.21.15.53:0/2559756703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a00094d0 con 0x7fe1b0061210 2023-12-08T21:25:32.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.731+0000 7fe1b53c3640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b0061210 0x7fe1b01f0490 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00e870 tx=0x7fe1ac00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.731+0000 7fe1a5ffb640 1 -- 172.21.15.53:0/2559756703 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac009510 con 0x7fe1b0061210 2023-12-08T21:25:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.731+0000 7fe1a5ffb640 1 -- 172.21.15.53:0/2559756703 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac00eec0 con 0x7fe1b0061210 2023-12-08T21:25:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.735+0000 7fe1b7627640 1 -- 172.21.15.53:0/2559756703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b0151ff0 con 0x7fe1b0061210 2023-12-08T21:25:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.735+0000 7fe1a5ffb640 1 -- 172.21.15.53:0/2559756703 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac00cb40 con 0x7fe1b0061210 2023-12-08T21:25:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.735+0000 7fe1b7627640 1 -- 172.21.15.53:0/2559756703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b014edd0 con 0x7fe1b0061210 2023-12-08T21:25:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:32.735+0000 7fe1b7627640 1 -- 172.21.15.53:0/2559756703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b0074190 con 0x7fe1b0061210 2023-12-08T21:25:33.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.031+0000 7fe1a5ffb640 1 -- 172.21.15.53:0/2559756703 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1ac00cca0 con 0x7fe1b0061210 2023-12-08T21:25:33.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.031+0000 7fe1a5ffb640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe1940664c0 0x7fe194068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:33.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.031+0000 7fe1b4bc2640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe1940664c0 0x7fe194068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:33.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.031+0000 7fe1b4bc2640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe1940664c0 0x7fe194068980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00b2000 tx=0x7fe1a00aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:33.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.067+0000 7fe1a5ffb640 1 -- 172.21.15.53:0/2559756703 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fe1ac055880 con 0x7fe1b0061210 2023-12-08T21:25:33.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.067+0000 7fe1a5ffb640 1 -- 172.21.15.53:0/2559756703 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1ac051bc0 con 0x7fe1b0061210 2023-12-08T21:25:33.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.235+0000 7fe1b7627640 1 -- 172.21.15.53:0/2559756703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1b01516f0 con 0x7fe1b0061210 2023-12-08T21:25:33.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1a5ffb640 1 -- 172.21.15.53:0/2559756703 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18446 (secure 0 0 0) 0x7fe1ac021090 con 0x7fe1b0061210 2023-12-08T21:25:33.315 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:25:33.315 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:59.702174+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T21:25:33.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1b7627640 1 -- 172.21.15.53:0/2559756703 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe1940664c0 msgr2=0x7fe194068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:33.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1b7627640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe1940664c0 0x7fe194068980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00b2000 tx=0x7fe1a00aa070 comp rx=0 tx=0).stop 2023-12-08T21:25:33.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1b7627640 1 -- 172.21.15.53:0/2559756703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b0061210 msgr2=0x7fe1b01f0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:33.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1b7627640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b0061210 0x7fe1b01f0490 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00e870 tx=0x7fe1ac00ec70 comp rx=0 tx=0).stop 2023-12-08T21:25:33.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1b7627640 1 -- 172.21.15.53:0/2559756703 shutdown_connections 2023-12-08T21:25:33.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1b7627640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fe1940664c0 0x7fe194068980 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:33.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1b7627640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b014d020 0x7fe1b006f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:33.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1b7627640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1b00c5480 0x7fe1b01527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:33.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1b7627640 1 --2- 172.21.15.53:0/2559756703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b0061210 0x7fe1b01f0490 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:33.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1b7627640 1 -- 172.21.15.53:0/2559756703 >> 172.21.15.53:0/2559756703 conn(0x7fe1b00c7f70 msgr2=0x7fe1b00c2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:33.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1b7627640 1 -- 172.21.15.53:0/2559756703 shutdown_connections 2023-12-08T21:25:33.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.311+0000 7fe1b7627640 1 -- 172.21.15.53:0/2559756703 wait complete. 2023-12-08T21:25:33.337 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T20:54:13.707275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T20:54:52.929484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T20:54:54.529440+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T20:55:01.908380+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T21:25:33.338 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T21:25:33.435 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:25:33.438 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:25:33.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.455+0000 7f97617b3640 1 Processor -- start 2023-12-08T21:25:33.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.455+0000 7f97617b3640 1 -- start start 2023-12-08T21:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.455+0000 7f97617b3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f975c0c1910 0x7f975c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.455+0000 7f97617b3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f975c0c1cf0 0x7f975c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.455+0000 7f97617b3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f975c0c6410 0x7f975c156240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.459+0000 7f97617b3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c0c01a0 con 0x7f975c0c6410 2023-12-08T21:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.459+0000 7f97617b3640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c156780 con 0x7f975c0c1cf0 2023-12-08T21:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.459+0000 7f97617b3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c06f3a0 con 0x7f975c0c1910 2023-12-08T21:25:33.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.475+0000 7f975b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f975c0c6410 0x7f975c156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:33.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.475+0000 7f975b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f975c0c6410 0x7f975c156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59794/0 (socket says 172.21.15.53:59794) 2023-12-08T21:25:33.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.475+0000 7f975b7fe640 1 -- 172.21.15.53:0/3185038026 learned_addr learned my addr 172.21.15.53:0/3185038026 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.479+0000 7f975b7fe640 1 -- 172.21.15.53:0/3185038026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f975c0c1910 msgr2=0x7f975c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.479+0000 7f975b7fe640 1 --2- 172.21.15.53:0/3185038026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f975c0c1910 0x7f975c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.479+0000 7f975b7fe640 1 -- 172.21.15.53:0/3185038026 >> v2:172.21.15.146:3300/0 conn(0x7f975c0c1cf0 msgr2=0x7f975c06e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.479+0000 7f975b7fe640 1 --2- 172.21.15.53:0/3185038026 >> v2:172.21.15.146:3300/0 conn(0x7f975c0c1cf0 0x7f975c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.479+0000 7f975b7fe640 1 -- 172.21.15.53:0/3185038026 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c06ede0 con 0x7f975c0c6410 2023-12-08T21:25:33.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.483+0000 7f975b7fe640 1 --2- 172.21.15.53:0/3185038026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c0c6410 0x7f975c156240 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f975c0cbfb0 tx=0x7f975401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6673dd5a67c4fcff server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:33.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.487+0000 7f9759ffb640 1 -- 172.21.15.53:0/3185038026 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540aa5f0 con 0x7f975c0c6410 2023-12-08T21:25:33.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.487+0000 7f9759ffb640 1 -- 172.21.15.53:0/3185038026 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97540aa750 con 0x7f975c0c6410 2023-12-08T21:25:33.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.487+0000 7f9759ffb640 1 -- 172.21.15.53:0/3185038026 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540aaae0 con 0x7f975c0c6410 2023-12-08T21:25:33.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.487+0000 7f97617b3640 1 -- 172.21.15.53:0/3185038026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c0c6410 msgr2=0x7f975c156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:33.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.487+0000 7f97617b3640 1 --2- 172.21.15.53:0/3185038026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c0c6410 0x7f975c156240 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f975c0cbfb0 tx=0x7f975401c4d0 comp rx=0 tx=0).stop 2023-12-08T21:25:33.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.487+0000 7f97617b3640 1 -- 172.21.15.53:0/3185038026 shutdown_connections 2023-12-08T21:25:33.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.487+0000 7f97617b3640 1 --2- 172.21.15.53:0/3185038026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c0c6410 0x7f975c156240 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:33.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.487+0000 7f97617b3640 1 --2- 172.21.15.53:0/3185038026 >> v2:172.21.15.146:3300/0 conn(0x7f975c0c1cf0 0x7f975c06e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:33.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.487+0000 7f97617b3640 1 --2- 172.21.15.53:0/3185038026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f975c0c1910 0x7f975c15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:33.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.487+0000 7f97617b3640 1 -- 172.21.15.53:0/3185038026 >> 172.21.15.53:0/3185038026 conn(0x7f975c0caef0 msgr2=0x7f975c0cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:33.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.487+0000 7f97617b3640 1 -- 172.21.15.53:0/3185038026 shutdown_connections 2023-12-08T21:25:33.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.487+0000 7f97617b3640 1 -- 172.21.15.53:0/3185038026 wait complete. 2023-12-08T21:25:33.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.491+0000 7f97617b3640 1 Processor -- start 2023-12-08T21:25:33.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.491+0000 7f97617b3640 1 -- start start 2023-12-08T21:25:33.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.491+0000 7f97617b3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c0c1910 0x7f975c0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:33.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.491+0000 7f97617b3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f975c0c1cf0 0x7f975c144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:33.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.491+0000 7f97617b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c0c6410 0x7f975c13db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:33.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.491+0000 7f97617b3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c1436f0 con 0x7f975c0c6410 2023-12-08T21:25:33.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.491+0000 7f97617b3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c157ae0 con 0x7f975c0c1910 2023-12-08T21:25:33.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.491+0000 7f97617b3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c1f65a0 con 0x7f975c0c1cf0 2023-12-08T21:25:33.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.491+0000 7f975b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c0c6410 0x7f975c13db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:33.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.491+0000 7f975b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c0c6410 0x7f975c13db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59802/0 (socket says 172.21.15.53:59802) 2023-12-08T21:25:33.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.491+0000 7f975b7fe640 1 -- 172.21.15.53:0/3328439375 learned_addr learned my addr 172.21.15.53:0/3328439375 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.495+0000 7f975b7fe640 1 -- 172.21.15.53:0/3328439375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f975c0c1cf0 msgr2=0x7f975c144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.495+0000 7f975b7fe640 1 --2- 172.21.15.53:0/3328439375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f975c0c1cf0 0x7f975c144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.495+0000 7f975b7fe640 1 -- 172.21.15.53:0/3328439375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c0c1910 msgr2=0x7f975c0c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.495+0000 7f975b7fe640 1 --2- 172.21.15.53:0/3328439375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c0c1910 0x7f975c0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.495+0000 7f975b7fe640 1 -- 172.21.15.53:0/3328439375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97540094d0 con 0x7f975c0c6410 2023-12-08T21:25:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.499+0000 7f975b7fe640 1 --2- 172.21.15.53:0/3328439375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c0c6410 0x7f975c13db30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f975401ab80 tx=0x7f975401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:33.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.503+0000 7f97537fe640 1 -- 172.21.15.53:0/3328439375 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540b3800 con 0x7f975c0c6410 2023-12-08T21:25:33.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.503+0000 7f97537fe640 1 -- 172.21.15.53:0/3328439375 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97540b3960 con 0x7f975c0c6410 2023-12-08T21:25:33.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.503+0000 7f97537fe640 1 -- 172.21.15.53:0/3328439375 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540b3cf0 con 0x7f975c0c6410 2023-12-08T21:25:33.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.503+0000 7f97617b3640 1 -- 172.21.15.53:0/3328439375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c15f6a0 con 0x7f975c0c6410 2023-12-08T21:25:33.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.503+0000 7f97617b3640 1 -- 172.21.15.53:0/3328439375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c157e70 con 0x7f975c0c6410 2023-12-08T21:25:33.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.503+0000 7f97617b3640 1 -- 172.21.15.53:0/3328439375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c0675b0 con 0x7f975c0c6410 2023-12-08T21:25:33.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.799+0000 7f97537fe640 1 -- 172.21.15.53:0/3328439375 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97540c6380 con 0x7f975c0c6410 2023-12-08T21:25:33.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.799+0000 7f97537fe640 1 --2- 172.21.15.53:0/3328439375 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f973c066470 0x7f973c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:33.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.799+0000 7f975affd640 1 --2- 172.21.15.53:0/3328439375 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f973c066470 0x7f973c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:33.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.803+0000 7f975affd640 1 --2- 172.21.15.53:0/3328439375 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f973c066470 0x7f973c068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f974c00ab90 tx=0x7f974c009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:33.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.839+0000 7f97537fe640 1 -- 172.21.15.53:0/3328439375 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f97540a7070 con 0x7f975c0c6410 2023-12-08T21:25:33.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:33.839+0000 7f97537fe640 1 -- 172.21.15.53:0/3328439375 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97540ebb10 con 0x7f975c0c6410 2023-12-08T21:25:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.023+0000 7f97617b3640 1 -- 172.21.15.53:0/3328439375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f975c141790 con 0x7f975c0c6410 2023-12-08T21:25:34.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.035+0000 7f97537fe640 1 -- 172.21.15.53:0/3328439375 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97540c3020 con 0x7f975c0c6410 2023-12-08T21:25:34.039 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-12-08T21:25:34.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.039+0000 7f97617b3640 1 -- 172.21.15.53:0/3328439375 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f973c066470 msgr2=0x7f973c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:34.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.039+0000 7f97617b3640 1 --2- 172.21.15.53:0/3328439375 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f973c066470 0x7f973c068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f974c00ab90 tx=0x7f974c009250 comp rx=0 tx=0).stop 2023-12-08T21:25:34.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.039+0000 7f97617b3640 1 -- 172.21.15.53:0/3328439375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c0c6410 msgr2=0x7f975c13db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:34.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.039+0000 7f97617b3640 1 --2- 172.21.15.53:0/3328439375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c0c6410 0x7f975c13db30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f975401ab80 tx=0x7f975401ad10 comp rx=0 tx=0).stop 2023-12-08T21:25:34.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.039+0000 7f97617b3640 1 -- 172.21.15.53:0/3328439375 shutdown_connections 2023-12-08T21:25:34.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.039+0000 7f97617b3640 1 --2- 172.21.15.53:0/3328439375 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f973c066470 0x7f973c068930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.039+0000 7f97617b3640 1 --2- 172.21.15.53:0/3328439375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c0c6410 0x7f975c13db30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.039+0000 7f97617b3640 1 --2- 172.21.15.53:0/3328439375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f975c0c1cf0 0x7f975c144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.039+0000 7f97617b3640 1 --2- 172.21.15.53:0/3328439375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c0c1910 0x7f975c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.039+0000 7f97617b3640 1 -- 172.21.15.53:0/3328439375 >> 172.21.15.53:0/3328439375 conn(0x7f975c0caef0 msgr2=0x7f975c06e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:34.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.039+0000 7f97617b3640 1 -- 172.21.15.53:0/3328439375 shutdown_connections 2023-12-08T21:25:34.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.039+0000 7f97617b3640 1 -- 172.21.15.53:0/3328439375 wait complete. 2023-12-08T21:25:34.060 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T21:25:34.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.227+0000 7fa84ec16640 1 Processor -- start 2023-12-08T21:25:34.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.227+0000 7fa84ec16640 1 -- start start 2023-12-08T21:25:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.227+0000 7fa84ec16640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84806ed30 0x7fa8480c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.227+0000 7fa84ec16640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa848157e90 con 0x7fa84806f110 2023-12-08T21:25:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.227+0000 7fa84ec16640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa848158170 con 0x7fa848071140 2023-12-08T21:25:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.227+0000 7fa84ec16640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84815a920 con 0x7fa84806ed30 2023-12-08T21:25:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.231+0000 7fa847fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa84806f110 0x7fa84806d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55220/0 (socket says 172.21.15.53:55220) 2023-12-08T21:25:34.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.231+0000 7fa847fff640 1 -- 172.21.15.53:0/752764471 learned_addr learned my addr 172.21.15.53:0/752764471 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:34.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.231+0000 7fa84c9b2640 1 --2- 172.21.15.53:0/752764471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84806ed30 0x7fa8480c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:34.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.231+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937704210 0 0) 0x7fa848157e90 con 0x7fa84806f110 2023-12-08T21:25:34.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.231+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa838003530 con 0x7fa84806f110 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2529484788 0 0) 0x7fa838003530 con 0x7fa84806f110 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84806ed30 msgr2=0x7fa8480c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 --2- 172.21.15.53:0/752764471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84806ed30 0x7fa8480c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 >> v1:172.21.15.146:6789/0 conn(0x7fa848071140 legacy=0x7fa848157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84815ac00 con 0x7fa84806f110 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 149952835 0 0) 0x7fa834001680 con 0x7fa84806f110 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 >> v1:172.21.15.53:6789/0 conn(0x7fa84806f110 legacy=0x7fa84806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 --2- 172.21.15.53:0/752764471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8380039b0 0x7fa838003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 --2- 172.21.15.53:0/752764471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84806ed30 0x7fa8380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 --2- 172.21.15.53:0/752764471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa838004d10 0x7fa838005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84815a920 con 0x7fa838004d10 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83800ff10 con 0x7fa8380039b0 2023-12-08T21:25:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.235+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380100d0 con 0x7fa84806ed30 2023-12-08T21:25:34.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.239+0000 7fa84d1b3640 1 --2- 172.21.15.53:0/752764471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa838004d10 0x7fa838005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.243+0000 7fa84c9b2640 1 --2- 172.21.15.53:0/752764471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8380039b0 0x7fa838003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.243+0000 7fa847fff640 1 --2- 172.21.15.53:0/752764471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84806ed30 0x7fa8380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.243+0000 7fa84d1b3640 1 -- 172.21.15.53:0/752764471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84806ed30 msgr2=0x7fa8380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.243+0000 7fa84d1b3640 1 --2- 172.21.15.53:0/752764471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84806ed30 0x7fa8380047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.243+0000 7fa84d1b3640 1 -- 172.21.15.53:0/752764471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8380039b0 msgr2=0x7fa838003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.243+0000 7fa84d1b3640 1 --2- 172.21.15.53:0/752764471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8380039b0 0x7fa838003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.243+0000 7fa84d1b3640 1 -- 172.21.15.53:0/752764471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa838003530 con 0x7fa838004d10 2023-12-08T21:25:34.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.247+0000 7fa84d1b3640 1 --2- 172.21.15.53:0/752764471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa838004d10 0x7fa838005190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa840001e40 tx=0x7fa84001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7f9d60d46e8e23 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.251+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840003b80 con 0x7fa838004d10 2023-12-08T21:25:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.251+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa840003ce0 con 0x7fa838004d10 2023-12-08T21:25:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.251+0000 7fa8477fe640 1 -- 172.21.15.53:0/752764471 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8400052c0 con 0x7fa838004d10 2023-12-08T21:25:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.251+0000 7fa84ec16640 1 -- 172.21.15.53:0/752764471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa838004d10 msgr2=0x7fa838005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.251+0000 7fa84ec16640 1 --2- 172.21.15.53:0/752764471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa838004d10 0x7fa838005190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa840001e40 tx=0x7fa84001c740 comp rx=0 tx=0).stop 2023-12-08T21:25:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.251+0000 7fa84d1b3640 1 -- 172.21.15.53:0/752764471 reap_dead start 2023-12-08T21:25:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.251+0000 7fa84ec16640 1 -- 172.21.15.53:0/752764471 shutdown_connections 2023-12-08T21:25:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.251+0000 7fa84ec16640 1 -- 172.21.15.53:0/752764471 >> 172.21.15.53:0/752764471 conn(0x7fa8480caef0 msgr2=0x7fa8480cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.251+0000 7fa84ec16640 1 -- 172.21.15.53:0/752764471 shutdown_connections 2023-12-08T21:25:34.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.251+0000 7fa84ec16640 1 -- 172.21.15.53:0/752764471 wait complete. 2023-12-08T21:25:34.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa84ec16640 1 Processor -- start 2023-12-08T21:25:34.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa84ec16640 1 -- start start 2023-12-08T21:25:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa84ec16640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa838004d10 0x7fa8480c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa84ec16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84806cbf0 0x7fa8481393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa84ec16640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa848139900 0x7fa8481edc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa84ec16640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480c3830 con 0x7fa84806cbf0 2023-12-08T21:25:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa84ec16640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa848138820 con 0x7fa838004d10 2023-12-08T21:25:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa84ec16640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa848138f30 con 0x7fa848139900 2023-12-08T21:25:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa847fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84806cbf0 0x7fa8481393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa847fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84806cbf0 0x7fa8481393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59816/0 (socket says 172.21.15.53:59816) 2023-12-08T21:25:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa847fff640 1 -- 172.21.15.53:0/3092590232 learned_addr learned my addr 172.21.15.53:0/3092590232 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:34.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa84d1b3640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa848139900 0x7fa8481edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:34.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.255+0000 7fa84c9b2640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa838004d10 0x7fa8480c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:34.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.259+0000 7fa847fff640 1 -- 172.21.15.53:0/3092590232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa848139900 msgr2=0x7fa8481edc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:34.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.259+0000 7fa847fff640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa848139900 0x7fa8481edc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.259+0000 7fa847fff640 1 -- 172.21.15.53:0/3092590232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa838004d10 msgr2=0x7fa8480c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:34.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.259+0000 7fa847fff640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa838004d10 0x7fa8480c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.259+0000 7fa847fff640 1 -- 172.21.15.53:0/3092590232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480c33f0 con 0x7fa84806cbf0 2023-12-08T21:25:34.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.263+0000 7fa847fff640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84806cbf0 0x7fa8481393c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa83400d7d0 tx=0x7fa83400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:34.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.267+0000 7fa8457fa640 1 -- 172.21.15.53:0/3092590232 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340074e0 con 0x7fa84806cbf0 2023-12-08T21:25:34.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.267+0000 7fa8457fa640 1 -- 172.21.15.53:0/3092590232 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa834007640 con 0x7fa84806cbf0 2023-12-08T21:25:34.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.267+0000 7fa8457fa640 1 -- 172.21.15.53:0/3092590232 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340049f0 con 0x7fa84806cbf0 2023-12-08T21:25:34.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.267+0000 7fa84ec16640 1 -- 172.21.15.53:0/3092590232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa848136420 con 0x7fa84806cbf0 2023-12-08T21:25:34.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.267+0000 7fa84ec16640 1 -- 172.21.15.53:0/3092590232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa848158450 con 0x7fa84806cbf0 2023-12-08T21:25:34.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.267+0000 7fa84ec16640 1 -- 172.21.15.53:0/3092590232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8480675b0 con 0x7fa84806cbf0 2023-12-08T21:25:34.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.575+0000 7fa8457fa640 1 -- 172.21.15.53:0/3092590232 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa834004b50 con 0x7fa84806cbf0 2023-12-08T21:25:34.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.575+0000 7fa8457fa640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa82c0664c0 0x7fa82c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:34.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.575+0000 7fa84c9b2640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa82c0664c0 0x7fa82c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:34.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.575+0000 7fa84c9b2640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa82c0664c0 0x7fa82c068980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009ae0 tx=0x7fa83c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:34.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.611+0000 7fa8457fa640 1 -- 172.21.15.53:0/3092590232 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fa834055420 con 0x7fa84806cbf0 2023-12-08T21:25:34.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.611+0000 7fa8457fa640 1 -- 172.21.15.53:0/3092590232 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa834051760 con 0x7fa84806cbf0 2023-12-08T21:25:34.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.803+0000 7fa84ec16640 1 -- 172.21.15.53:0/3092590232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa848138d00 con 0x7fa84806cbf0 2023-12-08T21:25:34.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.835+0000 7fa8457fa640 1 -- 172.21.15.53:0/3092590232 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8340230a0 con 0x7fa84806cbf0 2023-12-08T21:25:34.840 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-12-08T21:25:34.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.839+0000 7fa84ec16640 1 -- 172.21.15.53:0/3092590232 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa82c0664c0 msgr2=0x7fa82c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:34.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.839+0000 7fa84ec16640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa82c0664c0 0x7fa82c068980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009ae0 tx=0x7fa83c008040 comp rx=0 tx=0).stop 2023-12-08T21:25:34.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.839+0000 7fa84ec16640 1 -- 172.21.15.53:0/3092590232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84806cbf0 msgr2=0x7fa8481393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:34.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.839+0000 7fa84ec16640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84806cbf0 0x7fa8481393c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa83400d7d0 tx=0x7fa83400dc90 comp rx=0 tx=0).stop 2023-12-08T21:25:34.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.839+0000 7fa84ec16640 1 -- 172.21.15.53:0/3092590232 shutdown_connections 2023-12-08T21:25:34.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.839+0000 7fa84ec16640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fa82c0664c0 0x7fa82c068980 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.839+0000 7fa84ec16640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa848139900 0x7fa8481edc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.839+0000 7fa84ec16640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84806cbf0 0x7fa8481393c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.839+0000 7fa84ec16640 1 --2- 172.21.15.53:0/3092590232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa838004d10 0x7fa8480c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.839+0000 7fa84ec16640 1 -- 172.21.15.53:0/3092590232 >> 172.21.15.53:0/3092590232 conn(0x7fa8480caef0 msgr2=0x7fa8480c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:34.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.839+0000 7fa84ec16640 1 -- 172.21.15.53:0/3092590232 shutdown_connections 2023-12-08T21:25:34.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.839+0000 7fa84ec16640 1 -- 172.21.15.53:0/3092590232 wait complete. 2023-12-08T21:25:34.864 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T21:25:34.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.983+0000 7fd69cba1640 1 Processor -- start 2023-12-08T21:25:34.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.983+0000 7fd69cba1640 1 -- start start 2023-12-08T21:25:34.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.987+0000 7fd69cba1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6980c1910 0x7fd69815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:34.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.987+0000 7fd69cba1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd6980c6410 0x7fd69806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:34.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.987+0000 7fd69cba1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6980c01a0 con 0x7fd6980c1cf0 2023-12-08T21:25:34.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.987+0000 7fd69cba1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69806f3a0 con 0x7fd6980c6410 2023-12-08T21:25:34.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.987+0000 7fd69cba1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69806ede0 con 0x7fd6980c1910 2023-12-08T21:25:34.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.987+0000 7fd696d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd6980c6410 0x7fd69806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:34.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.987+0000 7fd696d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd6980c6410 0x7fd69806e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59820/0 (socket says 172.21.15.53:59820) 2023-12-08T21:25:34.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.987+0000 7fd696d9d640 1 -- 172.21.15.53:0/2356382043 learned_addr learned my addr 172.21.15.53:0/2356382043 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.991+0000 7fd696d9d640 1 -- 172.21.15.53:0/2356382043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6980c1910 msgr2=0x7fd69815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.991+0000 7fd696d9d640 1 --2- 172.21.15.53:0/2356382043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6980c1910 0x7fd69815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.991+0000 7fd696d9d640 1 -- 172.21.15.53:0/2356382043 >> v1:172.21.15.146:6789/0 conn(0x7fd6980c1cf0 legacy=0x7fd69814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.991+0000 7fd696d9d640 1 -- 172.21.15.53:0/2356382043 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69806f0c0 con 0x7fd6980c6410 2023-12-08T21:25:34.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.995+0000 7fd696d9d640 1 --2- 172.21.15.53:0/2356382043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980c6410 0x7fd69806e7a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd690009870 tx=0x7fd69001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c74af5f6f79f58a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:35.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69559a640 1 -- 172.21.15.53:0/2356382043 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6900aa5f0 con 0x7fd6980c6410 2023-12-08T21:25:35.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69559a640 1 -- 172.21.15.53:0/2356382043 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6900aa750 con 0x7fd6980c6410 2023-12-08T21:25:35.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69559a640 1 -- 172.21.15.53:0/2356382043 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6900aaae0 con 0x7fd6980c6410 2023-12-08T21:25:35.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69cba1640 1 -- 172.21.15.53:0/2356382043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980c6410 msgr2=0x7fd69806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:35.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69cba1640 1 --2- 172.21.15.53:0/2356382043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980c6410 0x7fd69806e7a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd690009870 tx=0x7fd69001c4d0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69cba1640 1 -- 172.21.15.53:0/2356382043 shutdown_connections 2023-12-08T21:25:35.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69cba1640 1 --2- 172.21.15.53:0/2356382043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980c6410 0x7fd69806e7a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69cba1640 1 --2- 172.21.15.53:0/2356382043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6980c1910 0x7fd69815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69cba1640 1 -- 172.21.15.53:0/2356382043 >> 172.21.15.53:0/2356382043 conn(0x7fd6980caef0 msgr2=0x7fd6980cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:35.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69cba1640 1 -- 172.21.15.53:0/2356382043 shutdown_connections 2023-12-08T21:25:35.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69cba1640 1 -- 172.21.15.53:0/2356382043 wait complete. 2023-12-08T21:25:35.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69cba1640 1 Processor -- start 2023-12-08T21:25:35.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:34.999+0000 7fd69cba1640 1 -- start start 2023-12-08T21:25:35.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.003+0000 7fd69cba1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980c1910 0x7fd6981589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:35.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.003+0000 7fd69cba1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6980c1cf0 0x7fd6981f2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:35.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.003+0000 7fd69cba1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6980c6410 0x7fd6981f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:35.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.003+0000 7fd69cba1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6981455f0 con 0x7fd6980c1910 2023-12-08T21:25:35.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.003+0000 7fd69cba1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6981f5cc0 con 0x7fd6980c6410 2023-12-08T21:25:35.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.003+0000 7fd69cba1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6981f5fa0 con 0x7fd6980c1cf0 2023-12-08T21:25:35.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.003+0000 7fd69659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980c1910 0x7fd6981589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:35.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.003+0000 7fd69659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980c1910 0x7fd6981589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59826/0 (socket says 172.21.15.53:59826) 2023-12-08T21:25:35.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.003+0000 7fd69659c640 1 -- 172.21.15.53:0/3326000513 learned_addr learned my addr 172.21.15.53:0/3326000513 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:35.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.007+0000 7fd69659c640 1 -- 172.21.15.53:0/3326000513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6980c1cf0 msgr2=0x7fd6981f2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:35.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.007+0000 7fd69659c640 1 --2- 172.21.15.53:0/3326000513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6980c1cf0 0x7fd6981f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.007+0000 7fd69659c640 1 -- 172.21.15.53:0/3326000513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6980c6410 msgr2=0x7fd6981f2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:35.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.007+0000 7fd69659c640 1 --2- 172.21.15.53:0/3326000513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6980c6410 0x7fd6981f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.007+0000 7fd69659c640 1 -- 172.21.15.53:0/3326000513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6900094d0 con 0x7fd6980c1910 2023-12-08T21:25:35.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.007+0000 7fd69659c640 1 --2- 172.21.15.53:0/3326000513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980c1910 0x7fd6981589f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd68800b550 tx=0x7fd68800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:35.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.011+0000 7fd686ffd640 1 -- 172.21.15.53:0/3326000513 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688011890 con 0x7fd6980c1910 2023-12-08T21:25:35.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.015+0000 7fd686ffd640 1 -- 172.21.15.53:0/3326000513 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd688011a10 con 0x7fd6980c1910 2023-12-08T21:25:35.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.015+0000 7fd69cba1640 1 -- 172.21.15.53:0/3326000513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6981f6280 con 0x7fd6980c1910 2023-12-08T21:25:35.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.015+0000 7fd686ffd640 1 -- 172.21.15.53:0/3326000513 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688011dc0 con 0x7fd6980c1910 2023-12-08T21:25:35.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.015+0000 7fd69cba1640 1 -- 172.21.15.53:0/3326000513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6981f6840 con 0x7fd6980c1910 2023-12-08T21:25:35.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.015+0000 7fd69cba1640 1 -- 172.21.15.53:0/3326000513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6981f6a60 con 0x7fd6980c1910 2023-12-08T21:25:35.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.307+0000 7fd686ffd640 1 -- 172.21.15.53:0/3326000513 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd68801a400 con 0x7fd6980c1910 2023-12-08T21:25:35.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.307+0000 7fd686ffd640 1 --2- 172.21.15.53:0/3326000513 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd6780664c0 0x7fd678068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:35.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.311+0000 7fd695d9b640 1 --2- 172.21.15.53:0/3326000513 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd6780664c0 0x7fd678068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:35.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.311+0000 7fd695d9b640 1 --2- 172.21.15.53:0/3326000513 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd6780664c0 0x7fd678068980 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd698155da0 tx=0x7fd68c007d20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:35.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.343+0000 7fd686ffd640 1 -- 172.21.15.53:0/3326000513 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fd6880560d0 con 0x7fd6980c1910 2023-12-08T21:25:35.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.347+0000 7fd686ffd640 1 -- 172.21.15.53:0/3326000513 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd688051d10 con 0x7fd6980c1910 2023-12-08T21:25:35.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.523+0000 7fd69cba1640 1 -- 172.21.15.53:0/3326000513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6980675b0 con 0x7fd6980c1910 2023-12-08T21:25:35.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.535+0000 7fd686ffd640 1 -- 172.21.15.53:0/3326000513 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd688015020 con 0x7fd6980c1910 2023-12-08T21:25:35.541 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-12-08T21:25:35.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.539+0000 7fd69cba1640 1 -- 172.21.15.53:0/3326000513 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd6780664c0 msgr2=0x7fd678068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:35.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.539+0000 7fd69cba1640 1 --2- 172.21.15.53:0/3326000513 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd6780664c0 0x7fd678068980 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd698155da0 tx=0x7fd68c007d20 comp rx=0 tx=0).stop 2023-12-08T21:25:35.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.539+0000 7fd69cba1640 1 -- 172.21.15.53:0/3326000513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980c1910 msgr2=0x7fd6981589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:35.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.539+0000 7fd69cba1640 1 --2- 172.21.15.53:0/3326000513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980c1910 0x7fd6981589f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd68800b550 tx=0x7fd68800ba10 comp rx=0 tx=0).stop 2023-12-08T21:25:35.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.539+0000 7fd69cba1640 1 -- 172.21.15.53:0/3326000513 shutdown_connections 2023-12-08T21:25:35.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.539+0000 7fd69cba1640 1 --2- 172.21.15.53:0/3326000513 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fd6780664c0 0x7fd678068980 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.539+0000 7fd69cba1640 1 --2- 172.21.15.53:0/3326000513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6980c6410 0x7fd6981f2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.539+0000 7fd69cba1640 1 --2- 172.21.15.53:0/3326000513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6980c1cf0 0x7fd6981f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.539+0000 7fd69cba1640 1 --2- 172.21.15.53:0/3326000513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6980c1910 0x7fd6981589f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.539+0000 7fd69cba1640 1 -- 172.21.15.53:0/3326000513 >> 172.21.15.53:0/3326000513 conn(0x7fd6980caef0 msgr2=0x7fd6981470b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:35.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.539+0000 7fd69cba1640 1 -- 172.21.15.53:0/3326000513 shutdown_connections 2023-12-08T21:25:35.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.539+0000 7fd69cba1640 1 -- 172.21.15.53:0/3326000513 wait complete. 2023-12-08T21:25:35.563 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T21:25:35.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.679+0000 7f71f29f6640 1 Processor -- start 2023-12-08T21:25:35.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.679+0000 7f71f29f6640 1 -- start start 2023-12-08T21:25:35.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.679+0000 7f71f29f6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71ec0cd350 0x7f71ec06f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:35.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.679+0000 7f71f29f6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71ec157d90 0x7f71ec0c8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:35.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.679+0000 7f71f29f6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ec0c2d20 con 0x7f71ec0cd730 2023-12-08T21:25:35.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.679+0000 7f71f29f6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ec0c7b80 con 0x7f71ec157d90 2023-12-08T21:25:35.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.679+0000 7f71f29f6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec06f920 con 0x7f71ec0cd350 2023-12-08T21:25:35.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.683+0000 7f71f0f93640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71ec157d90 0x7f71ec0c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:35.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.683+0000 7f71ebfff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71ec0cd350 0x7f71ec06f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:35.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.683+0000 7f71ebfff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71ec0cd350 0x7f71ec06f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:42080/0 (socket says 172.21.15.53:42080) 2023-12-08T21:25:35.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.683+0000 7f71ebfff640 1 -- 172.21.15.53:0/2500138046 learned_addr learned my addr 172.21.15.53:0/2500138046 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:35.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.687+0000 7f71ebfff640 1 -- 172.21.15.53:0/2500138046 >> v2:172.21.15.146:3300/0 conn(0x7f71ec157d90 msgr2=0x7f71ec0c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:35.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.687+0000 7f71ebfff640 1 --2- 172.21.15.53:0/2500138046 >> v2:172.21.15.146:3300/0 conn(0x7f71ec157d90 0x7f71ec0c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.687+0000 7f71ebfff640 1 -- 172.21.15.53:0/2500138046 >> v1:172.21.15.146:6789/0 conn(0x7f71ec0cd730 legacy=0x7f71ec151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:35.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.687+0000 7f71ebfff640 1 -- 172.21.15.53:0/2500138046 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec158240 con 0x7f71ec0cd350 2023-12-08T21:25:35.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.695+0000 7f71ebfff640 1 --2- 172.21.15.53:0/2500138046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71ec0cd350 0x7f71ec06f330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009870 tx=0x7f71dc01ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3db46e9b2af0352 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.851+0000 7f71eaffd640 1 -- 172.21.15.53:0/2500138046 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0a89b0 con 0x7f71ec0cd350 2023-12-08T21:25:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.851+0000 7f71eaffd640 1 -- 172.21.15.53:0/2500138046 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc0a8b10 con 0x7f71ec0cd350 2023-12-08T21:25:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.851+0000 7f71eaffd640 1 -- 172.21.15.53:0/2500138046 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0a8ea0 con 0x7f71ec0cd350 2023-12-08T21:25:35.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.851+0000 7f71f29f6640 1 -- 172.21.15.53:0/2500138046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71ec0cd350 msgr2=0x7f71ec06f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:35.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.851+0000 7f71f29f6640 1 --2- 172.21.15.53:0/2500138046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71ec0cd350 0x7f71ec06f330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009870 tx=0x7f71dc01ecf0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.851+0000 7f71f29f6640 1 -- 172.21.15.53:0/2500138046 shutdown_connections 2023-12-08T21:25:35.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.851+0000 7f71f29f6640 1 --2- 172.21.15.53:0/2500138046 >> v2:172.21.15.146:3300/0 conn(0x7f71ec157d90 0x7f71ec0c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.851+0000 7f71f29f6640 1 --2- 172.21.15.53:0/2500138046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71ec0cd350 0x7f71ec06f330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.851+0000 7f71f29f6640 1 -- 172.21.15.53:0/2500138046 >> 172.21.15.53:0/2500138046 conn(0x7f71ec0611a0 msgr2=0x7f71ec0615b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:35.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.851+0000 7f71f29f6640 1 -- 172.21.15.53:0/2500138046 shutdown_connections 2023-12-08T21:25:35.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.851+0000 7f71f29f6640 1 -- 172.21.15.53:0/2500138046 wait complete. 2023-12-08T21:25:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.855+0000 7f71f29f6640 1 Processor -- start 2023-12-08T21:25:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.855+0000 7f71f29f6640 1 -- start start 2023-12-08T21:25:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.855+0000 7f71f29f6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71ec0cd350 0x7f71ec1ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.855+0000 7f71f29f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ec0cd730 0x7f71ec13d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.855+0000 7f71f29f6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec157d90 0x7f71ec142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.855+0000 7f71f29f6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec1ed1d0 con 0x7f71ec0cd730 2023-12-08T21:25:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.855+0000 7f71f29f6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec1f1140 con 0x7f71ec157d90 2023-12-08T21:25:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.855+0000 7f71f29f6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec1f0be0 con 0x7f71ec0cd350 2023-12-08T21:25:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.855+0000 7f71eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ec0cd730 0x7f71ec13d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.855+0000 7f71eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ec0cd730 0x7f71ec13d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59828/0 (socket says 172.21.15.53:59828) 2023-12-08T21:25:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.855+0000 7f71eb7fe640 1 -- 172.21.15.53:0/957371772 learned_addr learned my addr 172.21.15.53:0/957371772 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.855+0000 7f71f0f93640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec157d90 0x7f71ec142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:35.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.859+0000 7f71ebfff640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71ec0cd350 0x7f71ec1ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:35.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.859+0000 7f71eb7fe640 1 -- 172.21.15.53:0/957371772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71ec0cd350 msgr2=0x7f71ec1ecc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:35.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.859+0000 7f71eb7fe640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71ec0cd350 0x7f71ec1ecc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.859+0000 7f71eb7fe640 1 -- 172.21.15.53:0/957371772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec157d90 msgr2=0x7f71ec142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:35.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.859+0000 7f71eb7fe640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec157d90 0x7f71ec142770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:35.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.859+0000 7f71eb7fe640 1 -- 172.21.15.53:0/957371772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0094d0 con 0x7f71ec0cd730 2023-12-08T21:25:35.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.863+0000 7f71eb7fe640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ec0cd730 0x7f71ec13d970 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f71e000c410 tx=0x7f71e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:35.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.867+0000 7f71e8ff9640 1 -- 172.21.15.53:0/957371772 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0011790 con 0x7f71ec0cd730 2023-12-08T21:25:35.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.867+0000 7f71f29f6640 1 -- 172.21.15.53:0/957371772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec158670 con 0x7f71ec0cd730 2023-12-08T21:25:35.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.867+0000 7f71f29f6640 1 -- 172.21.15.53:0/957371772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec158910 con 0x7f71ec0cd730 2023-12-08T21:25:35.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.867+0000 7f71e8ff9640 1 -- 172.21.15.53:0/957371772 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e0003870 con 0x7f71ec0cd730 2023-12-08T21:25:35.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.867+0000 7f71e8ff9640 1 -- 172.21.15.53:0/957371772 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0011b30 con 0x7f71ec0cd730 2023-12-08T21:25:35.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:35.871+0000 7f71f29f6640 1 -- 172.21.15.53:0/957371772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ec1584d0 con 0x7f71ec0cd730 2023-12-08T21:25:36.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.187+0000 7f71e8ff9640 1 -- 172.21.15.53:0/957371772 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71e0011c90 con 0x7f71ec0cd730 2023-12-08T21:25:36.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.187+0000 7f71e8ff9640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71d80664a0 0x7f71d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:36.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.187+0000 7f71ebfff640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71d80664a0 0x7f71d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:36.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.191+0000 7f71ebfff640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71d80664a0 0x7f71d8068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0b2000 tx=0x7f71dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:36.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.231+0000 7f71e8ff9640 1 -- 172.21.15.53:0/957371772 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f71e0055f40 con 0x7f71ec0cd730 2023-12-08T21:25:36.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.231+0000 7f71e8ff9640 1 -- 172.21.15.53:0/957371772 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71e0055610 con 0x7f71ec0cd730 2023-12-08T21:25:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.399+0000 7f71f29f6640 1 -- 172.21.15.53:0/957371772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f71ec1584d0 con 0x7f71ec0cd730 2023-12-08T21:25:36.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.415+0000 7f71e8ff9640 1 -- 172.21.15.53:0/957371772 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f71ec1584d0 con 0x7f71ec0cd730 2023-12-08T21:25:36.419 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-12-08T21:25:36.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.419+0000 7f71f29f6640 1 -- 172.21.15.53:0/957371772 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71d80664a0 msgr2=0x7f71d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:36.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.419+0000 7f71f29f6640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71d80664a0 0x7f71d8068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0b2000 tx=0x7f71dc008040 comp rx=0 tx=0).stop 2023-12-08T21:25:36.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.419+0000 7f71f29f6640 1 -- 172.21.15.53:0/957371772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ec0cd730 msgr2=0x7f71ec13d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:36.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.419+0000 7f71f29f6640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ec0cd730 0x7f71ec13d970 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f71e000c410 tx=0x7f71e000c8d0 comp rx=0 tx=0).stop 2023-12-08T21:25:36.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.419+0000 7f71f29f6640 1 -- 172.21.15.53:0/957371772 shutdown_connections 2023-12-08T21:25:36.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.419+0000 7f71f29f6640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71d80664a0 0x7f71d8068960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:36.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.419+0000 7f71f29f6640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec157d90 0x7f71ec142770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:36.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.419+0000 7f71f29f6640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ec0cd730 0x7f71ec13d970 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:36.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.419+0000 7f71f29f6640 1 --2- 172.21.15.53:0/957371772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71ec0cd350 0x7f71ec1ecc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:36.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.419+0000 7f71f29f6640 1 -- 172.21.15.53:0/957371772 >> 172.21.15.53:0/957371772 conn(0x7f71ec0611a0 msgr2=0x7f71ec0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:36.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.419+0000 7f71f29f6640 1 -- 172.21.15.53:0/957371772 shutdown_connections 2023-12-08T21:25:36.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.419+0000 7f71f29f6640 1 -- 172.21.15.53:0/957371772 wait complete. 2023-12-08T21:25:36.439 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T21:25:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.559+0000 7f0414f79640 1 Processor -- start 2023-12-08T21:25:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.559+0000 7f0414f79640 1 -- start start 2023-12-08T21:25:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.559+0000 7f0414f79640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f04101518b0 0x7f041006d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.559+0000 7f0414f79640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f041006dca0 0x7f04100c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.559+0000 7f0414f79640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0410158080 con 0x7f04100c72d0 2023-12-08T21:25:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.559+0000 7f0414f79640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04100c3820 con 0x7f041006dca0 2023-12-08T21:25:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.559+0000 7f0414f79640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0410157560 con 0x7f04101518b0 2023-12-08T21:25:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.563+0000 7f040e59c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f04101518b0 0x7f041006d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.563+0000 7f040e59c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f04101518b0 0x7f041006d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:44540/0 (socket says 172.21.15.53:44540) 2023-12-08T21:25:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.563+0000 7f040e59c640 1 -- 172.21.15.53:0/3531343504 learned_addr learned my addr 172.21.15.53:0/3531343504 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:36.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.563+0000 7f040ed9d640 1 --2- 172.21.15.53:0/3531343504 >> v2:172.21.15.53:3300/0 conn(0x7f041006dca0 0x7f04100c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.567+0000 7f040ed9d640 1 -- 172.21.15.53:0/3531343504 >> v2:172.21.15.146:3300/0 conn(0x7f04101518b0 msgr2=0x7f041006d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.567+0000 7f040ed9d640 1 --2- 172.21.15.53:0/3531343504 >> v2:172.21.15.146:3300/0 conn(0x7f04101518b0 0x7f041006d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:36.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.567+0000 7f040ed9d640 1 -- 172.21.15.53:0/3531343504 >> v1:172.21.15.53:6789/0 conn(0x7f04100c72d0 legacy=0x7f04100c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:36.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.567+0000 7f040ed9d640 1 -- 172.21.15.53:0/3531343504 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041015b4e0 con 0x7f041006dca0 2023-12-08T21:25:36.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.571+0000 7f040ed9d640 1 --2- 172.21.15.53:0/3531343504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f041006dca0 0x7f04100c7e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f04100c9b10 tx=0x7f040801c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03227fd18f9cea6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:36.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f040d59a640 1 -- 172.21.15.53:0/3531343504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080a6710 con 0x7f041006dca0 2023-12-08T21:25:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f040d59a640 1 -- 172.21.15.53:0/3531343504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04080a6870 con 0x7f041006dca0 2023-12-08T21:25:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f040d59a640 1 -- 172.21.15.53:0/3531343504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080a6c00 con 0x7f041006dca0 2023-12-08T21:25:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f0414f79640 1 -- 172.21.15.53:0/3531343504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f041006dca0 msgr2=0x7f04100c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f0414f79640 1 --2- 172.21.15.53:0/3531343504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f041006dca0 0x7f04100c7e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f04100c9b10 tx=0x7f040801c840 comp rx=0 tx=0).stop 2023-12-08T21:25:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f0414f79640 1 -- 172.21.15.53:0/3531343504 shutdown_connections 2023-12-08T21:25:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f0414f79640 1 --2- 172.21.15.53:0/3531343504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f041006dca0 0x7f04100c7e10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f0414f79640 1 --2- 172.21.15.53:0/3531343504 >> v2:172.21.15.146:3300/0 conn(0x7f04101518b0 0x7f041006d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f0414f79640 1 -- 172.21.15.53:0/3531343504 >> 172.21.15.53:0/3531343504 conn(0x7f04100cbfe0 msgr2=0x7f04100cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f0414f79640 1 -- 172.21.15.53:0/3531343504 shutdown_connections 2023-12-08T21:25:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f0414f79640 1 -- 172.21.15.53:0/3531343504 wait complete. 2023-12-08T21:25:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f0414f79640 1 Processor -- start 2023-12-08T21:25:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.579+0000 7f0414f79640 1 -- start start 2023-12-08T21:25:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.583+0000 7f0414f79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f041006dca0 0x7f041015a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.583+0000 7f0414f79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04100c72d0 0x7f04101efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.583+0000 7f0414f79640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04101518b0 0x7f04101f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.583+0000 7f0414f79640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0410150860 con 0x7f041006dca0 2023-12-08T21:25:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.583+0000 7f0414f79640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04101f0660 con 0x7f04100c72d0 2023-12-08T21:25:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.583+0000 7f0414f79640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0410158cc0 con 0x7f04101518b0 2023-12-08T21:25:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.583+0000 7f040e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f041006dca0 0x7f041015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.583+0000 7f040e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f041006dca0 0x7f041015a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59838/0 (socket says 172.21.15.53:59838) 2023-12-08T21:25:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.583+0000 7f040e59c640 1 -- 172.21.15.53:0/2311583690 learned_addr learned my addr 172.21.15.53:0/2311583690 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.583+0000 7f040dd9b640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04100c72d0 0x7f04101efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.583+0000 7f040ed9d640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04101518b0 0x7f04101f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:36.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.587+0000 7f040e59c640 1 -- 172.21.15.53:0/2311583690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04101518b0 msgr2=0x7f04101f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:36.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.587+0000 7f040e59c640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04101518b0 0x7f04101f0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:36.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.587+0000 7f040e59c640 1 -- 172.21.15.53:0/2311583690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04100c72d0 msgr2=0x7f04101efbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:36.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.587+0000 7f040e59c640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04100c72d0 0x7f04101efbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:36.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.587+0000 7f040e59c640 1 -- 172.21.15.53:0/2311583690 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0408009a70 con 0x7f041006dca0 2023-12-08T21:25:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.587+0000 7f040e59c640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f041006dca0 0x7f041015a540 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f040000e7f0 tx=0x7f040000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:36.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.591+0000 7f03feffd640 1 -- 172.21.15.53:0/2311583690 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400009580 con 0x7f041006dca0 2023-12-08T21:25:36.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.591+0000 7f03feffd640 1 -- 172.21.15.53:0/2311583690 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040000c940 con 0x7f041006dca0 2023-12-08T21:25:36.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.591+0000 7f0414f79640 1 -- 172.21.15.53:0/2311583690 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0410158a00 con 0x7f041006dca0 2023-12-08T21:25:36.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.591+0000 7f03feffd640 1 -- 172.21.15.53:0/2311583690 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040000ccf0 con 0x7f041006dca0 2023-12-08T21:25:36.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.591+0000 7f0414f79640 1 -- 172.21.15.53:0/2311583690 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0410150210 con 0x7f041006dca0 2023-12-08T21:25:36.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.595+0000 7f0414f79640 1 -- 172.21.15.53:0/2311583690 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0410074190 con 0x7f041006dca0 2023-12-08T21:25:36.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.611+0000 7f03feffd640 1 -- 172.21.15.53:0/2311583690 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0400013470 con 0x7f041006dca0 2023-12-08T21:25:36.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.615+0000 7f03feffd640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f03f00664c0 0x7f03f0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:36.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.615+0000 7f040dd9b640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f03f00664c0 0x7f03f0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:36.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.615+0000 7f040dd9b640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f03f00664c0 0x7f03f0068980 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f04100b1d70 tx=0x7f0404007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.907+0000 7f03feffd640 1 -- 172.21.15.53:0/2311583690 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f0400055930 con 0x7f041006dca0 2023-12-08T21:25:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:36.907+0000 7f03feffd640 1 -- 172.21.15.53:0/2311583690 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0400051c70 con 0x7f041006dca0 2023-12-08T21:25:37.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.091+0000 7f0414f79640 1 -- 172.21.15.53:0/2311583690 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f04100c4190 con 0x7f041006dca0 2023-12-08T21:25:37.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.099+0000 7f03feffd640 1 -- 172.21.15.53:0/2311583690 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0400021020 con 0x7f041006dca0 2023-12-08T21:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-12-08T21:25:37.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.103+0000 7f0414f79640 1 -- 172.21.15.53:0/2311583690 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f03f00664c0 msgr2=0x7f03f0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:37.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.103+0000 7f0414f79640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f03f00664c0 0x7f03f0068980 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f04100b1d70 tx=0x7f0404007e40 comp rx=0 tx=0).stop 2023-12-08T21:25:37.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.103+0000 7f0414f79640 1 -- 172.21.15.53:0/2311583690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f041006dca0 msgr2=0x7f041015a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:37.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.103+0000 7f0414f79640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f041006dca0 0x7f041015a540 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f040000e7f0 tx=0x7f040000ecb0 comp rx=0 tx=0).stop 2023-12-08T21:25:37.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.103+0000 7f0414f79640 1 -- 172.21.15.53:0/2311583690 shutdown_connections 2023-12-08T21:25:37.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.103+0000 7f0414f79640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f03f00664c0 0x7f03f0068980 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:37.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.103+0000 7f0414f79640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04101518b0 0x7f04101f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:37.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.103+0000 7f0414f79640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04100c72d0 0x7f04101efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:37.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.103+0000 7f0414f79640 1 --2- 172.21.15.53:0/2311583690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f041006dca0 0x7f041015a540 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:37.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.103+0000 7f0414f79640 1 -- 172.21.15.53:0/2311583690 >> 172.21.15.53:0/2311583690 conn(0x7f04100cbfe0 msgr2=0x7f04100c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:37.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.103+0000 7f0414f79640 1 -- 172.21.15.53:0/2311583690 shutdown_connections 2023-12-08T21:25:37.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:37.103+0000 7f0414f79640 1 -- 172.21.15.53:0/2311583690 wait complete. 2023-12-08T21:25:37.125 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-12-08T21:25:37.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T21:25:37.125 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-08T21:25:37.139 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:25:37.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[44874]: fuse finished with error 0 and tester_r 0 2023-12-08T21:25:37.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:==00:00:29:32.693 44874== 2023-12-08T21:25:37.832 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:==00:00:29:32.693 44874== Exit program on first error (--exit-on-first-error=yes) 2023-12-08T21:25:38.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:daemon-helper: command failed with exit status 42 2023-12-08T21:25:43.241 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-08T21:25:43.241 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T21:25:43.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T21:25:43.241 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T21:25:43.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T21:25:43.249 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-12-08T21:25:43.298 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T21:25:43.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T21:25:43.299 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T21:25:43.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T21:25:43.356 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2023-12-08T21:25:43.559 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-08T21:25:43.568 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-08T21:25:43.568 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T21:25:43.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.711+0000 7ff95b636640 1 Processor -- start 2023-12-08T21:25:43.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.711+0000 7ff95b636640 1 -- start start 2023-12-08T21:25:43.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.711+0000 7ff95b636640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff95406abf0 0x7ff95406b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:43.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.711+0000 7ff95b636640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95406f7d0 con 0x7ff95406a810 2023-12-08T21:25:43.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.711+0000 7ff95b636640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff954070350 con 0x7ff95406e320 2023-12-08T21:25:43.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.711+0000 7ff95b636640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9541583d0 con 0x7ff95406abf0 2023-12-08T21:25:43.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.715+0000 7ff9593d2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff95406a810 0x7ff95406dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40822/0 (socket says 172.21.15.53:40822) 2023-12-08T21:25:43.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.715+0000 7ff9593d2640 1 -- 172.21.15.53:0/1915420401 learned_addr learned my addr 172.21.15.53:0/1915420401 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:43.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.739+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071161362 0 0) 0x7ff95406f7d0 con 0x7ff95406a810 2023-12-08T21:25:43.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.739+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff940003530 con 0x7ff95406a810 2023-12-08T21:25:43.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 425116346 0 0) 0x7ff940003530 con 0x7ff95406a810 2023-12-08T21:25:43.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 >> v2:172.21.15.146:3300/0 conn(0x7ff95406abf0 msgr2=0x7ff95406b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:43.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 --2- 172.21.15.53:0/1915420401 >> v2:172.21.15.146:3300/0 conn(0x7ff95406abf0 0x7ff95406b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:43.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 >> v1:172.21.15.146:6789/0 conn(0x7ff95406e320 legacy=0x7ff9541512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:43.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95406fa20 con 0x7ff95406a810 2023-12-08T21:25:43.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 149952835 0 0) 0x7ff950001a00 con 0x7ff95406a810 2023-12-08T21:25:43.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 >> v1:172.21.15.53:6789/0 conn(0x7ff95406a810 legacy=0x7ff95406dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:43.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 --2- 172.21.15.53:0/1915420401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff940003980 0x7ff940003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:43.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 --2- 172.21.15.53:0/1915420401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9400047d0 0x7ff940004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:43.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 --2- 172.21.15.53:0/1915420401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9400052b0 0x7ff94000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:43.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9541583d0 con 0x7ff9400052b0 2023-12-08T21:25:43.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94000c1a0 con 0x7ff940003980 2023-12-08T21:25:43.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94000c360 con 0x7ff9400047d0 2023-12-08T21:25:43.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.743+0000 7ff959bd3640 1 --2- 172.21.15.53:0/1915420401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9400052b0 0x7ff94000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:43.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.751+0000 7ff959bd3640 1 -- 172.21.15.53:0/1915420401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9400047d0 msgr2=0x7ff940004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:43.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.751+0000 7ff959bd3640 1 --2- 172.21.15.53:0/1915420401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9400047d0 0x7ff940004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:43.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.751+0000 7ff959bd3640 1 -- 172.21.15.53:0/1915420401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff940003980 msgr2=0x7ff940003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:43.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.751+0000 7ff959bd3640 1 --2- 172.21.15.53:0/1915420401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff940003980 0x7ff940003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:43.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.751+0000 7ff959bd3640 1 -- 172.21.15.53:0/1915420401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff940003530 con 0x7ff9400052b0 2023-12-08T21:25:43.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.751+0000 7ff959bd3640 1 -- 172.21.15.53:0/1915420401 reap_dead start 2023-12-08T21:25:43.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.751+0000 7ff959bd3640 1 --2- 172.21.15.53:0/1915420401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9400052b0 0x7ff94000b990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009860 tx=0x7ff94c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc55261203329d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:43.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c004220 con 0x7ff9400052b0 2023-12-08T21:25:43.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c0a7050 con 0x7ff9400052b0 2023-12-08T21:25:43.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff94bfff640 1 -- 172.21.15.53:0/1915420401 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c003600 con 0x7ff9400052b0 2023-12-08T21:25:43.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 -- 172.21.15.53:0/1915420401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9400052b0 msgr2=0x7ff94000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:43.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 --2- 172.21.15.53:0/1915420401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9400052b0 0x7ff94000b990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009860 tx=0x7ff94c01c360 comp rx=0 tx=0).stop 2023-12-08T21:25:43.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 -- 172.21.15.53:0/1915420401 shutdown_connections 2023-12-08T21:25:43.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 --2- 172.21.15.53:0/1915420401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9400052b0 0x7ff94000b990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:43.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 -- 172.21.15.53:0/1915420401 >> 172.21.15.53:0/1915420401 conn(0x7ff9540c8a00 msgr2=0x7ff9540c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:43.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 -- 172.21.15.53:0/1915420401 shutdown_connections 2023-12-08T21:25:43.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 -- 172.21.15.53:0/1915420401 wait complete. 2023-12-08T21:25:43.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 Processor -- start 2023-12-08T21:25:43.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 -- start start 2023-12-08T21:25:43.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9400052b0 0x7ff9541e02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:43.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff954155c50 0x7ff9540cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:43.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff954156bd0 0x7ff954157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:43.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540b1280 con 0x7ff954155c50 2023-12-08T21:25:43.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540c2400 con 0x7ff9400052b0 2023-12-08T21:25:43.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.755+0000 7ff95b636640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff954157590 con 0x7ff954156bd0 2023-12-08T21:25:43.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.759+0000 7ff958bd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff954155c50 0x7ff9540cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:43.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.759+0000 7ff958bd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff954155c50 0x7ff9540cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60160/0 (socket says 172.21.15.53:60160) 2023-12-08T21:25:43.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.759+0000 7ff958bd1640 1 -- 172.21.15.53:0/1509493774 learned_addr learned my addr 172.21.15.53:0/1509493774 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:43.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.763+0000 7ff958bd1640 1 -- 172.21.15.53:0/1509493774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff954156bd0 msgr2=0x7ff954157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:43.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.763+0000 7ff958bd1640 1 --2- 172.21.15.53:0/1509493774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff954156bd0 0x7ff954157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:43.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.763+0000 7ff958bd1640 1 -- 172.21.15.53:0/1509493774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9400052b0 msgr2=0x7ff9541e02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:43.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.763+0000 7ff958bd1640 1 --2- 172.21.15.53:0/1509493774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9400052b0 0x7ff9541e02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:43.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.763+0000 7ff958bd1640 1 -- 172.21.15.53:0/1509493774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540c4fc0 con 0x7ff954155c50 2023-12-08T21:25:43.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.763+0000 7ff958bd1640 1 --2- 172.21.15.53:0/1509493774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff954155c50 0x7ff9540cb060 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff94400c3f0 tx=0x7ff94400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:43.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.771+0000 7ff949ffb640 1 -- 172.21.15.53:0/1509493774 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9440054e0 con 0x7ff954155c50 2023-12-08T21:25:43.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.771+0000 7ff949ffb640 1 -- 172.21.15.53:0/1509493774 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff944003650 con 0x7ff954155c50 2023-12-08T21:25:43.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.771+0000 7ff949ffb640 1 -- 172.21.15.53:0/1509493774 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944003a00 con 0x7ff954155c50 2023-12-08T21:25:43.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.771+0000 7ff95b636640 1 -- 172.21.15.53:0/1509493774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9540c1a60 con 0x7ff954155c50 2023-12-08T21:25:43.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.771+0000 7ff95b636640 1 -- 172.21.15.53:0/1509493774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9540c1d00 con 0x7ff954155c50 2023-12-08T21:25:43.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:43.771+0000 7ff95b636640 1 -- 172.21.15.53:0/1509493774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff954074190 con 0x7ff954155c50 2023-12-08T21:25:44.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.043+0000 7ff949ffb640 1 -- 172.21.15.53:0/1509493774 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff944003b60 con 0x7ff954155c50 2023-12-08T21:25:44.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.043+0000 7ff949ffb640 1 --2- 172.21.15.53:0/1509493774 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff9380664f0 0x7ff9380689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:44.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.043+0000 7ff9593d2640 1 --2- 172.21.15.53:0/1509493774 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff9380664f0 0x7ff9380689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.043+0000 7ff9593d2640 1 --2- 172.21.15.53:0/1509493774 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff9380664f0 0x7ff9380689b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff950001360 tx=0x7ff9500018c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.075+0000 7ff949ffb640 1 -- 172.21.15.53:0/1509493774 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff9440550c0 con 0x7ff954155c50 2023-12-08T21:25:44.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.115+0000 7ff949ffb640 1 -- 172.21.15.53:0/1509493774 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff944050d00 con 0x7ff954155c50 2023-12-08T21:25:44.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.287+0000 7ff95b636640 1 -- 172.21.15.53:0/1509493774 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff95406ffe0 con 0x7ff9380664f0 2023-12-08T21:25:44.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.315+0000 7ff949ffb640 1 -- 172.21.15.53:0/1509493774 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369263 (secure 0 0 0) 0x7ff950002010 con 0x7ff9380664f0 2023-12-08T21:25:44.324 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:25:44.327 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-12-08T21:25:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.319+0000 7ff95b636640 1 -- 172.21.15.53:0/1509493774 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff9380664f0 msgr2=0x7ff9380689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.319+0000 7ff95b636640 1 --2- 172.21.15.53:0/1509493774 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff9380664f0 0x7ff9380689b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff950001360 tx=0x7ff9500018c0 comp rx=0 tx=0).stop 2023-12-08T21:25:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.319+0000 7ff95b636640 1 -- 172.21.15.53:0/1509493774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff954155c50 msgr2=0x7ff9540cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.319+0000 7ff95b636640 1 --2- 172.21.15.53:0/1509493774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff954155c50 0x7ff9540cb060 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff94400c3f0 tx=0x7ff94400c8b0 comp rx=0 tx=0).stop 2023-12-08T21:25:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.319+0000 7ff95b636640 1 -- 172.21.15.53:0/1509493774 shutdown_connections 2023-12-08T21:25:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.319+0000 7ff95b636640 1 --2- 172.21.15.53:0/1509493774 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff9380664f0 0x7ff9380689b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.319+0000 7ff95b636640 1 --2- 172.21.15.53:0/1509493774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff954156bd0 0x7ff954157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.319+0000 7ff95b636640 1 --2- 172.21.15.53:0/1509493774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff954155c50 0x7ff9540cb060 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.319+0000 7ff95b636640 1 --2- 172.21.15.53:0/1509493774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9400052b0 0x7ff9541e02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.319+0000 7ff95b636640 1 -- 172.21.15.53:0/1509493774 >> 172.21.15.53:0/1509493774 conn(0x7ff9540c8a00 msgr2=0x7ff9540c5810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.319+0000 7ff95b636640 1 -- 172.21.15.53:0/1509493774 shutdown_connections 2023-12-08T21:25:44.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.319+0000 7ff95b636640 1 -- 172.21.15.53:0/1509493774 wait complete. 2023-12-08T21:25:44.349 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":973,"stamp":"2023-12-08T21:25:44.046440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24448816,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":690,"num_read_kb":695,"num_write":8182,"num_write_kb":281588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9403,"ondisk_log_size":9403,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":328152,"kb_used_data":34328,"kb_used_omap":12,"kb_used_meta":293747,"kb_avail":754646568,"statfs":{"total":773094113280,"available":772758085632,"internally_reserved":0,"allocated":35151872,"data_stored":49947816,"data_compressed":4799006,"data_compressed_allocated":7397376,"data_compressed_original":23764992,"omap_allocated":12752,"internal_metadata":300797488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11621,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":23,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004831"},"pg_stats":[{"pgid":"2.1f","version":"30'720","reported_seq":755,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:07.393324+0000","last_change":"2023-12-08T20:54:54.983255+0000","last_active":"2023-12-08T21:24:07.393324+0000","last_peered":"2023-12-08T21:24:07.393324+0000","last_clean":"2023-12-08T21:24:07.393324+0000","last_became_active":"2023-12-08T20:54:54.982479+0000","last_became_peered":"2023-12-08T20:54:54.982479+0000","last_unstale":"2023-12-08T21:24:07.393324+0000","last_undegraded":"2023-12-08T21:24:07.393324+0000","last_fullsized":"2023-12-08T21:24:07.393324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:17:36.784429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":4491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.545912+0000","last_change":"2023-12-08T20:54:56.407614+0000","last_active":"2023-12-08T21:25:37.545912+0000","last_peered":"2023-12-08T21:25:37.545912+0000","last_clean":"2023-12-08T21:25:37.545912+0000","last_became_active":"2023-12-08T20:54:56.406245+0000","last_became_peered":"2023-12-08T20:54:56.406245+0000","last_unstale":"2023-12-08T21:25:37.545912+0000","last_undegraded":"2023-12-08T21:25:37.545912+0000","last_fullsized":"2023-12-08T21:25:37.545912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:29.997818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'66","reported_seq":93,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:29.730895+0000","last_change":"2023-12-08T20:55:04.459400+0000","last_active":"2023-12-08T21:24:29.730895+0000","last_peered":"2023-12-08T21:24:29.730895+0000","last_clean":"2023-12-08T21:24:29.730895+0000","last_became_active":"2023-12-08T20:55:04.458087+0000","last_became_peered":"2023-12-08T20:55:04.458087+0000","last_unstale":"2023-12-08T21:24:29.730895+0000","last_undegraded":"2023-12-08T21:24:29.730895+0000","last_fullsized":"2023-12-08T21:24:29.730895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:23.378911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'290","reported_seq":326,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.211179+0000","last_change":"2023-12-08T20:54:54.929925+0000","last_active":"2023-12-08T21:25:37.211179+0000","last_peered":"2023-12-08T21:25:37.211179+0000","last_clean":"2023-12-08T21:25:37.211179+0000","last_became_active":"2023-12-08T20:54:54.929391+0000","last_became_peered":"2023-12-08T20:54:54.929391+0000","last_unstale":"2023-12-08T21:25:37.211179+0000","last_undegraded":"2023-12-08T21:25:37.211179+0000","last_fullsized":"2023-12-08T21:25:37.211179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:15:29.148520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759983,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":2843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.565498+0000","last_change":"2023-12-08T20:54:56.409201+0000","last_active":"2023-12-08T21:25:37.565498+0000","last_peered":"2023-12-08T21:25:37.565498+0000","last_clean":"2023-12-08T21:25:37.565498+0000","last_became_active":"2023-12-08T20:54:56.408361+0000","last_became_peered":"2023-12-08T20:54:56.408361+0000","last_unstale":"2023-12-08T21:25:37.565498+0000","last_undegraded":"2023-12-08T21:25:37.565498+0000","last_fullsized":"2023-12-08T21:25:37.565498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:43:42.044530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'74","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:08.280157+0000","last_change":"2023-12-08T20:55:04.529086+0000","last_active":"2023-12-08T21:24:08.280157+0000","last_peered":"2023-12-08T21:24:08.280157+0000","last_clean":"2023-12-08T21:24:08.280157+0000","last_became_active":"2023-12-08T20:55:04.528732+0000","last_became_peered":"2023-12-08T20:55:04.528732+0000","last_unstale":"2023-12-08T21:24:08.280157+0000","last_undegraded":"2023-12-08T21:24:08.280157+0000","last_fullsized":"2023-12-08T21:24:08.280157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:09:07.484233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'9","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:20.382538+0000","last_change":"2023-12-08T20:54:54.935973+0000","last_active":"2023-12-08T21:25:20.382538+0000","last_peered":"2023-12-08T21:25:20.382538+0000","last_clean":"2023-12-08T21:25:20.382538+0000","last_became_active":"2023-12-08T20:54:54.935620+0000","last_became_peered":"2023-12-08T20:54:54.935620+0000","last_unstale":"2023-12-08T21:25:20.382538+0000","last_undegraded":"2023-12-08T21:25:20.382538+0000","last_fullsized":"2023-12-08T21:25:20.382538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:57.947192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'23","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572529+0000","last_change":"2023-12-08T20:54:56.382016+0000","last_active":"2023-12-08T21:25:37.572529+0000","last_peered":"2023-12-08T21:25:37.572529+0000","last_clean":"2023-12-08T21:25:37.572529+0000","last_became_active":"2023-12-08T20:54:56.380927+0000","last_became_peered":"2023-12-08T20:54:56.380927+0000","last_unstale":"2023-12-08T21:25:37.572529+0000","last_undegraded":"2023-12-08T21:25:37.572529+0000","last_fullsized":"2023-12-08T21:25:37.572529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'75","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.127325+0000","last_change":"2023-12-08T20:55:04.527024+0000","last_active":"2023-12-08T21:24:30.127325+0000","last_peered":"2023-12-08T21:24:30.127325+0000","last_clean":"2023-12-08T21:24:30.127325+0000","last_became_active":"2023-12-08T20:55:04.526605+0000","last_became_peered":"2023-12-08T20:55:04.526605+0000","last_unstale":"2023-12-08T21:24:30.127325+0000","last_undegraded":"2023-12-08T21:24:30.127325+0000","last_fullsized":"2023-12-08T21:24:30.127325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:15.471006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:54.122416+0000","last_change":"2023-12-08T20:54:54.929388+0000","last_active":"2023-12-08T21:24:54.122416+0000","last_peered":"2023-12-08T21:24:54.122416+0000","last_clean":"2023-12-08T21:24:54.122416+0000","last_became_active":"2023-12-08T20:54:54.926132+0000","last_became_peered":"2023-12-08T20:54:54.926132+0000","last_unstale":"2023-12-08T21:24:54.122416+0000","last_undegraded":"2023-12-08T21:24:54.122416+0000","last_fullsized":"2023-12-08T21:24:54.122416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:00.435948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.531175+0000","last_change":"2023-12-08T20:54:56.388306+0000","last_active":"2023-12-08T21:25:37.531175+0000","last_peered":"2023-12-08T21:25:37.531175+0000","last_clean":"2023-12-08T21:25:37.531175+0000","last_became_active":"2023-12-08T20:54:56.387528+0000","last_became_peered":"2023-12-08T20:54:56.387528+0000","last_unstale":"2023-12-08T21:25:37.531175+0000","last_undegraded":"2023-12-08T21:25:37.531175+0000","last_fullsized":"2023-12-08T21:25:37.531175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:22.236935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'65","reported_seq":92,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:32.160514+0000","last_change":"2023-12-08T20:55:04.523251+0000","last_active":"2023-12-08T21:24:32.160514+0000","last_peered":"2023-12-08T21:24:32.160514+0000","last_clean":"2023-12-08T21:24:32.160514+0000","last_became_active":"2023-12-08T20:55:04.522777+0000","last_became_peered":"2023-12-08T20:55:04.522777+0000","last_unstale":"2023-12-08T21:24:32.160514+0000","last_undegraded":"2023-12-08T21:24:32.160514+0000","last_fullsized":"2023-12-08T21:24:32.160514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:09.972989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'17","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.527629+0000","last_change":"2023-12-08T20:54:56.319638+0000","last_active":"2023-12-08T21:25:37.527629+0000","last_peered":"2023-12-08T21:25:37.527629+0000","last_clean":"2023-12-08T21:25:37.527629+0000","last_became_active":"2023-12-08T20:54:56.318855+0000","last_became_peered":"2023-12-08T20:54:56.318855+0000","last_unstale":"2023-12-08T21:25:37.527629+0000","last_undegraded":"2023-12-08T21:25:37.527629+0000","last_fullsized":"2023-12-08T21:25:37.527629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:27.151902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'722","reported_seq":756,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.547932+0000","last_change":"2023-12-08T20:54:54.929584+0000","last_active":"2023-12-08T21:25:04.547932+0000","last_peered":"2023-12-08T21:25:04.547932+0000","last_clean":"2023-12-08T21:25:04.547932+0000","last_became_active":"2023-12-08T20:54:54.928702+0000","last_became_peered":"2023-12-08T20:54:54.928702+0000","last_unstale":"2023-12-08T21:25:04.547932+0000","last_undegraded":"2023-12-08T21:25:04.547932+0000","last_fullsized":"2023-12-08T21:25:04.547932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:40.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'78","reported_seq":106,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.189347+0000","last_change":"2023-12-08T20:55:04.535786+0000","last_active":"2023-12-08T21:24:31.189347+0000","last_peered":"2023-12-08T21:24:31.189347+0000","last_clean":"2023-12-08T21:24:31.189347+0000","last_became_active":"2023-12-08T20:55:04.535119+0000","last_became_peered":"2023-12-08T20:55:04.535119+0000","last_unstale":"2023-12-08T21:24:31.189347+0000","last_undegraded":"2023-12-08T21:24:31.189347+0000","last_fullsized":"2023-12-08T21:24:31.189347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:23:32.647822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":12383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.475615+0000","last_change":"2023-12-08T20:54:56.370877+0000","last_active":"2023-12-08T21:25:37.475615+0000","last_peered":"2023-12-08T21:25:37.475615+0000","last_clean":"2023-12-08T21:25:37.475615+0000","last_became_active":"2023-12-08T20:54:56.370044+0000","last_became_peered":"2023-12-08T20:54:56.370044+0000","last_unstale":"2023-12-08T21:25:37.475615+0000","last_undegraded":"2023-12-08T21:25:37.475615+0000","last_fullsized":"2023-12-08T21:25:37.475615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:26.733660+0000","last_change":"2023-12-08T20:54:54.923604+0000","last_active":"2023-12-08T21:25:26.733660+0000","last_peered":"2023-12-08T21:25:26.733660+0000","last_clean":"2023-12-08T21:25:26.733660+0000","last_became_active":"2023-12-08T20:54:54.922960+0000","last_became_peered":"2023-12-08T20:54:54.922960+0000","last_unstale":"2023-12-08T21:25:26.733660+0000","last_undegraded":"2023-12-08T21:25:26.733660+0000","last_fullsized":"2023-12-08T21:25:26.733660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:41:46.444603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'95","reported_seq":123,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.193518+0000","last_change":"2023-12-08T20:55:04.522655+0000","last_active":"2023-12-08T21:24:28.193518+0000","last_peered":"2023-12-08T21:24:28.193518+0000","last_clean":"2023-12-08T21:24:28.193518+0000","last_became_active":"2023-12-08T20:55:04.522172+0000","last_became_peered":"2023-12-08T20:55:04.522172+0000","last_unstale":"2023-12-08T21:24:28.193518+0000","last_undegraded":"2023-12-08T21:24:28.193518+0000","last_fullsized":"2023-12-08T21:24:28.193518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:09:00.038275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.700497+0000","last_change":"2023-12-08T20:54:56.366227+0000","last_active":"2023-12-08T21:25:37.700497+0000","last_peered":"2023-12-08T21:25:37.700497+0000","last_clean":"2023-12-08T21:25:37.700497+0000","last_became_active":"2023-12-08T20:54:56.365552+0000","last_became_peered":"2023-12-08T20:54:56.365552+0000","last_unstale":"2023-12-08T21:25:37.700497+0000","last_undegraded":"2023-12-08T21:25:37.700497+0000","last_fullsized":"2023-12-08T21:25:37.700497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:00.821031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.043833+0000","last_change":"2023-12-08T20:54:54.980466+0000","last_active":"2023-12-08T21:25:17.043833+0000","last_peered":"2023-12-08T21:25:17.043833+0000","last_clean":"2023-12-08T21:25:17.043833+0000","last_became_active":"2023-12-08T20:54:54.979668+0000","last_became_peered":"2023-12-08T20:54:54.979668+0000","last_unstale":"2023-12-08T21:25:17.043833+0000","last_undegraded":"2023-12-08T21:25:17.043833+0000","last_fullsized":"2023-12-08T21:25:17.043833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:53.529738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'67","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.342620+0000","last_change":"2023-12-08T20:55:04.513186+0000","last_active":"2023-12-08T21:24:30.342620+0000","last_peered":"2023-12-08T21:24:30.342620+0000","last_clean":"2023-12-08T21:24:30.342620+0000","last_became_active":"2023-12-08T20:55:04.512549+0000","last_became_peered":"2023-12-08T20:55:04.512549+0000","last_unstale":"2023-12-08T21:24:30.342620+0000","last_undegraded":"2023-12-08T21:24:30.342620+0000","last_fullsized":"2023-12-08T21:24:30.342620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:49:31.307794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:19.086943+0000","last_change":"2023-12-08T20:54:56.261452+0000","last_active":"2023-12-08T21:25:19.086943+0000","last_peered":"2023-12-08T21:25:19.086943+0000","last_clean":"2023-12-08T21:25:19.086943+0000","last_became_active":"2023-12-08T20:54:56.260355+0000","last_became_peered":"2023-12-08T20:54:56.260355+0000","last_unstale":"2023-12-08T21:25:19.086943+0000","last_undegraded":"2023-12-08T21:25:19.086943+0000","last_fullsized":"2023-12-08T21:25:19.086943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:47:02.249125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'6","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:15.054410+0000","last_change":"2023-12-08T20:54:54.926546+0000","last_active":"2023-12-08T21:25:15.054410+0000","last_peered":"2023-12-08T21:25:15.054410+0000","last_clean":"2023-12-08T21:25:15.054410+0000","last_became_active":"2023-12-08T20:54:54.925888+0000","last_became_peered":"2023-12-08T20:54:54.925888+0000","last_unstale":"2023-12-08T21:25:15.054410+0000","last_undegraded":"2023-12-08T21:25:15.054410+0000","last_fullsized":"2023-12-08T21:25:15.054410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:25:20.796728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'77","reported_seq":105,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.244645+0000","last_change":"2023-12-08T20:55:04.529041+0000","last_active":"2023-12-08T21:24:28.244645+0000","last_peered":"2023-12-08T21:24:28.244645+0000","last_clean":"2023-12-08T21:24:28.244645+0000","last_became_active":"2023-12-08T20:55:04.528640+0000","last_became_peered":"2023-12-08T20:55:04.528640+0000","last_unstale":"2023-12-08T21:24:28.244645+0000","last_undegraded":"2023-12-08T21:24:28.244645+0000","last_fullsized":"2023-12-08T21:24:28.244645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:18.653508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.700875+0000","last_change":"2023-12-08T20:54:56.365339+0000","last_active":"2023-12-08T21:25:37.700875+0000","last_peered":"2023-12-08T21:25:37.700875+0000","last_clean":"2023-12-08T21:25:37.700875+0000","last_became_active":"2023-12-08T20:54:56.364597+0000","last_became_peered":"2023-12-08T20:54:56.364597+0000","last_unstale":"2023-12-08T21:25:37.700875+0000","last_undegraded":"2023-12-08T21:25:37.700875+0000","last_fullsized":"2023-12-08T21:25:37.700875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:17:58.931401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.405257+0000","last_change":"2023-12-08T20:54:54.928399+0000","last_active":"2023-12-08T21:25:17.405257+0000","last_peered":"2023-12-08T21:25:17.405257+0000","last_clean":"2023-12-08T21:25:17.405257+0000","last_became_active":"2023-12-08T20:54:54.927814+0000","last_became_peered":"2023-12-08T20:54:54.927814+0000","last_unstale":"2023-12-08T21:25:17.405257+0000","last_undegraded":"2023-12-08T21:25:17.405257+0000","last_fullsized":"2023-12-08T21:25:17.405257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:04:22.986992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'64","reported_seq":93,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:32.160272+0000","last_change":"2023-12-08T20:55:04.523561+0000","last_active":"2023-12-08T21:24:32.160272+0000","last_peered":"2023-12-08T21:24:32.160272+0000","last_clean":"2023-12-08T21:24:32.160272+0000","last_became_active":"2023-12-08T20:55:04.522714+0000","last_became_peered":"2023-12-08T20:55:04.522714+0000","last_unstale":"2023-12-08T21:24:32.160272+0000","last_undegraded":"2023-12-08T21:24:32.160272+0000","last_fullsized":"2023-12-08T21:24:32.160272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:14.534456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":9451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.698634+0000","last_change":"2023-12-08T20:54:56.331268+0000","last_active":"2023-12-08T21:25:37.698634+0000","last_peered":"2023-12-08T21:25:37.698634+0000","last_clean":"2023-12-08T21:25:37.698634+0000","last_became_active":"2023-12-08T20:54:56.330508+0000","last_became_peered":"2023-12-08T20:54:56.330508+0000","last_unstale":"2023-12-08T21:25:37.698634+0000","last_undegraded":"2023-12-08T21:25:37.698634+0000","last_fullsized":"2023-12-08T21:25:37.698634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:52.392589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'333","reported_seq":368,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:32.174048+0000","last_change":"2023-12-08T20:54:54.982136+0000","last_active":"2023-12-08T21:25:32.174048+0000","last_peered":"2023-12-08T21:25:32.174048+0000","last_clean":"2023-12-08T21:25:32.174048+0000","last_became_active":"2023-12-08T20:54:54.981168+0000","last_became_peered":"2023-12-08T20:54:54.981168+0000","last_unstale":"2023-12-08T21:25:32.174048+0000","last_undegraded":"2023-12-08T21:25:32.174048+0000","last_fullsized":"2023-12-08T21:25:32.174048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:13.841870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'104","reported_seq":134,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.293300+0000","last_change":"2023-12-08T20:55:04.513360+0000","last_active":"2023-12-08T21:24:33.293300+0000","last_peered":"2023-12-08T21:24:33.293300+0000","last_clean":"2023-12-08T21:24:33.293300+0000","last_became_active":"2023-12-08T20:55:04.511032+0000","last_became_peered":"2023-12-08T20:55:04.511032+0000","last_unstale":"2023-12-08T21:24:33.293300+0000","last_undegraded":"2023-12-08T21:24:33.293300+0000","last_fullsized":"2023-12-08T21:24:33.293300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:38:04.841172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":14212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.469315+0000","last_change":"2023-12-08T20:54:56.409829+0000","last_active":"2023-12-08T21:25:37.469315+0000","last_peered":"2023-12-08T21:25:37.469315+0000","last_clean":"2023-12-08T21:25:37.469315+0000","last_became_active":"2023-12-08T20:54:56.409291+0000","last_became_peered":"2023-12-08T20:54:56.409291+0000","last_unstale":"2023-12-08T21:25:37.469315+0000","last_undegraded":"2023-12-08T21:25:37.469315+0000","last_fullsized":"2023-12-08T21:25:37.469315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:06:37.234510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.405216+0000","last_change":"2023-12-08T20:54:54.978750+0000","last_active":"2023-12-08T21:25:17.405216+0000","last_peered":"2023-12-08T21:25:17.405216+0000","last_clean":"2023-12-08T21:25:17.405216+0000","last_became_active":"2023-12-08T20:54:54.978416+0000","last_became_peered":"2023-12-08T20:54:54.978416+0000","last_unstale":"2023-12-08T21:25:17.405216+0000","last_undegraded":"2023-12-08T21:25:17.405216+0000","last_fullsized":"2023-12-08T21:25:17.405216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:00:08.584168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'75","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.504300+0000","last_change":"2023-12-08T20:55:04.507859+0000","last_active":"2023-12-08T21:24:30.504300+0000","last_peered":"2023-12-08T21:24:30.504300+0000","last_clean":"2023-12-08T21:24:30.504300+0000","last_became_active":"2023-12-08T20:55:04.507454+0000","last_became_peered":"2023-12-08T20:55:04.507454+0000","last_unstale":"2023-12-08T21:24:30.504300+0000","last_undegraded":"2023-12-08T21:24:30.504300+0000","last_fullsized":"2023-12-08T21:24:30.504300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:56:57.279368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'17","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.668121+0000","last_change":"2023-12-08T20:54:56.372983+0000","last_active":"2023-12-08T21:25:37.668121+0000","last_peered":"2023-12-08T21:25:37.668121+0000","last_clean":"2023-12-08T21:25:37.668121+0000","last_became_active":"2023-12-08T20:54:56.369974+0000","last_became_peered":"2023-12-08T20:54:56.369974+0000","last_unstale":"2023-12-08T21:25:37.668121+0000","last_undegraded":"2023-12-08T21:25:37.668121+0000","last_fullsized":"2023-12-08T21:25:37.668121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.229971+0000","last_change":"2023-12-08T20:54:54.925560+0000","last_active":"2023-12-08T21:25:17.229971+0000","last_peered":"2023-12-08T21:25:17.229971+0000","last_clean":"2023-12-08T21:25:17.229971+0000","last_became_active":"2023-12-08T20:54:54.925022+0000","last_became_peered":"2023-12-08T20:54:54.925022+0000","last_unstale":"2023-12-08T21:25:17.229971+0000","last_undegraded":"2023-12-08T21:25:17.229971+0000","last_fullsized":"2023-12-08T21:25:17.229971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:10:52.902793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'85","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:26.213718+0000","last_change":"2023-12-08T20:55:04.531931+0000","last_active":"2023-12-08T21:24:26.213718+0000","last_peered":"2023-12-08T21:24:26.213718+0000","last_clean":"2023-12-08T21:24:26.213718+0000","last_became_active":"2023-12-08T20:55:04.530774+0000","last_became_peered":"2023-12-08T20:55:04.530774+0000","last_unstale":"2023-12-08T21:24:26.213718+0000","last_undegraded":"2023-12-08T21:24:26.213718+0000","last_fullsized":"2023-12-08T21:24:26.213718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:39:26.927665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.560779+0000","last_change":"2023-12-08T20:54:56.391492+0000","last_active":"2023-12-08T21:25:37.560779+0000","last_peered":"2023-12-08T21:25:37.560779+0000","last_clean":"2023-12-08T21:25:37.560779+0000","last_became_active":"2023-12-08T20:54:56.385090+0000","last_became_peered":"2023-12-08T20:54:56.385090+0000","last_unstale":"2023-12-08T21:25:37.560779+0000","last_undegraded":"2023-12-08T21:25:37.560779+0000","last_fullsized":"2023-12-08T21:25:37.560779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:21:29.009005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'6","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:00.493188+0000","last_change":"2023-12-08T20:54:54.932503+0000","last_active":"2023-12-08T21:25:00.493188+0000","last_peered":"2023-12-08T21:25:00.493188+0000","last_clean":"2023-12-08T21:25:00.493188+0000","last_became_active":"2023-12-08T20:54:54.932121+0000","last_became_peered":"2023-12-08T20:54:54.932121+0000","last_unstale":"2023-12-08T21:25:00.493188+0000","last_undegraded":"2023-12-08T21:25:00.493188+0000","last_fullsized":"2023-12-08T21:25:00.493188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:58.013744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'55","reported_seq":84,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:17.818790+0000","last_change":"2023-12-08T20:55:04.529911+0000","last_active":"2023-12-08T21:24:17.818790+0000","last_peered":"2023-12-08T21:24:17.818790+0000","last_clean":"2023-12-08T21:24:17.818790+0000","last_became_active":"2023-12-08T20:55:04.528698+0000","last_became_peered":"2023-12-08T20:55:04.528698+0000","last_unstale":"2023-12-08T21:24:17.818790+0000","last_undegraded":"2023-12-08T21:24:17.818790+0000","last_fullsized":"2023-12-08T21:24:17.818790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:33:11.874876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'24","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546193+0000","last_change":"2023-12-08T20:54:56.413886+0000","last_active":"2023-12-08T21:25:37.546193+0000","last_peered":"2023-12-08T21:25:37.546193+0000","last_clean":"2023-12-08T21:25:37.546193+0000","last_became_active":"2023-12-08T20:54:56.412786+0000","last_became_peered":"2023-12-08T20:54:56.412786+0000","last_unstale":"2023-12-08T21:25:37.546193+0000","last_undegraded":"2023-12-08T21:25:37.546193+0000","last_fullsized":"2023-12-08T21:25:37.546193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:39.331476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'576","reported_seq":1185,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:34.738873+0000","last_change":"2023-12-08T20:54:54.922605+0000","last_active":"2023-12-08T21:25:34.738873+0000","last_peered":"2023-12-08T21:25:34.738873+0000","last_clean":"2023-12-08T21:25:34.738873+0000","last_became_active":"2023-12-08T20:54:54.922014+0000","last_became_peered":"2023-12-08T20:54:54.922014+0000","last_unstale":"2023-12-08T21:25:34.738873+0000","last_undegraded":"2023-12-08T21:25:34.738873+0000","last_fullsized":"2023-12-08T21:25:34.738873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:08:48.601596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125475,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":574,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'71","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.296642+0000","last_change":"2023-12-08T20:55:04.509438+0000","last_active":"2023-12-08T21:24:33.296642+0000","last_peered":"2023-12-08T21:24:33.296642+0000","last_clean":"2023-12-08T21:24:33.296642+0000","last_became_active":"2023-12-08T20:55:04.508219+0000","last_became_peered":"2023-12-08T20:55:04.508219+0000","last_unstale":"2023-12-08T21:24:33.296642+0000","last_undegraded":"2023-12-08T21:24:33.296642+0000","last_fullsized":"2023-12-08T21:24:33.296642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:16:31.758437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'15","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.472707+0000","last_change":"2023-12-08T20:54:56.370599+0000","last_active":"2023-12-08T21:25:37.472707+0000","last_peered":"2023-12-08T21:25:37.472707+0000","last_clean":"2023-12-08T21:25:37.472707+0000","last_became_active":"2023-12-08T20:54:56.370121+0000","last_became_peered":"2023-12-08T20:54:56.370121+0000","last_unstale":"2023-12-08T21:25:37.472707+0000","last_undegraded":"2023-12-08T21:25:37.472707+0000","last_fullsized":"2023-12-08T21:25:37.472707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:58:13.927241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'5","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.082976+0000","last_change":"2023-12-08T20:54:54.927599+0000","last_active":"2023-12-08T21:25:04.082976+0000","last_peered":"2023-12-08T21:25:04.082976+0000","last_clean":"2023-12-08T21:25:04.082976+0000","last_became_active":"2023-12-08T20:54:54.927120+0000","last_became_peered":"2023-12-08T20:54:54.927120+0000","last_unstale":"2023-12-08T21:25:04.082976+0000","last_undegraded":"2023-12-08T21:25:04.082976+0000","last_fullsized":"2023-12-08T21:25:04.082976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:38.042201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'100","reported_seq":129,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.170138+0000","last_change":"2023-12-08T20:55:04.546945+0000","last_active":"2023-12-08T21:24:28.170138+0000","last_peered":"2023-12-08T21:24:28.170138+0000","last_clean":"2023-12-08T21:24:28.170138+0000","last_became_active":"2023-12-08T20:55:04.546439+0000","last_became_peered":"2023-12-08T20:55:04.546439+0000","last_unstale":"2023-12-08T21:24:28.170138+0000","last_undegraded":"2023-12-08T21:24:28.170138+0000","last_fullsized":"2023-12-08T21:24:28.170138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:30.484701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.698344+0000","last_change":"2023-12-08T20:54:56.372770+0000","last_active":"2023-12-08T21:25:37.698344+0000","last_peered":"2023-12-08T21:25:37.698344+0000","last_clean":"2023-12-08T21:25:37.698344+0000","last_became_active":"2023-12-08T20:54:56.372205+0000","last_became_peered":"2023-12-08T20:54:56.372205+0000","last_unstale":"2023-12-08T21:25:37.698344+0000","last_undegraded":"2023-12-08T21:25:37.698344+0000","last_fullsized":"2023-12-08T21:25:37.698344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:06.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:05.621357+0000","last_change":"2023-12-08T20:54:54.929937+0000","last_active":"2023-12-08T21:25:05.621357+0000","last_peered":"2023-12-08T21:25:05.621357+0000","last_clean":"2023-12-08T21:25:05.621357+0000","last_became_active":"2023-12-08T20:54:54.929177+0000","last_became_peered":"2023-12-08T20:54:54.929177+0000","last_unstale":"2023-12-08T21:25:05.621357+0000","last_undegraded":"2023-12-08T21:25:05.621357+0000","last_fullsized":"2023-12-08T21:25:05.621357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:39:58.988364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:22:24.292691+0000","last_change":"2023-12-08T20:54:16.149485+0000","last_active":"2023-12-08T21:22:24.292691+0000","last_peered":"2023-12-08T21:22:24.292691+0000","last_clean":"2023-12-08T21:22:24.292691+0000","last_became_active":"2023-12-08T20:54:16.147507+0000","last_became_peered":"2023-12-08T20:54:16.147507+0000","last_unstale":"2023-12-08T21:22:24.292691+0000","last_undegraded":"2023-12-08T21:22:24.292691+0000","last_fullsized":"2023-12-08T21:22:24.292691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_clean_scrub_stamp":"2023-12-08T20:54:14.141045+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:17.484651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'75","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:24.073710+0000","last_change":"2023-12-08T20:55:04.515531+0000","last_active":"2023-12-08T21:24:24.073710+0000","last_peered":"2023-12-08T21:24:24.073710+0000","last_clean":"2023-12-08T21:24:24.073710+0000","last_became_active":"2023-12-08T20:55:04.515200+0000","last_became_peered":"2023-12-08T20:55:04.515200+0000","last_unstale":"2023-12-08T21:24:24.073710+0000","last_undegraded":"2023-12-08T21:24:24.073710+0000","last_fullsized":"2023-12-08T21:24:24.073710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:00:08.085700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.528119+0000","last_change":"2023-12-08T20:54:56.318724+0000","last_active":"2023-12-08T21:25:37.528119+0000","last_peered":"2023-12-08T21:25:37.528119+0000","last_clean":"2023-12-08T21:25:37.528119+0000","last_became_active":"2023-12-08T20:54:56.318408+0000","last_became_peered":"2023-12-08T20:54:56.318408+0000","last_unstale":"2023-12-08T21:25:37.528119+0000","last_undegraded":"2023-12-08T21:25:37.528119+0000","last_fullsized":"2023-12-08T21:25:37.528119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:14:20.217847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:09.731159+0000","last_change":"2023-12-08T20:54:54.926031+0000","last_active":"2023-12-08T21:25:09.731159+0000","last_peered":"2023-12-08T21:25:09.731159+0000","last_clean":"2023-12-08T21:25:09.731159+0000","last_became_active":"2023-12-08T20:54:54.925610+0000","last_became_peered":"2023-12-08T20:54:54.925610+0000","last_unstale":"2023-12-08T21:25:09.731159+0000","last_undegraded":"2023-12-08T21:25:09.731159+0000","last_fullsized":"2023-12-08T21:25:09.731159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:05:08.857673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'78","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:25.041338+0000","last_change":"2023-12-08T20:55:04.523264+0000","last_active":"2023-12-08T21:24:25.041338+0000","last_peered":"2023-12-08T21:24:25.041338+0000","last_clean":"2023-12-08T21:24:25.041338+0000","last_became_active":"2023-12-08T20:55:04.522245+0000","last_became_peered":"2023-12-08T20:55:04.522245+0000","last_unstale":"2023-12-08T21:24:25.041338+0000","last_undegraded":"2023-12-08T21:24:25.041338+0000","last_fullsized":"2023-12-08T21:24:25.041338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:23.322536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.565005+0000","last_change":"2023-12-08T20:54:56.378291+0000","last_active":"2023-12-08T21:25:37.565005+0000","last_peered":"2023-12-08T21:25:37.565005+0000","last_clean":"2023-12-08T21:25:37.565005+0000","last_became_active":"2023-12-08T20:54:56.377762+0000","last_became_peered":"2023-12-08T20:54:56.377762+0000","last_unstale":"2023-12-08T21:25:37.565005+0000","last_undegraded":"2023-12-08T21:25:37.565005+0000","last_fullsized":"2023-12-08T21:25:37.565005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:11:11.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.548033+0000","last_change":"2023-12-08T20:54:54.936008+0000","last_active":"2023-12-08T21:25:04.548033+0000","last_peered":"2023-12-08T21:25:04.548033+0000","last_clean":"2023-12-08T21:25:04.548033+0000","last_became_active":"2023-12-08T20:54:54.935472+0000","last_became_peered":"2023-12-08T20:54:54.935472+0000","last_unstale":"2023-12-08T21:25:04.548033+0000","last_undegraded":"2023-12-08T21:25:04.548033+0000","last_fullsized":"2023-12-08T21:25:04.548033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:11:02.460764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'94","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:23.574475+0000","last_change":"2023-12-08T20:55:04.534674+0000","last_active":"2023-12-08T21:24:23.574475+0000","last_peered":"2023-12-08T21:24:23.574475+0000","last_clean":"2023-12-08T21:24:23.574475+0000","last_became_active":"2023-12-08T20:55:04.533305+0000","last_became_peered":"2023-12-08T20:55:04.533305+0000","last_unstale":"2023-12-08T21:24:23.574475+0000","last_undegraded":"2023-12-08T21:24:23.574475+0000","last_fullsized":"2023-12-08T21:24:23.574475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:18.790378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":6556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.570211+0000","last_change":"2023-12-08T20:54:56.380702+0000","last_active":"2023-12-08T21:25:37.570211+0000","last_peered":"2023-12-08T21:25:37.570211+0000","last_clean":"2023-12-08T21:25:37.570211+0000","last_became_active":"2023-12-08T20:54:56.379933+0000","last_became_peered":"2023-12-08T20:54:56.379933+0000","last_unstale":"2023-12-08T21:25:37.570211+0000","last_undegraded":"2023-12-08T21:25:37.570211+0000","last_fullsized":"2023-12-08T21:25:37.570211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:31:18.872161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:39.712705+0000","last_change":"2023-12-08T20:54:54.983221+0000","last_active":"2023-12-08T21:24:39.712705+0000","last_peered":"2023-12-08T21:24:39.712705+0000","last_clean":"2023-12-08T21:24:39.712705+0000","last_became_active":"2023-12-08T20:54:54.982414+0000","last_became_peered":"2023-12-08T20:54:54.982414+0000","last_unstale":"2023-12-08T21:24:39.712705+0000","last_undegraded":"2023-12-08T21:24:39.712705+0000","last_fullsized":"2023-12-08T21:24:39.712705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:36:42.874558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'68","reported_seq":97,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.192568+0000","last_change":"2023-12-08T20:55:04.515310+0000","last_active":"2023-12-08T21:24:31.192568+0000","last_peered":"2023-12-08T21:24:31.192568+0000","last_clean":"2023-12-08T21:24:31.192568+0000","last_became_active":"2023-12-08T20:55:04.514907+0000","last_became_peered":"2023-12-08T20:55:04.514907+0000","last_unstale":"2023-12-08T21:24:31.192568+0000","last_undegraded":"2023-12-08T21:24:31.192568+0000","last_fullsized":"2023-12-08T21:24:31.192568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:26:19.536478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.683664+0000","last_change":"2023-12-08T20:54:56.378176+0000","last_active":"2023-12-08T21:25:37.683664+0000","last_peered":"2023-12-08T21:25:37.683664+0000","last_clean":"2023-12-08T21:25:37.683664+0000","last_became_active":"2023-12-08T20:54:56.377430+0000","last_became_peered":"2023-12-08T20:54:56.377430+0000","last_unstale":"2023-12-08T21:25:37.683664+0000","last_undegraded":"2023-12-08T21:25:37.683664+0000","last_fullsized":"2023-12-08T21:25:37.683664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'3","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:43.669821+0000","last_change":"2023-12-08T20:54:54.926769+0000","last_active":"2023-12-08T21:24:43.669821+0000","last_peered":"2023-12-08T21:24:43.669821+0000","last_clean":"2023-12-08T21:24:43.669821+0000","last_became_active":"2023-12-08T20:54:54.926386+0000","last_became_peered":"2023-12-08T20:54:54.926386+0000","last_unstale":"2023-12-08T21:24:43.669821+0000","last_undegraded":"2023-12-08T21:24:43.669821+0000","last_fullsized":"2023-12-08T21:24:43.669821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:05.933965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'113","reported_seq":142,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.299532+0000","last_change":"2023-12-08T20:55:04.523709+0000","last_active":"2023-12-08T21:24:33.299532+0000","last_peered":"2023-12-08T21:24:33.299532+0000","last_clean":"2023-12-08T21:24:33.299532+0000","last_became_active":"2023-12-08T20:55:04.523074+0000","last_became_peered":"2023-12-08T20:55:04.523074+0000","last_unstale":"2023-12-08T21:24:33.299532+0000","last_undegraded":"2023-12-08T21:24:33.299532+0000","last_fullsized":"2023-12-08T21:24:33.299532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":11577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.525199+0000","last_change":"2023-12-08T20:54:56.373188+0000","last_active":"2023-12-08T21:25:37.525199+0000","last_peered":"2023-12-08T21:25:37.525199+0000","last_clean":"2023-12-08T21:25:37.525199+0000","last_became_active":"2023-12-08T20:54:56.371132+0000","last_became_peered":"2023-12-08T20:54:56.371132+0000","last_unstale":"2023-12-08T21:25:37.525199+0000","last_undegraded":"2023-12-08T21:25:37.525199+0000","last_fullsized":"2023-12-08T21:25:37.525199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:30:06.387412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'14","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:28.682828+0000","last_change":"2023-12-08T20:54:54.985432+0000","last_active":"2023-12-08T21:25:28.682828+0000","last_peered":"2023-12-08T21:25:28.682828+0000","last_clean":"2023-12-08T21:25:28.682828+0000","last_became_active":"2023-12-08T20:54:54.984661+0000","last_became_peered":"2023-12-08T20:54:54.984661+0000","last_unstale":"2023-12-08T21:25:28.682828+0000","last_undegraded":"2023-12-08T21:25:28.682828+0000","last_fullsized":"2023-12-08T21:25:28.682828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:16:34.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'88","reported_seq":115,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.177978+0000","last_change":"2023-12-08T20:55:04.543349+0000","last_active":"2023-12-08T21:24:31.177978+0000","last_peered":"2023-12-08T21:24:31.177978+0000","last_clean":"2023-12-08T21:24:31.177978+0000","last_became_active":"2023-12-08T20:55:04.541074+0000","last_became_peered":"2023-12-08T20:55:04.541074+0000","last_unstale":"2023-12-08T21:24:31.177978+0000","last_undegraded":"2023-12-08T21:24:31.177978+0000","last_fullsized":"2023-12-08T21:24:31.177978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:35.399668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.566458+0000","last_change":"2023-12-08T20:54:56.413772+0000","last_active":"2023-12-08T21:25:37.566458+0000","last_peered":"2023-12-08T21:25:37.566458+0000","last_clean":"2023-12-08T21:25:37.566458+0000","last_became_active":"2023-12-08T20:54:56.413023+0000","last_became_peered":"2023-12-08T20:54:56.413023+0000","last_unstale":"2023-12-08T21:25:37.566458+0000","last_undegraded":"2023-12-08T21:25:37.566458+0000","last_fullsized":"2023-12-08T21:25:37.566458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'1","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:54.150090+0000","last_change":"2023-12-08T20:54:54.929238+0000","last_active":"2023-12-08T21:24:54.150090+0000","last_peered":"2023-12-08T21:24:54.150090+0000","last_clean":"2023-12-08T21:24:54.150090+0000","last_became_active":"2023-12-08T20:54:54.928543+0000","last_became_peered":"2023-12-08T20:54:54.928543+0000","last_unstale":"2023-12-08T21:24:54.150090+0000","last_undegraded":"2023-12-08T21:24:54.150090+0000","last_fullsized":"2023-12-08T21:24:54.150090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:04.997415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'85","reported_seq":112,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.170336+0000","last_change":"2023-12-08T20:55:04.540347+0000","last_active":"2023-12-08T21:24:31.170336+0000","last_peered":"2023-12-08T21:24:31.170336+0000","last_clean":"2023-12-08T21:24:31.170336+0000","last_became_active":"2023-12-08T20:55:04.535002+0000","last_became_peered":"2023-12-08T20:55:04.535002+0000","last_unstale":"2023-12-08T21:24:31.170336+0000","last_undegraded":"2023-12-08T21:24:31.170336+0000","last_fullsized":"2023-12-08T21:24:31.170336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:09.576246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'40","reported_seq":80,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526171+0000","last_change":"2023-12-08T20:56:00.382392+0000","last_active":"2023-12-08T21:25:37.526171+0000","last_peered":"2023-12-08T21:25:37.526171+0000","last_clean":"2023-12-08T21:25:37.526171+0000","last_became_active":"2023-12-08T20:56:00.381771+0000","last_became_peered":"2023-12-08T20:56:00.381771+0000","last_unstale":"2023-12-08T21:25:37.526171+0000","last_undegraded":"2023-12-08T21:25:37.526171+0000","last_fullsized":"2023-12-08T21:25:37.526171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:08:00.588477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'5","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:26.733534+0000","last_change":"2023-12-08T20:54:54.930839+0000","last_active":"2023-12-08T21:25:26.733534+0000","last_peered":"2023-12-08T21:25:26.733534+0000","last_clean":"2023-12-08T21:25:26.733534+0000","last_became_active":"2023-12-08T20:54:54.928065+0000","last_became_peered":"2023-12-08T20:54:54.928065+0000","last_unstale":"2023-12-08T21:25:26.733534+0000","last_undegraded":"2023-12-08T21:25:26.733534+0000","last_fullsized":"2023-12-08T21:25:26.733534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:28.708543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'59","reported_seq":87,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.072418+0000","last_change":"2023-12-08T20:55:04.520698+0000","last_active":"2023-12-08T21:24:31.072418+0000","last_peered":"2023-12-08T21:24:31.072418+0000","last_clean":"2023-12-08T21:24:31.072418+0000","last_became_active":"2023-12-08T20:55:04.516783+0000","last_became_peered":"2023-12-08T20:55:04.516783+0000","last_unstale":"2023-12-08T21:24:31.072418+0000","last_undegraded":"2023-12-08T21:24:31.072418+0000","last_fullsized":"2023-12-08T21:24:31.072418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:46:00.331700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.459902+0000","last_change":"2023-12-08T20:54:56.331045+0000","last_active":"2023-12-08T21:25:37.459902+0000","last_peered":"2023-12-08T21:25:37.459902+0000","last_clean":"2023-12-08T21:25:37.459902+0000","last_became_active":"2023-12-08T20:54:56.330346+0000","last_became_peered":"2023-12-08T20:54:56.330346+0000","last_unstale":"2023-12-08T21:25:37.459902+0000","last_undegraded":"2023-12-08T21:25:37.459902+0000","last_fullsized":"2023-12-08T21:25:37.459902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:43:36.950589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:58.411679+0000","last_change":"2023-12-08T20:54:54.927094+0000","last_active":"2023-12-08T21:24:58.411679+0000","last_peered":"2023-12-08T21:24:58.411679+0000","last_clean":"2023-12-08T21:24:58.411679+0000","last_became_active":"2023-12-08T20:54:54.926435+0000","last_became_peered":"2023-12-08T20:54:54.926435+0000","last_unstale":"2023-12-08T21:24:58.411679+0000","last_undegraded":"2023-12-08T21:24:58.411679+0000","last_fullsized":"2023-12-08T21:24:58.411679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'79","reported_seq":106,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.481627+0000","last_change":"2023-12-08T20:55:04.534630+0000","last_active":"2023-12-08T21:24:30.481627+0000","last_peered":"2023-12-08T21:24:30.481627+0000","last_clean":"2023-12-08T21:24:30.481627+0000","last_became_active":"2023-12-08T20:55:04.534289+0000","last_became_peered":"2023-12-08T20:55:04.534289+0000","last_unstale":"2023-12-08T21:24:30.481627+0000","last_undegraded":"2023-12-08T21:24:30.481627+0000","last_fullsized":"2023-12-08T21:24:30.481627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:36:33.771845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'24","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.564735+0000","last_change":"2023-12-08T20:54:56.376691+0000","last_active":"2023-12-08T21:25:37.564735+0000","last_peered":"2023-12-08T21:25:37.564735+0000","last_clean":"2023-12-08T21:25:37.564735+0000","last_became_active":"2023-12-08T20:54:56.375922+0000","last_became_peered":"2023-12-08T20:54:56.375922+0000","last_unstale":"2023-12-08T21:25:37.564735+0000","last_undegraded":"2023-12-08T21:25:37.564735+0000","last_fullsized":"2023-12-08T21:25:37.564735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:37:56.593406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'890","reported_seq":924,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.079615+0000","last_change":"2023-12-08T20:54:54.978427+0000","last_active":"2023-12-08T21:25:24.079615+0000","last_peered":"2023-12-08T21:25:24.079615+0000","last_clean":"2023-12-08T21:25:24.079615+0000","last_became_active":"2023-12-08T20:54:54.977999+0000","last_became_peered":"2023-12-08T20:54:54.977999+0000","last_unstale":"2023-12-08T21:25:24.079615+0000","last_undegraded":"2023-12-08T21:25:24.079615+0000","last_fullsized":"2023-12-08T21:25:24.079615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":887,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'80","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.225499+0000","last_change":"2023-12-08T20:55:04.522691+0000","last_active":"2023-12-08T21:24:28.225499+0000","last_peered":"2023-12-08T21:24:28.225499+0000","last_clean":"2023-12-08T21:24:28.225499+0000","last_became_active":"2023-12-08T20:55:04.522190+0000","last_became_peered":"2023-12-08T20:55:04.522190+0000","last_unstale":"2023-12-08T21:24:28.225499+0000","last_undegraded":"2023-12-08T21:24:28.225499+0000","last_fullsized":"2023-12-08T21:24:28.225499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:52.945031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526963+0000","last_change":"2023-12-08T20:54:56.384439+0000","last_active":"2023-12-08T21:25:37.526963+0000","last_peered":"2023-12-08T21:25:37.526963+0000","last_clean":"2023-12-08T21:25:37.526963+0000","last_became_active":"2023-12-08T20:54:56.383561+0000","last_became_peered":"2023-12-08T20:54:56.383561+0000","last_unstale":"2023-12-08T21:25:37.526963+0000","last_undegraded":"2023-12-08T21:25:37.526963+0000","last_fullsized":"2023-12-08T21:25:37.526963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:01.328480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'406","reported_seq":439,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:28.706595+0000","last_change":"2023-12-08T20:54:54.980625+0000","last_active":"2023-12-08T21:25:28.706595+0000","last_peered":"2023-12-08T21:25:28.706595+0000","last_clean":"2023-12-08T21:25:28.706595+0000","last_became_active":"2023-12-08T20:54:54.980023+0000","last_became_peered":"2023-12-08T20:54:54.980023+0000","last_unstale":"2023-12-08T21:25:28.706595+0000","last_undegraded":"2023-12-08T21:25:28.706595+0000","last_fullsized":"2023-12-08T21:25:28.706595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:44:27.401600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'116","reported_seq":144,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.295564+0000","last_change":"2023-12-08T20:55:04.523658+0000","last_active":"2023-12-08T21:24:33.295564+0000","last_peered":"2023-12-08T21:24:33.295564+0000","last_clean":"2023-12-08T21:24:33.295564+0000","last_became_active":"2023-12-08T20:55:04.522325+0000","last_became_peered":"2023-12-08T20:55:04.522325+0000","last_unstale":"2023-12-08T21:24:33.295564+0000","last_undegraded":"2023-12-08T21:24:33.295564+0000","last_fullsized":"2023-12-08T21:24:33.295564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:32:03.125815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":12653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'29","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546655+0000","last_change":"2023-12-08T20:54:56.410075+0000","last_active":"2023-12-08T21:25:37.546655+0000","last_peered":"2023-12-08T21:25:37.546655+0000","last_clean":"2023-12-08T21:25:37.546655+0000","last_became_active":"2023-12-08T20:54:56.409539+0000","last_became_peered":"2023-12-08T20:54:56.409539+0000","last_unstale":"2023-12-08T21:25:37.546655+0000","last_undegraded":"2023-12-08T21:25:37.546655+0000","last_fullsized":"2023-12-08T21:25:37.546655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:37:03.173965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:11.858914+0000","last_change":"2023-12-08T20:54:54.936311+0000","last_active":"2023-12-08T21:25:11.858914+0000","last_peered":"2023-12-08T21:25:11.858914+0000","last_clean":"2023-12-08T21:25:11.858914+0000","last_became_active":"2023-12-08T20:54:54.935889+0000","last_became_peered":"2023-12-08T20:54:54.935889+0000","last_unstale":"2023-12-08T21:25:11.858914+0000","last_undegraded":"2023-12-08T21:25:11.858914+0000","last_fullsized":"2023-12-08T21:25:11.858914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:13.785495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'68","reported_seq":92,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:08.154547+0000","last_change":"2023-12-08T20:56:00.560908+0000","last_active":"2023-12-08T21:24:08.154547+0000","last_peered":"2023-12-08T21:24:08.154547+0000","last_clean":"2023-12-08T21:24:08.154547+0000","last_became_active":"2023-12-08T20:56:00.560282+0000","last_became_peered":"2023-12-08T20:56:00.560282+0000","last_unstale":"2023-12-08T21:24:08.154547+0000","last_undegraded":"2023-12-08T21:24:08.154547+0000","last_fullsized":"2023-12-08T21:24:08.154547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:48:24.748646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":7515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.687754+0000","last_change":"2023-12-08T20:54:56.376709+0000","last_active":"2023-12-08T21:25:37.687754+0000","last_peered":"2023-12-08T21:25:37.687754+0000","last_clean":"2023-12-08T21:25:37.687754+0000","last_became_active":"2023-12-08T20:54:56.369709+0000","last_became_peered":"2023-12-08T20:54:56.369709+0000","last_unstale":"2023-12-08T21:25:37.687754+0000","last_undegraded":"2023-12-08T21:25:37.687754+0000","last_fullsized":"2023-12-08T21:25:37.687754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:06.577773+0000","last_change":"2023-12-08T20:54:54.980040+0000","last_active":"2023-12-08T21:25:06.577773+0000","last_peered":"2023-12-08T21:25:06.577773+0000","last_clean":"2023-12-08T21:25:06.577773+0000","last_became_active":"2023-12-08T20:54:54.979751+0000","last_became_peered":"2023-12-08T20:54:54.979751+0000","last_unstale":"2023-12-08T21:25:06.577773+0000","last_undegraded":"2023-12-08T21:25:06.577773+0000","last_fullsized":"2023-12-08T21:25:06.577773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:08.789175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'79","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.293956+0000","last_change":"2023-12-08T20:55:04.513429+0000","last_active":"2023-12-08T21:24:33.293956+0000","last_peered":"2023-12-08T21:24:33.293956+0000","last_clean":"2023-12-08T21:24:33.293956+0000","last_became_active":"2023-12-08T20:55:04.511405+0000","last_became_peered":"2023-12-08T20:55:04.511405+0000","last_unstale":"2023-12-08T21:24:33.293956+0000","last_undegraded":"2023-12-08T21:24:33.293956+0000","last_fullsized":"2023-12-08T21:24:33.293956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:48:08.081679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.225720+0000","last_change":"2023-12-08T20:55:04.537067+0000","last_active":"2023-12-08T21:24:28.225720+0000","last_peered":"2023-12-08T21:24:28.225720+0000","last_clean":"2023-12-08T21:24:28.225720+0000","last_became_active":"2023-12-08T20:55:04.536497+0000","last_became_peered":"2023-12-08T20:55:04.536497+0000","last_unstale":"2023-12-08T21:24:28.225720+0000","last_undegraded":"2023-12-08T21:24:28.225720+0000","last_fullsized":"2023-12-08T21:24:28.225720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:49.322641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.702440+0000","last_change":"2023-12-08T20:54:56.318249+0000","last_active":"2023-12-08T21:25:37.702440+0000","last_peered":"2023-12-08T21:25:37.702440+0000","last_clean":"2023-12-08T21:25:37.702440+0000","last_became_active":"2023-12-08T20:54:56.317895+0000","last_became_peered":"2023-12-08T20:54:56.317895+0000","last_unstale":"2023-12-08T21:25:37.702440+0000","last_undegraded":"2023-12-08T21:25:37.702440+0000","last_fullsized":"2023-12-08T21:25:37.702440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:47:45.185235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'4","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:20.438586+0000","last_change":"2023-12-08T20:54:54.935924+0000","last_active":"2023-12-08T21:25:20.438586+0000","last_peered":"2023-12-08T21:25:20.438586+0000","last_clean":"2023-12-08T21:25:20.438586+0000","last_became_active":"2023-12-08T20:54:54.935578+0000","last_became_peered":"2023-12-08T20:54:54.935578+0000","last_unstale":"2023-12-08T21:25:20.438586+0000","last_undegraded":"2023-12-08T21:25:20.438586+0000","last_fullsized":"2023-12-08T21:25:20.438586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:22.627774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'80","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:25.039486+0000","last_change":"2023-12-08T20:55:04.535940+0000","last_active":"2023-12-08T21:24:25.039486+0000","last_peered":"2023-12-08T21:24:25.039486+0000","last_clean":"2023-12-08T21:24:25.039486+0000","last_became_active":"2023-12-08T20:55:04.535525+0000","last_became_peered":"2023-12-08T20:55:04.535525+0000","last_unstale":"2023-12-08T21:24:25.039486+0000","last_undegraded":"2023-12-08T21:24:25.039486+0000","last_fullsized":"2023-12-08T21:24:25.039486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:30:14.451021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":11364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546710+0000","last_change":"2023-12-08T20:54:56.413484+0000","last_active":"2023-12-08T21:25:37.546710+0000","last_peered":"2023-12-08T21:25:37.546710+0000","last_clean":"2023-12-08T21:25:37.546710+0000","last_became_active":"2023-12-08T20:54:56.412133+0000","last_became_peered":"2023-12-08T20:54:56.412133+0000","last_unstale":"2023-12-08T21:25:37.546710+0000","last_undegraded":"2023-12-08T21:25:37.546710+0000","last_fullsized":"2023-12-08T21:25:37.546710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:41:41.172811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:54.123528+0000","last_change":"2023-12-08T20:54:54.927237+0000","last_active":"2023-12-08T21:24:54.123528+0000","last_peered":"2023-12-08T21:24:54.123528+0000","last_clean":"2023-12-08T21:24:54.123528+0000","last_became_active":"2023-12-08T20:54:54.926804+0000","last_became_peered":"2023-12-08T20:54:54.926804+0000","last_unstale":"2023-12-08T21:24:54.123528+0000","last_undegraded":"2023-12-08T21:24:54.123528+0000","last_fullsized":"2023-12-08T21:24:54.123528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:30:21.341630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'615","reported_seq":648,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:27.777967+0000","last_change":"2023-12-08T20:54:54.931212+0000","last_active":"2023-12-08T21:25:27.777967+0000","last_peered":"2023-12-08T21:25:27.777967+0000","last_clean":"2023-12-08T21:25:27.777967+0000","last_became_active":"2023-12-08T20:54:54.930324+0000","last_became_peered":"2023-12-08T20:54:54.930324+0000","last_unstale":"2023-12-08T21:25:27.777967+0000","last_undegraded":"2023-12-08T21:25:27.777967+0000","last_fullsized":"2023-12-08T21:25:27.777967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:54.461219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.704911+0000","last_change":"2023-12-08T20:54:56.383879+0000","last_active":"2023-12-08T21:25:37.704911+0000","last_peered":"2023-12-08T21:25:37.704911+0000","last_clean":"2023-12-08T21:25:37.704911+0000","last_became_active":"2023-12-08T20:54:56.383467+0000","last_became_peered":"2023-12-08T20:54:56.383467+0000","last_unstale":"2023-12-08T21:25:37.704911+0000","last_undegraded":"2023-12-08T21:25:37.704911+0000","last_fullsized":"2023-12-08T21:25:37.704911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:59.236467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'50","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.296513+0000","last_change":"2023-12-08T20:55:04.541743+0000","last_active":"2023-12-08T21:24:33.296513+0000","last_peered":"2023-12-08T21:24:33.296513+0000","last_clean":"2023-12-08T21:24:33.296513+0000","last_became_active":"2023-12-08T20:55:04.536537+0000","last_became_peered":"2023-12-08T20:55:04.536537+0000","last_unstale":"2023-12-08T21:24:33.296513+0000","last_undegraded":"2023-12-08T21:24:33.296513+0000","last_fullsized":"2023-12-08T21:24:33.296513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:45.443252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'553","reported_seq":586,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:09.778328+0000","last_change":"2023-12-08T20:54:54.925711+0000","last_active":"2023-12-08T21:25:09.778328+0000","last_peered":"2023-12-08T21:25:09.778328+0000","last_clean":"2023-12-08T21:25:09.778328+0000","last_became_active":"2023-12-08T20:54:54.925229+0000","last_became_peered":"2023-12-08T20:54:54.925229+0000","last_unstale":"2023-12-08T21:25:09.778328+0000","last_undegraded":"2023-12-08T21:25:09.778328+0000","last_fullsized":"2023-12-08T21:25:09.778328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:33:15.472131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'20","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.570598+0000","last_change":"2023-12-08T20:54:56.404755+0000","last_active":"2023-12-08T21:25:37.570598+0000","last_peered":"2023-12-08T21:25:37.570598+0000","last_clean":"2023-12-08T21:25:37.570598+0000","last_became_active":"2023-12-08T20:54:56.403996+0000","last_became_peered":"2023-12-08T20:54:56.403996+0000","last_unstale":"2023-12-08T21:25:37.570598+0000","last_undegraded":"2023-12-08T21:25:37.570598+0000","last_fullsized":"2023-12-08T21:25:37.570598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'97","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.091219+0000","last_change":"2023-12-08T20:55:04.523477+0000","last_active":"2023-12-08T21:24:30.091219+0000","last_peered":"2023-12-08T21:24:30.091219+0000","last_clean":"2023-12-08T21:24:30.091219+0000","last_became_active":"2023-12-08T20:55:04.523137+0000","last_became_peered":"2023-12-08T20:55:04.523137+0000","last_unstale":"2023-12-08T21:24:30.091219+0000","last_undegraded":"2023-12-08T21:24:30.091219+0000","last_fullsized":"2023-12-08T21:24:30.091219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"30'37","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.669831+0000","last_change":"2023-12-08T20:54:56.379055+0000","last_active":"2023-12-08T21:25:37.669831+0000","last_peered":"2023-12-08T21:25:37.669831+0000","last_clean":"2023-12-08T21:25:37.669831+0000","last_became_active":"2023-12-08T20:54:56.373080+0000","last_became_peered":"2023-12-08T20:54:56.373080+0000","last_unstale":"2023-12-08T21:25:37.669831+0000","last_undegraded":"2023-12-08T21:25:37.669831+0000","last_fullsized":"2023-12-08T21:25:37.669831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'27","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.464046+0000","last_change":"2023-12-08T20:54:56.378688+0000","last_active":"2023-12-08T21:25:37.464046+0000","last_peered":"2023-12-08T21:25:37.464046+0000","last_clean":"2023-12-08T21:25:37.464046+0000","last_became_active":"2023-12-08T20:54:56.378154+0000","last_became_peered":"2023-12-08T20:54:56.378154+0000","last_unstale":"2023-12-08T21:25:37.464046+0000","last_undegraded":"2023-12-08T21:25:37.464046+0000","last_fullsized":"2023-12-08T21:25:37.464046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:22:06.625769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'26","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526690+0000","last_change":"2023-12-08T20:54:56.410526+0000","last_active":"2023-12-08T21:25:37.526690+0000","last_peered":"2023-12-08T21:25:37.526690+0000","last_clean":"2023-12-08T21:25:37.526690+0000","last_became_active":"2023-12-08T20:54:56.409863+0000","last_became_peered":"2023-12-08T20:54:56.409863+0000","last_unstale":"2023-12-08T21:25:37.526690+0000","last_undegraded":"2023-12-08T21:25:37.526690+0000","last_fullsized":"2023-12-08T21:25:37.526690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:10.542611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546309+0000","last_change":"2023-12-08T20:54:56.408750+0000","last_active":"2023-12-08T21:25:37.546309+0000","last_peered":"2023-12-08T21:25:37.546309+0000","last_clean":"2023-12-08T21:25:37.546309+0000","last_became_active":"2023-12-08T20:54:56.408205+0000","last_became_peered":"2023-12-08T20:54:56.408205+0000","last_unstale":"2023-12-08T21:25:37.546309+0000","last_undegraded":"2023-12-08T21:25:37.546309+0000","last_fullsized":"2023-12-08T21:25:37.546309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:55.750494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'16","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.474033+0000","last_change":"2023-12-08T20:54:56.386660+0000","last_active":"2023-12-08T21:25:37.474033+0000","last_peered":"2023-12-08T21:25:37.474033+0000","last_clean":"2023-12-08T21:25:37.474033+0000","last_became_active":"2023-12-08T20:54:56.386344+0000","last_became_peered":"2023-12-08T20:54:56.386344+0000","last_unstale":"2023-12-08T21:25:37.474033+0000","last_undegraded":"2023-12-08T21:25:37.474033+0000","last_fullsized":"2023-12-08T21:25:37.474033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:33:27.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.466511+0000","last_change":"2023-12-08T20:54:56.367640+0000","last_active":"2023-12-08T21:25:37.466511+0000","last_peered":"2023-12-08T21:25:37.466511+0000","last_clean":"2023-12-08T21:25:37.466511+0000","last_became_active":"2023-12-08T20:54:56.366967+0000","last_became_peered":"2023-12-08T20:54:56.366967+0000","last_unstale":"2023-12-08T21:25:37.466511+0000","last_undegraded":"2023-12-08T21:25:37.466511+0000","last_fullsized":"2023-12-08T21:25:37.466511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:22:24.171129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'32","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.686312+0000","last_change":"2023-12-08T20:54:56.376663+0000","last_active":"2023-12-08T21:25:37.686312+0000","last_peered":"2023-12-08T21:25:37.686312+0000","last_clean":"2023-12-08T21:25:37.686312+0000","last_became_active":"2023-12-08T20:54:56.371954+0000","last_became_peered":"2023-12-08T20:54:56.371954+0000","last_unstale":"2023-12-08T21:25:37.686312+0000","last_undegraded":"2023-12-08T21:25:37.686312+0000","last_fullsized":"2023-12-08T21:25:37.686312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546047+0000","last_change":"2023-12-08T20:54:56.410398+0000","last_active":"2023-12-08T21:25:37.546047+0000","last_peered":"2023-12-08T21:25:37.546047+0000","last_clean":"2023-12-08T21:25:37.546047+0000","last_became_active":"2023-12-08T20:54:56.409462+0000","last_became_peered":"2023-12-08T20:54:56.409462+0000","last_unstale":"2023-12-08T21:25:37.546047+0000","last_undegraded":"2023-12-08T21:25:37.546047+0000","last_fullsized":"2023-12-08T21:25:37.546047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:07:04.340773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'18","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526793+0000","last_change":"2023-12-08T20:54:56.415800+0000","last_active":"2023-12-08T21:25:37.526793+0000","last_peered":"2023-12-08T21:25:37.526793+0000","last_clean":"2023-12-08T21:25:37.526793+0000","last_became_active":"2023-12-08T20:54:56.415176+0000","last_became_peered":"2023-12-08T20:54:56.415176+0000","last_unstale":"2023-12-08T21:25:37.526793+0000","last_undegraded":"2023-12-08T21:25:37.526793+0000","last_fullsized":"2023-12-08T21:25:37.526793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:24:27.173941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548502+0000","last_change":"2023-12-08T20:54:56.401521+0000","last_active":"2023-12-08T21:25:37.548502+0000","last_peered":"2023-12-08T21:25:37.548502+0000","last_clean":"2023-12-08T21:25:37.548502+0000","last_became_active":"2023-12-08T20:54:56.400980+0000","last_became_peered":"2023-12-08T20:54:56.400980+0000","last_unstale":"2023-12-08T21:25:37.548502+0000","last_undegraded":"2023-12-08T21:25:37.548502+0000","last_fullsized":"2023-12-08T21:25:37.548502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:42.093754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.570548+0000","last_change":"2023-12-08T20:54:56.387218+0000","last_active":"2023-12-08T21:25:37.570548+0000","last_peered":"2023-12-08T21:25:37.570548+0000","last_clean":"2023-12-08T21:25:37.570548+0000","last_became_active":"2023-12-08T20:54:56.386413+0000","last_became_peered":"2023-12-08T20:54:56.386413+0000","last_unstale":"2023-12-08T21:25:37.570548+0000","last_undegraded":"2023-12-08T21:25:37.570548+0000","last_fullsized":"2023-12-08T21:25:37.570548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.704536+0000","last_change":"2023-12-08T20:54:56.371962+0000","last_active":"2023-12-08T21:25:37.704536+0000","last_peered":"2023-12-08T21:25:37.704536+0000","last_clean":"2023-12-08T21:25:37.704536+0000","last_became_active":"2023-12-08T20:54:56.371456+0000","last_became_peered":"2023-12-08T20:54:56.371456+0000","last_unstale":"2023-12-08T21:25:37.704536+0000","last_undegraded":"2023-12-08T21:25:37.704536+0000","last_fullsized":"2023-12-08T21:25:37.704536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:01.725223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572196+0000","last_change":"2023-12-08T20:54:56.381311+0000","last_active":"2023-12-08T21:25:37.572196+0000","last_peered":"2023-12-08T21:25:37.572196+0000","last_clean":"2023-12-08T21:25:37.572196+0000","last_became_active":"2023-12-08T20:54:56.380860+0000","last_became_peered":"2023-12-08T20:54:56.380860+0000","last_unstale":"2023-12-08T21:25:37.572196+0000","last_undegraded":"2023-12-08T21:25:37.572196+0000","last_fullsized":"2023-12-08T21:25:37.572196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:11:11.173329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.527856+0000","last_change":"2023-12-08T20:54:56.261370+0000","last_active":"2023-12-08T21:25:37.527856+0000","last_peered":"2023-12-08T21:25:37.527856+0000","last_clean":"2023-12-08T21:25:37.527856+0000","last_became_active":"2023-12-08T20:54:56.260387+0000","last_became_peered":"2023-12-08T20:54:56.260387+0000","last_unstale":"2023-12-08T21:25:37.527856+0000","last_undegraded":"2023-12-08T21:25:37.527856+0000","last_fullsized":"2023-12-08T21:25:37.527856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:17:07.046357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.468545+0000","last_change":"2023-12-08T20:54:56.388280+0000","last_active":"2023-12-08T21:25:37.468545+0000","last_peered":"2023-12-08T21:25:37.468545+0000","last_clean":"2023-12-08T21:25:37.468545+0000","last_became_active":"2023-12-08T20:54:56.387774+0000","last_became_peered":"2023-12-08T20:54:56.387774+0000","last_unstale":"2023-12-08T21:25:37.468545+0000","last_undegraded":"2023-12-08T21:25:37.468545+0000","last_fullsized":"2023-12-08T21:25:37.468545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:15:20.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.530020+0000","last_change":"2023-12-08T20:54:56.378804+0000","last_active":"2023-12-08T21:25:37.530020+0000","last_peered":"2023-12-08T21:25:37.530020+0000","last_clean":"2023-12-08T21:25:37.530020+0000","last_became_active":"2023-12-08T20:54:56.377029+0000","last_became_peered":"2023-12-08T20:54:56.377029+0000","last_unstale":"2023-12-08T21:25:37.530020+0000","last_undegraded":"2023-12-08T21:25:37.530020+0000","last_fullsized":"2023-12-08T21:25:37.530020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:55:29.247824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526742+0000","last_change":"2023-12-08T20:54:56.372118+0000","last_active":"2023-12-08T21:25:37.526742+0000","last_peered":"2023-12-08T21:25:37.526742+0000","last_clean":"2023-12-08T21:25:37.526742+0000","last_became_active":"2023-12-08T20:54:56.370707+0000","last_became_peered":"2023-12-08T20:54:56.370707+0000","last_unstale":"2023-12-08T21:25:37.526742+0000","last_undegraded":"2023-12-08T21:25:37.526742+0000","last_fullsized":"2023-12-08T21:25:37.526742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:35.994091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.552611+0000","last_change":"2023-12-08T20:54:56.405033+0000","last_active":"2023-12-08T21:25:37.552611+0000","last_peered":"2023-12-08T21:25:37.552611+0000","last_clean":"2023-12-08T21:25:37.552611+0000","last_became_active":"2023-12-08T20:54:56.401544+0000","last_became_peered":"2023-12-08T20:54:56.401544+0000","last_unstale":"2023-12-08T21:25:37.552611+0000","last_undegraded":"2023-12-08T21:25:37.552611+0000","last_fullsized":"2023-12-08T21:25:37.552611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:59.303019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.473127+0000","last_change":"2023-12-08T20:54:56.366037+0000","last_active":"2023-12-08T21:25:37.473127+0000","last_peered":"2023-12-08T21:25:37.473127+0000","last_clean":"2023-12-08T21:25:37.473127+0000","last_became_active":"2023-12-08T20:54:56.365432+0000","last_became_peered":"2023-12-08T20:54:56.365432+0000","last_unstale":"2023-12-08T21:25:37.473127+0000","last_undegraded":"2023-12-08T21:25:37.473127+0000","last_fullsized":"2023-12-08T21:25:37.473127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:48:49.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'32","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.474444+0000","last_change":"2023-12-08T20:54:56.393022+0000","last_active":"2023-12-08T21:25:37.474444+0000","last_peered":"2023-12-08T21:25:37.474444+0000","last_clean":"2023-12-08T21:25:37.474444+0000","last_became_active":"2023-12-08T20:54:56.392408+0000","last_became_peered":"2023-12-08T20:54:56.392408+0000","last_unstale":"2023-12-08T21:25:37.474444+0000","last_undegraded":"2023-12-08T21:25:37.474444+0000","last_fullsized":"2023-12-08T21:25:37.474444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:30:22.435898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572384+0000","last_change":"2023-12-08T20:54:56.380654+0000","last_active":"2023-12-08T21:25:37.572384+0000","last_peered":"2023-12-08T21:25:37.572384+0000","last_clean":"2023-12-08T21:25:37.572384+0000","last_became_active":"2023-12-08T20:54:56.380137+0000","last_became_peered":"2023-12-08T20:54:56.380137+0000","last_unstale":"2023-12-08T21:25:37.572384+0000","last_undegraded":"2023-12-08T21:25:37.572384+0000","last_fullsized":"2023-12-08T21:25:37.572384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:47:59.833913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'21","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.571319+0000","last_change":"2023-12-08T20:54:56.392997+0000","last_active":"2023-12-08T21:25:37.571319+0000","last_peered":"2023-12-08T21:25:37.571319+0000","last_clean":"2023-12-08T21:25:37.571319+0000","last_became_active":"2023-12-08T20:54:56.391299+0000","last_became_peered":"2023-12-08T20:54:56.391299+0000","last_unstale":"2023-12-08T21:25:37.571319+0000","last_undegraded":"2023-12-08T21:25:37.571319+0000","last_fullsized":"2023-12-08T21:25:37.571319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:37.195485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'32","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.563701+0000","last_change":"2023-12-08T20:54:56.393461+0000","last_active":"2023-12-08T21:25:37.563701+0000","last_peered":"2023-12-08T21:25:37.563701+0000","last_clean":"2023-12-08T21:25:37.563701+0000","last_became_active":"2023-12-08T20:54:56.392708+0000","last_became_peered":"2023-12-08T20:54:56.392708+0000","last_unstale":"2023-12-08T21:25:37.563701+0000","last_undegraded":"2023-12-08T21:25:37.563701+0000","last_fullsized":"2023-12-08T21:25:37.563701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:44.697264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'30","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.568850+0000","last_change":"2023-12-08T20:54:56.319183+0000","last_active":"2023-12-08T21:25:37.568850+0000","last_peered":"2023-12-08T21:25:37.568850+0000","last_clean":"2023-12-08T21:25:37.568850+0000","last_became_active":"2023-12-08T20:54:56.318400+0000","last_became_peered":"2023-12-08T20:54:56.318400+0000","last_unstale":"2023-12-08T21:25:37.568850+0000","last_undegraded":"2023-12-08T21:25:37.568850+0000","last_fullsized":"2023-12-08T21:25:37.568850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'20","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.552441+0000","last_change":"2023-12-08T20:54:56.414028+0000","last_active":"2023-12-08T21:25:37.552441+0000","last_peered":"2023-12-08T21:25:37.552441+0000","last_clean":"2023-12-08T21:25:37.552441+0000","last_became_active":"2023-12-08T20:54:56.413220+0000","last_became_peered":"2023-12-08T20:54:56.413220+0000","last_unstale":"2023-12-08T21:25:37.552441+0000","last_undegraded":"2023-12-08T21:25:37.552441+0000","last_fullsized":"2023-12-08T21:25:37.552441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:23.917049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.553915+0000","last_change":"2023-12-08T20:54:56.366203+0000","last_active":"2023-12-08T21:25:37.553915+0000","last_peered":"2023-12-08T21:25:37.553915+0000","last_clean":"2023-12-08T21:25:37.553915+0000","last_became_active":"2023-12-08T20:54:56.365448+0000","last_became_peered":"2023-12-08T20:54:56.365448+0000","last_unstale":"2023-12-08T21:25:37.553915+0000","last_undegraded":"2023-12-08T21:25:37.553915+0000","last_fullsized":"2023-12-08T21:25:37.553915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:10.405742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'25","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.673045+0000","last_change":"2023-12-08T20:54:56.373847+0000","last_active":"2023-12-08T21:25:37.673045+0000","last_peered":"2023-12-08T21:25:37.673045+0000","last_clean":"2023-12-08T21:25:37.673045+0000","last_became_active":"2023-12-08T20:54:56.369574+0000","last_became_peered":"2023-12-08T20:54:56.369574+0000","last_unstale":"2023-12-08T21:25:37.673045+0000","last_undegraded":"2023-12-08T21:25:37.673045+0000","last_fullsized":"2023-12-08T21:25:37.673045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:10.078450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'21","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.554262+0000","last_change":"2023-12-08T20:54:56.411972+0000","last_active":"2023-12-08T21:25:37.554262+0000","last_peered":"2023-12-08T21:25:37.554262+0000","last_clean":"2023-12-08T21:25:37.554262+0000","last_became_active":"2023-12-08T20:54:56.411339+0000","last_became_peered":"2023-12-08T20:54:56.411339+0000","last_unstale":"2023-12-08T21:25:37.554262+0000","last_undegraded":"2023-12-08T21:25:37.554262+0000","last_fullsized":"2023-12-08T21:25:37.554262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:41.074875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'17","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.668142+0000","last_change":"2023-12-08T20:54:56.370763+0000","last_active":"2023-12-08T21:25:37.668142+0000","last_peered":"2023-12-08T21:25:37.668142+0000","last_clean":"2023-12-08T21:25:37.668142+0000","last_became_active":"2023-12-08T20:54:56.369650+0000","last_became_peered":"2023-12-08T20:54:56.369650+0000","last_unstale":"2023-12-08T21:25:37.668142+0000","last_undegraded":"2023-12-08T21:25:37.668142+0000","last_fullsized":"2023-12-08T21:25:37.668142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548529+0000","last_change":"2023-12-08T20:54:56.409124+0000","last_active":"2023-12-08T21:25:37.548529+0000","last_peered":"2023-12-08T21:25:37.548529+0000","last_clean":"2023-12-08T21:25:37.548529+0000","last_became_active":"2023-12-08T20:54:56.408861+0000","last_became_peered":"2023-12-08T20:54:56.408861+0000","last_unstale":"2023-12-08T21:25:37.548529+0000","last_undegraded":"2023-12-08T21:25:37.548529+0000","last_fullsized":"2023-12-08T21:25:37.548529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:40:00.277639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'19","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.545814+0000","last_change":"2023-12-08T20:54:56.407010+0000","last_active":"2023-12-08T21:25:37.545814+0000","last_peered":"2023-12-08T21:25:37.545814+0000","last_clean":"2023-12-08T21:25:37.545814+0000","last_became_active":"2023-12-08T20:54:56.404697+0000","last_became_peered":"2023-12-08T20:54:56.404697+0000","last_unstale":"2023-12-08T21:25:37.545814+0000","last_undegraded":"2023-12-08T21:25:37.545814+0000","last_fullsized":"2023-12-08T21:25:37.545814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:58:49.474462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.554838+0000","last_change":"2023-12-08T20:54:56.378873+0000","last_active":"2023-12-08T21:25:37.554838+0000","last_peered":"2023-12-08T21:25:37.554838+0000","last_clean":"2023-12-08T21:25:37.554838+0000","last_became_active":"2023-12-08T20:54:56.377835+0000","last_became_peered":"2023-12-08T20:54:56.377835+0000","last_unstale":"2023-12-08T21:25:37.554838+0000","last_undegraded":"2023-12-08T21:25:37.554838+0000","last_fullsized":"2023-12-08T21:25:37.554838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:54:57.439693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2350,"num_write_kb":252630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2525,"ondisk_log_size":2525,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1552,"ondisk_log_size":1552,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23858448,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":5673,"num_write_kb":26542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32464896,"data_stored":47716896,"data_compressed":4732252,"data_compressed_allocated":7307264,"data_compressed_original":22618112,"omap_allocated":0,"internal_metadata":0},"log_size":5209,"ondisk_log_size":5209,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509821,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":4588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":4698112,"data_stored":7801495,"data_compressed":855543,"data_compressed_allocated":1261568,"data_compressed_original":4567040,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.91400000000000003,"15min":0.878},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.371},"max":{"1min":1.268,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.157},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.93200000000000005,"15min":0.94299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.499},"max":{"1min":1.2649999999999999,"5min":1.4710000000000001,"15min":1.6479999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96299999999999997,"15min":0.92700000000000005},"min":{"1min":0.56299999999999994,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3280000000000001,"5min":1.405,"15min":1.405},"last":1.2869999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.93300000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.48599999999999999},"max":{"1min":1.1519999999999999,"5min":1.3640000000000001,"15min":1.504},"last":0.93000000000000005}]},{"osd":2,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.94699999999999995,"15min":0.91800000000000004},"min":{"1min":0.67100000000000004,"5min":0.54600000000000004,"15min":0.51900000000000002},"max":{"1min":1.2290000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98199999999999998,"15min":0.98999999999999999},"min":{"1min":0.69399999999999995,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":1.3049999999999999,"5min":1.361,"15min":1.776},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0169999999999999,"15min":1.0089999999999999},"min":{"1min":0.75900000000000001,"5min":0.64100000000000001,"15min":0.46700000000000003},"max":{"1min":1.355,"5min":1.363,"15min":2.0840000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0720000000000001,"15min":1.0800000000000001},"min":{"1min":0.82099999999999995,"5min":0.61399999999999999,"15min":0.44800000000000001},"max":{"1min":1.276,"5min":1.468,"15min":2.181},"last":1.0660000000000001}]},{"osd":4,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.90400000000000003,"15min":0.91500000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.30199999999999999},"max":{"1min":1.173,"5min":1.444,"15min":1.972},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.995,"5min":1.0249999999999999,"15min":1.0289999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4099999999999999,"5min":1.4830000000000001,"15min":1.8149999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.008,"15min":1.0189999999999999},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.41799999999999998},"max":{"1min":1.327,"5min":1.5760000000000001,"15min":2.3069999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0469999999999999,"15min":1.0669999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52100000000000002},"max":{"1min":1.3140000000000001,"5min":1.4470000000000001,"15min":1.8959999999999999},"last":1.2529999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1080000000000001,"15min":1.107},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.56999999999999995},"max":{"1min":1.353,"5min":1.5760000000000001,"15min":1.71},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1519999999999999,"15min":1.167},"min":{"1min":0.69599999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3959999999999999,"5min":1.7110000000000001,"15min":1.8600000000000001},"last":1.401}]}]},{"osd":3,"up_from":15,"seq":64424509821,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62188,"kb_used_data":8804,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309652,"statfs":{"total":96636764160,"available":96573083648,"internally_reserved":0,"allocated":9015296,"data_stored":12714767,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.53600000000000003,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":1.3520000000000001,"5min":1.3700000000000001,"15min":1.655},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81299999999999994,"15min":0.78400000000000003},"min":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.34699999999999998},"max":{"1min":1.383,"5min":1.504,"15min":1.7809999999999999},"last":0.375}]},{"osd":1,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.83799999999999997,"15min":0.82099999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.30399999999999999},"max":{"1min":1.254,"5min":1.5189999999999999,"15min":1.5329999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.93300000000000005,"15min":0.93600000000000005},"min":{"1min":0.52600000000000002,"5min":0.46200000000000002,"15min":0.26900000000000002},"max":{"1min":1.3700000000000001,"5min":1.4490000000000001,"15min":2.036},"last":0.84599999999999997}]},{"osd":2,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.56599999999999995,"5min":0.48099999999999998,"15min":0.45500000000000002},"max":{"1min":1.5349999999999999,"5min":1.585,"15min":1.9470000000000001},"last":0.441},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.002,"15min":0.98799999999999999},"min":{"1min":0.63900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.377,"5min":1.534,"15min":1.786},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.091,"15min":1.0820000000000001},"min":{"1min":0.79800000000000004,"5min":0.65500000000000003,"15min":0.52000000000000002},"max":{"1min":1.6839999999999999,"5min":1.73,"15min":1.73},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.171,"15min":1.143},"min":{"1min":0.85399999999999998,"5min":0.66300000000000003,"15min":0.53700000000000003},"max":{"1min":1.554,"5min":1.875,"15min":2.3039999999999998},"last":0.89800000000000002}]},{"osd":5,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.80800000000000005,"5min":0.70999999999999996,"15min":0.65700000000000003},"max":{"1min":1.679,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.272,"15min":1.272},"min":{"1min":0.89500000000000002,"5min":0.747,"15min":0.55000000000000004},"max":{"1min":1.798,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.0669999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3089999999999999,"15min":1.296},"min":{"1min":0.747,"5min":0.747,"15min":0.629},"max":{"1min":1.9179999999999999,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.234,"15min":1.2150000000000001},"min":{"1min":0.98299999999999998,"5min":0.83599999999999997,"15min":0.621},"max":{"1min":1.478,"5min":1.8460000000000001,"15min":1.9059999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.282,"15min":1.2609999999999999},"min":{"1min":0.94699999999999995,"5min":0.72099999999999997,"15min":0.58899999999999997},"max":{"1min":1.6000000000000001,"5min":1.849,"15min":1.849},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.379,"5min":1.327,"15min":1.306},"min":{"1min":1.05,"5min":0.81799999999999995,"15min":0.58499999999999996},"max":{"1min":1.9239999999999999,"5min":1.966,"15min":2.1640000000000001},"last":0.64100000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509820,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37588,"kb_used_data":6412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334252,"statfs":{"total":96636764160,"available":96598274048,"internally_reserved":0,"allocated":6565888,"data_stored":8520553,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.747,"15min":0.748},"min":{"1min":0.50800000000000001,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.93200000000000005,"5min":1.296,"15min":1.4670000000000001},"last":1.097},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.81599999999999995,"15min":0.80500000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.316},"max":{"1min":1.262,"5min":1.429,"15min":1.482},"last":0.66300000000000003}]},{"osd":1,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.59299999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4430000000000001,"5min":1.466,"15min":1.6599999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.92600000000000005,"15min":0.90800000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":1.2809999999999999,"5min":1.3919999999999999,"15min":4.5620000000000003},"last":1.0129999999999999}]},{"osd":3,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.88400000000000001,"15min":0.85699999999999998},"min":{"1min":0.63500000000000001,"5min":0.52400000000000002,"15min":0.39300000000000002},"max":{"1min":1.5049999999999999,"5min":1.704,"15min":1.704},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.048,"15min":1.014},"min":{"1min":0.75,"5min":0.63600000000000001,"15min":0.44500000000000001},"max":{"1min":1.643,"5min":1.643,"15min":1.661},"last":0.96599999999999997}]},{"osd":4,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.1259999999999999,"15min":1.105},"min":{"1min":0.67800000000000005,"5min":0.65600000000000003,"15min":0.51200000000000001},"max":{"1min":1.3799999999999999,"5min":1.647,"15min":1.726},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.085,"15min":1.046},"min":{"1min":0.80300000000000005,"5min":0.67400000000000004,"15min":0.53700000000000003},"max":{"1min":1.359,"5min":1.609,"15min":1.6240000000000001},"last":1.0629999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.218,"15min":1.196},"min":{"1min":0.83199999999999996,"5min":0.74099999999999999,"15min":0.624},"max":{"1min":1.458,"5min":1.7649999999999999,"15min":1.8009999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.204,"15min":1.194},"min":{"1min":0.96599999999999997,"5min":0.85499999999999998,"15min":0.61099999999999999},"max":{"1min":1.466,"5min":1.7470000000000001,"15min":1.855},"last":1.1419999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1519999999999999,"15min":1.139},"min":{"1min":0.84699999999999998,"5min":0.80600000000000005,"15min":0.66300000000000003},"max":{"1min":1.478,"5min":1.5209999999999999,"15min":1.7270000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.246,"5min":1.282,"15min":1.2689999999999999},"min":{"1min":0.93999999999999995,"5min":0.77800000000000002,"15min":0.54700000000000004},"max":{"1min":1.5469999999999999,"5min":1.919,"15min":2.0150000000000001},"last":1.3320000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3,"15min":1.2729999999999999},"min":{"1min":1.0109999999999999,"5min":0.76200000000000001,"15min":0.56999999999999995},"max":{"1min":1.5489999999999999,"5min":1.8400000000000001,"15min":1.9810000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.2430000000000001,"15min":1.22},"min":{"1min":0.97499999999999998,"5min":0.82099999999999995,"15min":0.68500000000000005},"max":{"1min":1.6040000000000001,"5min":1.7869999999999999,"15min":1.8240000000000001},"last":0.89300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509822,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":721711,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.50900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.7689999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.85799999999999998,"15min":0.80700000000000005},"min":{"1min":0.61299999999999999,"5min":0.34200000000000003,"15min":0.33700000000000002},"max":{"1min":1.3340000000000001,"5min":1.556,"15min":1.556},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.75},"min":{"1min":0.54000000000000004,"5min":0.41699999999999998,"15min":0.41599999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.4510000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96699999999999997,"15min":0.91800000000000004},"min":{"1min":0.60599999999999998,"5min":0.50800000000000001,"15min":0.33500000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":2.0019999999999998},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.002,"15min":0.95999999999999996},"min":{"1min":0.51100000000000001,"5min":0.46100000000000002,"15min":0.32400000000000001},"max":{"1min":1.3819999999999999,"5min":1.639,"15min":1.948},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97599999999999998,"15min":0.94099999999999995},"min":{"1min":0.69999999999999996,"5min":0.48699999999999999,"15min":0.35199999999999998},"max":{"1min":1.4099999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.63}]},{"osd":4,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1339999999999999,"15min":1.0760000000000001},"min":{"1min":0.80500000000000005,"5min":0.67700000000000005,"15min":0.57299999999999995},"max":{"1min":1.577,"5min":1.879,"15min":1.879},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.194,"15min":1.163},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.626},"max":{"1min":1.5,"5min":1.7470000000000001,"15min":2.0259999999999998},"last":1.175}]},{"osd":5,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2190000000000001,"15min":1.163},"min":{"1min":0.76100000000000001,"5min":0.71899999999999997,"15min":0.60199999999999998},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.9179999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2270000000000001,"15min":1.1679999999999999},"min":{"1min":0.92800000000000005,"5min":0.65300000000000002,"15min":0.64600000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.91400000000000003}]},{"osd":6,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.284,"15min":1.242},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.569,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.28,"15min":1.238},"min":{"1min":1.008,"5min":0.85299999999999998,"15min":0.66200000000000003},"max":{"1min":1.631,"5min":1.7529999999999999,"15min":2.0259999999999998},"last":1.0189999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3360000000000001,"15min":1.28},"min":{"1min":1.0640000000000001,"5min":0.82799999999999996,"15min":0.66600000000000004},"max":{"1min":1.526,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.139},{"interface":"front","average":{"1min":1.264,"5min":1.298,"15min":1.2450000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.67300000000000004},"max":{"1min":1.786,"5min":1.873,"15min":2.1880000000000002},"last":1.105}]}]},{"osd":0,"up_from":15,"seq":64424509821,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42508,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329332,"statfs":{"total":96636764160,"available":96593235968,"internally_reserved":0,"allocated":3084288,"data_stored":4325633,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.52500000000000002,"5min":0.35699999999999998,"15min":0.35099999999999998},"max":{"1min":1.2430000000000001,"5min":1.3819999999999999,"15min":1.698},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82299999999999995,"15min":0.81299999999999994},"min":{"1min":0.629,"5min":0.46200000000000002,"15min":0.40600000000000003},"max":{"1min":1.4650000000000001,"5min":1.788,"15min":1.907},"last":0.91000000000000003}]},{"osd":2,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84399999999999997,"15min":0.84699999999999998},"min":{"1min":0.60599999999999998,"5min":0.41999999999999998,"15min":0.34100000000000003},"max":{"1min":1.286,"5min":1.633,"15min":1.633},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":0.92300000000000004,"15min":0.88500000000000001},"min":{"1min":0.68899999999999995,"5min":0.432,"15min":0.38400000000000001},"max":{"1min":1.47,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.82999999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":1.292,"5min":1.2969999999999999,"15min":1.657},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0389999999999999,"15min":1.02},"min":{"1min":0.83499999999999996,"5min":0.40999999999999998,"15min":0.38400000000000001},"max":{"1min":1.631,"5min":1.694,"15min":2.2850000000000001},"last":1.1799999999999999}]},{"osd":4,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.117,"15min":1.105},"min":{"1min":0.84499999999999997,"5min":0.64000000000000001,"15min":0.61299999999999999},"max":{"1min":1.3620000000000001,"5min":1.8480000000000001,"15min":2.1000000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.2330000000000001,"15min":1.1160000000000001},"min":{"1min":0.82799999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.617,"5min":14.787000000000001,"15min":14.787000000000001},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2330000000000001,"15min":1.1890000000000001},"min":{"1min":0.79700000000000004,"5min":0.68000000000000005,"15min":0.61699999999999999},"max":{"1min":1.534,"5min":2.218,"15min":2.218},"last":1.071},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2350000000000001,"15min":1.1970000000000001},"min":{"1min":1.071,"5min":0.85499999999999998,"15min":0.66900000000000004},"max":{"1min":1.6870000000000001,"5min":2.0739999999999998,"15min":2.2309999999999999},"last":1.3660000000000001}]},{"osd":6,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.167,"15min":1.145},"min":{"1min":0.82499999999999996,"5min":0.66600000000000004,"15min":0.65400000000000003},"max":{"1min":1.7390000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.323,"15min":1.284},"min":{"1min":1.046,"5min":0.747,"15min":0.68500000000000005},"max":{"1min":1.782,"5min":1.9379999999999999,"15min":2.1480000000000001},"last":1.3100000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.302,"15min":1.2669999999999999},"min":{"1min":1.0249999999999999,"5min":0.83499999999999996,"15min":0.60199999999999998},"max":{"1min":1.784,"5min":2.0059999999999998,"15min":2.3300000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.226,"15min":1.216},"min":{"1min":1.0109999999999999,"5min":0.67000000000000004,"15min":0.58099999999999996},"max":{"1min":1.873,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.2709999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542525,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29016,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342824,"statfs":{"total":96636764160,"available":96607051776,"internally_reserved":0,"allocated":2048000,"data_stored":3016855,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.92600000000000005,"15min":0.91200000000000003},"min":{"1min":0.63400000000000001,"5min":0.55200000000000005,"15min":0.38100000000000001},"max":{"1min":1.2669999999999999,"5min":1.8069999999999999,"15min":1.8939999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.208,"5min":1.948,"15min":1.948},"last":1.0189999999999999}]},{"osd":1,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.96899999999999997,"15min":0.93700000000000006},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.244,"5min":3.246,"15min":3.246},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95299999999999996,"15min":0.94599999999999995},"min":{"1min":0.72299999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.282,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.0960000000000001}]},{"osd":2,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97999999999999998,"15min":0.97499999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.712,"15min":1.9399999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.97499999999999998,"15min":0.97899999999999998},"min":{"1min":0.79000000000000004,"5min":0.50700000000000001,"15min":0.47799999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.8280000000000001},"last":1.296}]},{"osd":3,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0509999999999999,"15min":1.036},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.55300000000000005},"max":{"1min":1.3400000000000001,"5min":1.528,"15min":1.528},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.002,"5min":1.024,"15min":1.0109999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.359,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.95099999999999996}]},{"osd":4,"last update":"Fri Dec 8 21:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93999999999999995,"15min":0.96499999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.55300000000000005},"max":{"1min":1.272,"5min":1.3859999999999999,"15min":1.45},"last":1.242},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.92600000000000005,"15min":0.98899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2709999999999999,"5min":1.371,"15min":1.5680000000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92800000000000005,"15min":0.98099999999999998},"min":{"1min":0.63800000000000001,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.2270000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.085,"5min":1.0920000000000001,"15min":1.127},"min":{"1min":0.67800000000000005,"5min":0.66200000000000003,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.6419999999999999,"15min":1.857},"last":1.052}]},{"osd":6,"last update":"Fri Dec 8 21:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0289999999999999,"15min":1.079},"min":{"1min":0.77400000000000002,"5min":0.68799999999999994,"15min":0.57399999999999995},"max":{"1min":1.2789999999999999,"5min":1.8380000000000001,"15min":1.948},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.202,"5min":1.194,"15min":1.212},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6399999999999999,"5min":1.6639999999999999,"15min":2.0019999999999998},"last":1.143}]}]},{"osd":6,"up_from":14,"seq":60129542526,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42332,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329508,"statfs":{"total":96636764160,"available":96593416192,"internally_reserved":0,"allocated":2904064,"data_stored":4325577,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.92700000000000005,"15min":0.90100000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48799999999999999},"max":{"1min":1.3919999999999999,"5min":1.395,"15min":1.4430000000000001},"last":1.069},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.94199999999999995,"15min":0.90300000000000002},"min":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.44900000000000001},"max":{"1min":1.3420000000000001,"5min":1.3979999999999999,"15min":1.4790000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.96899999999999997,"15min":0.93300000000000005},"min":{"1min":0.65400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2849999999999999,"5min":1.49,"15min":1.49},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.64300000000000002,"5min":0.53600000000000003,"15min":0.48699999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.512},"last":0.97899999999999998}]},{"osd":2,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98099999999999998,"15min":0.93799999999999994},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.45900000000000002},"max":{"1min":1.357,"5min":1.421,"15min":1.421},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0169999999999999,"15min":0.99199999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.51300000000000001},"max":{"1min":1.4410000000000001,"5min":1.546,"15min":1.546},"last":1.107}]},{"osd":3,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0229999999999999,"15min":1.0209999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.56000000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.708},"last":1.135},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.72499999999999998,"5min":0.627,"15min":0.54700000000000004},"max":{"1min":1.389,"5min":1.542,"15min":1.7},"last":1.24}]},{"osd":4,"last update":"Fri Dec 8 21:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.96099999999999997,"15min":0.97499999999999998},"min":{"1min":0.68400000000000005,"5min":0.60499999999999998,"15min":0.50900000000000001},"max":{"1min":1.319,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.022,"15min":1.0029999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.57899999999999996},"max":{"1min":1.55,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.67500000000000004,"5min":0.56499999999999995,"15min":0.53100000000000003},"max":{"1min":1.2110000000000001,"5min":1.79,"15min":1.79},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1140000000000001,"15min":1.111},"min":{"1min":0.80200000000000005,"5min":0.69399999999999995,"15min":0.432},"max":{"1min":1.6120000000000001,"5min":1.694,"15min":1.694},"last":1.3220000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:24:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0609999999999999,"15min":1.0640000000000001},"min":{"1min":0.72899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.696,"5min":1.732,"15min":1.732},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.196,"15min":1.1990000000000001},"min":{"1min":0.78600000000000003,"5min":0.71499999999999997,"15min":0.47299999999999998},"max":{"1min":1.532,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.3979999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542524,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55520,"kb_used_data":6296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316320,"statfs":{"total":96636764160,"available":96579911680,"internally_reserved":0,"allocated":6447104,"data_stored":8521225,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.90200000000000002},"min":{"1min":0.63900000000000001,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.6000000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92200000000000004,"15min":0.90800000000000003},"min":{"1min":0.54200000000000004,"5min":0.51000000000000001,"15min":0.41399999999999998},"max":{"1min":1.1359999999999999,"5min":1.3440000000000001,"15min":1.391},"last":1.0489999999999999}]},{"osd":1,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93799999999999994,"15min":0.91100000000000003},"min":{"1min":0.64100000000000001,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":1.2629999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0289999999999999,"15min":0.998},"min":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.46100000000000002},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4570000000000001},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0029999999999999,"15min":1.0089999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3400000000000001,"5min":1.4710000000000001,"15min":1.681},"last":1.365},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.95399999999999996,"15min":0.94899999999999995},"min":{"1min":0.67700000000000005,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.1479999999999999,"5min":1.52,"15min":1.52},"last":0.97199999999999998}]},{"osd":3,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.996,"15min":0.98699999999999999},"min":{"1min":0.65500000000000003,"5min":0.63100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2150000000000001,"5min":1.927,"15min":1.927},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.143,"15min":1.1140000000000001},"min":{"1min":0.84199999999999997,"5min":0.64100000000000001,"15min":0.433},"max":{"1min":1.3680000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.2789999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.876,"15min":0.91700000000000004},"min":{"1min":0.63700000000000001,"5min":0.56599999999999995,"15min":0.46300000000000002},"max":{"1min":1.034,"5min":1.28,"15min":1.504},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0069999999999999,"15min":0.998},"min":{"1min":0.74299999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.409}]},{"osd":6,"last update":"Fri Dec 8 21:25:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.03,"15min":1.0549999999999999},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.54500000000000004},"max":{"1min":1.415,"5min":1.478,"15min":1.617},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0660000000000001,"15min":1.0569999999999999},"min":{"1min":0.80600000000000005,"5min":0.69899999999999995,"15min":0.52900000000000003},"max":{"1min":1.294,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.23}]},{"osd":7,"last update":"Fri Dec 8 21:25:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.159,"15min":1.157},"min":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.39400000000000002},"max":{"1min":1.524,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.45},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0800000000000001,"15min":1.0960000000000001},"min":{"1min":0.72699999999999998,"5min":0.58299999999999996,"15min":0.45400000000000001},"max":{"1min":1.238,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.91200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":4194360,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6246400,"data_stored":8389280,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8695808,"data_stored":12583494,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":8389952,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4313088,"data_stored":7079854,"data_compressed":822166,"data_compressed_allocated":1216512,"data_compressed_original":3993600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":4194304,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1728512,"data_stored":2885582,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T21:25:44.356 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T21:25:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.527+0000 7f7e8ca60640 1 Processor -- start 2023-12-08T21:25:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.527+0000 7f7e8ca60640 1 -- start start 2023-12-08T21:25:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.531+0000 7f7e8ca60640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e880c1910 0x7f7e8815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.531+0000 7f7e8ca60640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c6410 0x7f7e8806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.531+0000 7f7e8ca60640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e880c01a0 con 0x7f7e880c1cf0 2023-12-08T21:25:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.531+0000 7f7e8ca60640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8806f3a0 con 0x7f7e880c1910 2023-12-08T21:25:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.531+0000 7f7e8ca60640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8806ede0 con 0x7f7e880c6410 2023-12-08T21:25:44.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.531+0000 7f7e86d9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c6410 0x7f7e8806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:44.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.531+0000 7f7e8659c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e880c1910 0x7f7e8815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:44.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.531+0000 7f7e86d9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c6410 0x7f7e8806e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:50104/0 (socket says 172.21.15.53:50104) 2023-12-08T21:25:44.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.531+0000 7f7e86d9d640 1 -- 172.21.15.53:0/1880538177 learned_addr learned my addr 172.21.15.53:0/1880538177 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:44.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.539+0000 7f7e8659c640 1 -- 172.21.15.53:0/1880538177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c6410 msgr2=0x7f7e8806e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:44.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.539+0000 7f7e8659c640 1 --2- 172.21.15.53:0/1880538177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c6410 0x7f7e8806e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:44.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.539+0000 7f7e8659c640 1 -- 172.21.15.53:0/1880538177 >> v1:172.21.15.146:6789/0 conn(0x7f7e880c1cf0 legacy=0x7f7e8814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:44.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.539+0000 7f7e8659c640 1 -- 172.21.15.53:0/1880538177 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8806f0c0 con 0x7f7e880c1910 2023-12-08T21:25:44.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.551+0000 7f7e8659c640 1 --2- 172.21.15.53:0/1880538177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e880c1910 0x7f7e8815a440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7e780097c0 tx=0x7f7e7801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48cd40a39369ab09 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e85d9b640 1 -- 172.21.15.53:0/1880538177 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e780ac630 con 0x7f7e880c1910 2023-12-08T21:25:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e85d9b640 1 -- 172.21.15.53:0/1880538177 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e780ac790 con 0x7f7e880c1910 2023-12-08T21:25:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e85d9b640 1 -- 172.21.15.53:0/1880538177 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e780acb20 con 0x7f7e880c1910 2023-12-08T21:25:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1880538177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e880c1910 msgr2=0x7f7e8815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e8ca60640 1 --2- 172.21.15.53:0/1880538177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e880c1910 0x7f7e8815a440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7e780097c0 tx=0x7f7e7801c410 comp rx=0 tx=0).stop 2023-12-08T21:25:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1880538177 shutdown_connections 2023-12-08T21:25:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e8ca60640 1 --2- 172.21.15.53:0/1880538177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c6410 0x7f7e8806e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e8ca60640 1 --2- 172.21.15.53:0/1880538177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e880c1910 0x7f7e8815a440 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1880538177 >> 172.21.15.53:0/1880538177 conn(0x7f7e880caef0 msgr2=0x7f7e880cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1880538177 shutdown_connections 2023-12-08T21:25:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1880538177 wait complete. 2023-12-08T21:25:44.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e8ca60640 1 Processor -- start 2023-12-08T21:25:44.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.559+0000 7f7e8ca60640 1 -- start start 2023-12-08T21:25:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.567+0000 7f7e8ca60640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c1910 0x7f7e880c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.567+0000 7f7e8ca60640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e880c1cf0 0x7f7e88145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.567+0000 7f7e8ca60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e880c6410 0x7f7e88145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.567+0000 7f7e8ca60640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8814ae40 con 0x7f7e880c6410 2023-12-08T21:25:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.567+0000 7f7e8ca60640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e88149820 con 0x7f7e880c1cf0 2023-12-08T21:25:44.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.567+0000 7f7e8ca60640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8814a880 con 0x7f7e880c1910 2023-12-08T21:25:44.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.567+0000 7f7e8659c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c1910 0x7f7e880c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:44.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.567+0000 7f7e8659c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c1910 0x7f7e880c4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:50120/0 (socket says 172.21.15.53:50120) 2023-12-08T21:25:44.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.567+0000 7f7e8659c640 1 -- 172.21.15.53:0/1810131517 learned_addr learned my addr 172.21.15.53:0/1810131517 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:44.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.567+0000 7f7e7ffff640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e880c1cf0 0x7f7e88145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:44.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.571+0000 7f7e86d9d640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e880c6410 0x7f7e88145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:44.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.575+0000 7f7e8659c640 1 -- 172.21.15.53:0/1810131517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e880c1cf0 msgr2=0x7f7e88145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:44.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.575+0000 7f7e8659c640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e880c1cf0 0x7f7e88145a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:44.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.575+0000 7f7e8659c640 1 -- 172.21.15.53:0/1810131517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e880c6410 msgr2=0x7f7e88145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:44.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.575+0000 7f7e8659c640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e880c6410 0x7f7e88145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:44.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.575+0000 7f7e8659c640 1 -- 172.21.15.53:0/1810131517 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78009420 con 0x7f7e880c1910 2023-12-08T21:25:44.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.579+0000 7f7e8659c640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c1910 0x7f7e880c4900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7e7801aac0 tx=0x7f7e780191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.607+0000 7f7e7effd640 1 -- 172.21.15.53:0/1810131517 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e780b5600 con 0x7f7e880c1910 2023-12-08T21:25:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.607+0000 7f7e7effd640 1 -- 172.21.15.53:0/1810131517 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e780b5760 con 0x7f7e880c1910 2023-12-08T21:25:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.607+0000 7f7e7effd640 1 -- 172.21.15.53:0/1810131517 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e780b5b10 con 0x7f7e880c1910 2023-12-08T21:25:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.607+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1810131517 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e881f0540 con 0x7f7e880c1910 2023-12-08T21:25:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.607+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1810131517 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8814aad0 con 0x7f7e880c1910 2023-12-08T21:25:44.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.607+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1810131517 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e880675b0 con 0x7f7e880c1910 2023-12-08T21:25:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.939+0000 7f7e7effd640 1 -- 172.21.15.53:0/1810131517 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e780b3040 con 0x7f7e880c1910 2023-12-08T21:25:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.939+0000 7f7e7effd640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7e68066470 0x7f7e68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:44.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.943+0000 7f7e7ffff640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7e68066470 0x7f7e68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.943+0000 7f7e7ffff640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7e68066470 0x7f7e68068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7e881607c0 tx=0x7f7e70007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:44.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.947+0000 7f7e7effd640 1 -- 172.21.15.53:0/1810131517 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7e780ef850 con 0x7f7e880c1910 2023-12-08T21:25:44.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:44.975+0000 7f7e7effd640 1 -- 172.21.15.53:0/1810131517 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e780ebb90 con 0x7f7e880c1910 2023-12-08T21:25:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.191+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1810131517 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e88156650 con 0x7f7e68066470 2023-12-08T21:25:45.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.215+0000 7f7e7effd640 1 -- 172.21.15.53:0/1810131517 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369263 (secure 0 0 0) 0x7f7e70004c00 con 0x7f7e68066470 2023-12-08T21:25:45.221 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:25:45.223 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-12-08T21:25:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.223+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1810131517 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7e68066470 msgr2=0x7f7e68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.223+0000 7f7e8ca60640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7e68066470 0x7f7e68068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7e881607c0 tx=0x7f7e70007e40 comp rx=0 tx=0).stop 2023-12-08T21:25:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.223+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1810131517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c1910 msgr2=0x7f7e880c4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.223+0000 7f7e8ca60640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c1910 0x7f7e880c4900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7e7801aac0 tx=0x7f7e780191b0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.223+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1810131517 shutdown_connections 2023-12-08T21:25:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.223+0000 7f7e8ca60640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7e68066470 0x7f7e68068930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.223+0000 7f7e8ca60640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e880c6410 0x7f7e88145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.223+0000 7f7e8ca60640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e880c1cf0 0x7f7e88145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.223+0000 7f7e8ca60640 1 --2- 172.21.15.53:0/1810131517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e880c1910 0x7f7e880c4900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.223+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1810131517 >> 172.21.15.53:0/1810131517 conn(0x7f7e880caef0 msgr2=0x7f7e88073900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.223+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1810131517 shutdown_connections 2023-12-08T21:25:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.223+0000 7f7e8ca60640 1 -- 172.21.15.53:0/1810131517 wait complete. 2023-12-08T21:25:45.244 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":973,"stamp":"2023-12-08T21:25:44.046440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24448816,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":690,"num_read_kb":695,"num_write":8182,"num_write_kb":281588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9403,"ondisk_log_size":9403,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":328152,"kb_used_data":34328,"kb_used_omap":12,"kb_used_meta":293747,"kb_avail":754646568,"statfs":{"total":773094113280,"available":772758085632,"internally_reserved":0,"allocated":35151872,"data_stored":49947816,"data_compressed":4799006,"data_compressed_allocated":7397376,"data_compressed_original":23764992,"omap_allocated":12752,"internal_metadata":300797488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11621,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":23,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004831"},"pg_stats":[{"pgid":"2.1f","version":"30'720","reported_seq":755,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:07.393324+0000","last_change":"2023-12-08T20:54:54.983255+0000","last_active":"2023-12-08T21:24:07.393324+0000","last_peered":"2023-12-08T21:24:07.393324+0000","last_clean":"2023-12-08T21:24:07.393324+0000","last_became_active":"2023-12-08T20:54:54.982479+0000","last_became_peered":"2023-12-08T20:54:54.982479+0000","last_unstale":"2023-12-08T21:24:07.393324+0000","last_undegraded":"2023-12-08T21:24:07.393324+0000","last_fullsized":"2023-12-08T21:24:07.393324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:17:36.784429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":4491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.545912+0000","last_change":"2023-12-08T20:54:56.407614+0000","last_active":"2023-12-08T21:25:37.545912+0000","last_peered":"2023-12-08T21:25:37.545912+0000","last_clean":"2023-12-08T21:25:37.545912+0000","last_became_active":"2023-12-08T20:54:56.406245+0000","last_became_peered":"2023-12-08T20:54:56.406245+0000","last_unstale":"2023-12-08T21:25:37.545912+0000","last_undegraded":"2023-12-08T21:25:37.545912+0000","last_fullsized":"2023-12-08T21:25:37.545912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:29.997818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'66","reported_seq":93,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:29.730895+0000","last_change":"2023-12-08T20:55:04.459400+0000","last_active":"2023-12-08T21:24:29.730895+0000","last_peered":"2023-12-08T21:24:29.730895+0000","last_clean":"2023-12-08T21:24:29.730895+0000","last_became_active":"2023-12-08T20:55:04.458087+0000","last_became_peered":"2023-12-08T20:55:04.458087+0000","last_unstale":"2023-12-08T21:24:29.730895+0000","last_undegraded":"2023-12-08T21:24:29.730895+0000","last_fullsized":"2023-12-08T21:24:29.730895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:23.378911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'290","reported_seq":326,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.211179+0000","last_change":"2023-12-08T20:54:54.929925+0000","last_active":"2023-12-08T21:25:37.211179+0000","last_peered":"2023-12-08T21:25:37.211179+0000","last_clean":"2023-12-08T21:25:37.211179+0000","last_became_active":"2023-12-08T20:54:54.929391+0000","last_became_peered":"2023-12-08T20:54:54.929391+0000","last_unstale":"2023-12-08T21:25:37.211179+0000","last_undegraded":"2023-12-08T21:25:37.211179+0000","last_fullsized":"2023-12-08T21:25:37.211179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:15:29.148520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759983,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":2843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.565498+0000","last_change":"2023-12-08T20:54:56.409201+0000","last_active":"2023-12-08T21:25:37.565498+0000","last_peered":"2023-12-08T21:25:37.565498+0000","last_clean":"2023-12-08T21:25:37.565498+0000","last_became_active":"2023-12-08T20:54:56.408361+0000","last_became_peered":"2023-12-08T20:54:56.408361+0000","last_unstale":"2023-12-08T21:25:37.565498+0000","last_undegraded":"2023-12-08T21:25:37.565498+0000","last_fullsized":"2023-12-08T21:25:37.565498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:43:42.044530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'74","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:08.280157+0000","last_change":"2023-12-08T20:55:04.529086+0000","last_active":"2023-12-08T21:24:08.280157+0000","last_peered":"2023-12-08T21:24:08.280157+0000","last_clean":"2023-12-08T21:24:08.280157+0000","last_became_active":"2023-12-08T20:55:04.528732+0000","last_became_peered":"2023-12-08T20:55:04.528732+0000","last_unstale":"2023-12-08T21:24:08.280157+0000","last_undegraded":"2023-12-08T21:24:08.280157+0000","last_fullsized":"2023-12-08T21:24:08.280157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:09:07.484233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'9","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:20.382538+0000","last_change":"2023-12-08T20:54:54.935973+0000","last_active":"2023-12-08T21:25:20.382538+0000","last_peered":"2023-12-08T21:25:20.382538+0000","last_clean":"2023-12-08T21:25:20.382538+0000","last_became_active":"2023-12-08T20:54:54.935620+0000","last_became_peered":"2023-12-08T20:54:54.935620+0000","last_unstale":"2023-12-08T21:25:20.382538+0000","last_undegraded":"2023-12-08T21:25:20.382538+0000","last_fullsized":"2023-12-08T21:25:20.382538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:57.947192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'23","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572529+0000","last_change":"2023-12-08T20:54:56.382016+0000","last_active":"2023-12-08T21:25:37.572529+0000","last_peered":"2023-12-08T21:25:37.572529+0000","last_clean":"2023-12-08T21:25:37.572529+0000","last_became_active":"2023-12-08T20:54:56.380927+0000","last_became_peered":"2023-12-08T20:54:56.380927+0000","last_unstale":"2023-12-08T21:25:37.572529+0000","last_undegraded":"2023-12-08T21:25:37.572529+0000","last_fullsized":"2023-12-08T21:25:37.572529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'75","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.127325+0000","last_change":"2023-12-08T20:55:04.527024+0000","last_active":"2023-12-08T21:24:30.127325+0000","last_peered":"2023-12-08T21:24:30.127325+0000","last_clean":"2023-12-08T21:24:30.127325+0000","last_became_active":"2023-12-08T20:55:04.526605+0000","last_became_peered":"2023-12-08T20:55:04.526605+0000","last_unstale":"2023-12-08T21:24:30.127325+0000","last_undegraded":"2023-12-08T21:24:30.127325+0000","last_fullsized":"2023-12-08T21:24:30.127325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:15.471006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:54.122416+0000","last_change":"2023-12-08T20:54:54.929388+0000","last_active":"2023-12-08T21:24:54.122416+0000","last_peered":"2023-12-08T21:24:54.122416+0000","last_clean":"2023-12-08T21:24:54.122416+0000","last_became_active":"2023-12-08T20:54:54.926132+0000","last_became_peered":"2023-12-08T20:54:54.926132+0000","last_unstale":"2023-12-08T21:24:54.122416+0000","last_undegraded":"2023-12-08T21:24:54.122416+0000","last_fullsized":"2023-12-08T21:24:54.122416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:00.435948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.531175+0000","last_change":"2023-12-08T20:54:56.388306+0000","last_active":"2023-12-08T21:25:37.531175+0000","last_peered":"2023-12-08T21:25:37.531175+0000","last_clean":"2023-12-08T21:25:37.531175+0000","last_became_active":"2023-12-08T20:54:56.387528+0000","last_became_peered":"2023-12-08T20:54:56.387528+0000","last_unstale":"2023-12-08T21:25:37.531175+0000","last_undegraded":"2023-12-08T21:25:37.531175+0000","last_fullsized":"2023-12-08T21:25:37.531175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:22.236935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'65","reported_seq":92,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:32.160514+0000","last_change":"2023-12-08T20:55:04.523251+0000","last_active":"2023-12-08T21:24:32.160514+0000","last_peered":"2023-12-08T21:24:32.160514+0000","last_clean":"2023-12-08T21:24:32.160514+0000","last_became_active":"2023-12-08T20:55:04.522777+0000","last_became_peered":"2023-12-08T20:55:04.522777+0000","last_unstale":"2023-12-08T21:24:32.160514+0000","last_undegraded":"2023-12-08T21:24:32.160514+0000","last_fullsized":"2023-12-08T21:24:32.160514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:09.972989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'17","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.527629+0000","last_change":"2023-12-08T20:54:56.319638+0000","last_active":"2023-12-08T21:25:37.527629+0000","last_peered":"2023-12-08T21:25:37.527629+0000","last_clean":"2023-12-08T21:25:37.527629+0000","last_became_active":"2023-12-08T20:54:56.318855+0000","last_became_peered":"2023-12-08T20:54:56.318855+0000","last_unstale":"2023-12-08T21:25:37.527629+0000","last_undegraded":"2023-12-08T21:25:37.527629+0000","last_fullsized":"2023-12-08T21:25:37.527629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:27.151902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'722","reported_seq":756,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.547932+0000","last_change":"2023-12-08T20:54:54.929584+0000","last_active":"2023-12-08T21:25:04.547932+0000","last_peered":"2023-12-08T21:25:04.547932+0000","last_clean":"2023-12-08T21:25:04.547932+0000","last_became_active":"2023-12-08T20:54:54.928702+0000","last_became_peered":"2023-12-08T20:54:54.928702+0000","last_unstale":"2023-12-08T21:25:04.547932+0000","last_undegraded":"2023-12-08T21:25:04.547932+0000","last_fullsized":"2023-12-08T21:25:04.547932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:40.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'78","reported_seq":106,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.189347+0000","last_change":"2023-12-08T20:55:04.535786+0000","last_active":"2023-12-08T21:24:31.189347+0000","last_peered":"2023-12-08T21:24:31.189347+0000","last_clean":"2023-12-08T21:24:31.189347+0000","last_became_active":"2023-12-08T20:55:04.535119+0000","last_became_peered":"2023-12-08T20:55:04.535119+0000","last_unstale":"2023-12-08T21:24:31.189347+0000","last_undegraded":"2023-12-08T21:24:31.189347+0000","last_fullsized":"2023-12-08T21:24:31.189347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:23:32.647822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":12383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.475615+0000","last_change":"2023-12-08T20:54:56.370877+0000","last_active":"2023-12-08T21:25:37.475615+0000","last_peered":"2023-12-08T21:25:37.475615+0000","last_clean":"2023-12-08T21:25:37.475615+0000","last_became_active":"2023-12-08T20:54:56.370044+0000","last_became_peered":"2023-12-08T20:54:56.370044+0000","last_unstale":"2023-12-08T21:25:37.475615+0000","last_undegraded":"2023-12-08T21:25:37.475615+0000","last_fullsized":"2023-12-08T21:25:37.475615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:26.733660+0000","last_change":"2023-12-08T20:54:54.923604+0000","last_active":"2023-12-08T21:25:26.733660+0000","last_peered":"2023-12-08T21:25:26.733660+0000","last_clean":"2023-12-08T21:25:26.733660+0000","last_became_active":"2023-12-08T20:54:54.922960+0000","last_became_peered":"2023-12-08T20:54:54.922960+0000","last_unstale":"2023-12-08T21:25:26.733660+0000","last_undegraded":"2023-12-08T21:25:26.733660+0000","last_fullsized":"2023-12-08T21:25:26.733660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:41:46.444603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'95","reported_seq":123,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.193518+0000","last_change":"2023-12-08T20:55:04.522655+0000","last_active":"2023-12-08T21:24:28.193518+0000","last_peered":"2023-12-08T21:24:28.193518+0000","last_clean":"2023-12-08T21:24:28.193518+0000","last_became_active":"2023-12-08T20:55:04.522172+0000","last_became_peered":"2023-12-08T20:55:04.522172+0000","last_unstale":"2023-12-08T21:24:28.193518+0000","last_undegraded":"2023-12-08T21:24:28.193518+0000","last_fullsized":"2023-12-08T21:24:28.193518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:09:00.038275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.700497+0000","last_change":"2023-12-08T20:54:56.366227+0000","last_active":"2023-12-08T21:25:37.700497+0000","last_peered":"2023-12-08T21:25:37.700497+0000","last_clean":"2023-12-08T21:25:37.700497+0000","last_became_active":"2023-12-08T20:54:56.365552+0000","last_became_peered":"2023-12-08T20:54:56.365552+0000","last_unstale":"2023-12-08T21:25:37.700497+0000","last_undegraded":"2023-12-08T21:25:37.700497+0000","last_fullsized":"2023-12-08T21:25:37.700497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:00.821031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.043833+0000","last_change":"2023-12-08T20:54:54.980466+0000","last_active":"2023-12-08T21:25:17.043833+0000","last_peered":"2023-12-08T21:25:17.043833+0000","last_clean":"2023-12-08T21:25:17.043833+0000","last_became_active":"2023-12-08T20:54:54.979668+0000","last_became_peered":"2023-12-08T20:54:54.979668+0000","last_unstale":"2023-12-08T21:25:17.043833+0000","last_undegraded":"2023-12-08T21:25:17.043833+0000","last_fullsized":"2023-12-08T21:25:17.043833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:53.529738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'67","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.342620+0000","last_change":"2023-12-08T20:55:04.513186+0000","last_active":"2023-12-08T21:24:30.342620+0000","last_peered":"2023-12-08T21:24:30.342620+0000","last_clean":"2023-12-08T21:24:30.342620+0000","last_became_active":"2023-12-08T20:55:04.512549+0000","last_became_peered":"2023-12-08T20:55:04.512549+0000","last_unstale":"2023-12-08T21:24:30.342620+0000","last_undegraded":"2023-12-08T21:24:30.342620+0000","last_fullsized":"2023-12-08T21:24:30.342620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:49:31.307794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:19.086943+0000","last_change":"2023-12-08T20:54:56.261452+0000","last_active":"2023-12-08T21:25:19.086943+0000","last_peered":"2023-12-08T21:25:19.086943+0000","last_clean":"2023-12-08T21:25:19.086943+0000","last_became_active":"2023-12-08T20:54:56.260355+0000","last_became_peered":"2023-12-08T20:54:56.260355+0000","last_unstale":"2023-12-08T21:25:19.086943+0000","last_undegraded":"2023-12-08T21:25:19.086943+0000","last_fullsized":"2023-12-08T21:25:19.086943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:47:02.249125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'6","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:15.054410+0000","last_change":"2023-12-08T20:54:54.926546+0000","last_active":"2023-12-08T21:25:15.054410+0000","last_peered":"2023-12-08T21:25:15.054410+0000","last_clean":"2023-12-08T21:25:15.054410+0000","last_became_active":"2023-12-08T20:54:54.925888+0000","last_became_peered":"2023-12-08T20:54:54.925888+0000","last_unstale":"2023-12-08T21:25:15.054410+0000","last_undegraded":"2023-12-08T21:25:15.054410+0000","last_fullsized":"2023-12-08T21:25:15.054410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:25:20.796728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'77","reported_seq":105,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.244645+0000","last_change":"2023-12-08T20:55:04.529041+0000","last_active":"2023-12-08T21:24:28.244645+0000","last_peered":"2023-12-08T21:24:28.244645+0000","last_clean":"2023-12-08T21:24:28.244645+0000","last_became_active":"2023-12-08T20:55:04.528640+0000","last_became_peered":"2023-12-08T20:55:04.528640+0000","last_unstale":"2023-12-08T21:24:28.244645+0000","last_undegraded":"2023-12-08T21:24:28.244645+0000","last_fullsized":"2023-12-08T21:24:28.244645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:18.653508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.700875+0000","last_change":"2023-12-08T20:54:56.365339+0000","last_active":"2023-12-08T21:25:37.700875+0000","last_peered":"2023-12-08T21:25:37.700875+0000","last_clean":"2023-12-08T21:25:37.700875+0000","last_became_active":"2023-12-08T20:54:56.364597+0000","last_became_peered":"2023-12-08T20:54:56.364597+0000","last_unstale":"2023-12-08T21:25:37.700875+0000","last_undegraded":"2023-12-08T21:25:37.700875+0000","last_fullsized":"2023-12-08T21:25:37.700875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:17:58.931401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.405257+0000","last_change":"2023-12-08T20:54:54.928399+0000","last_active":"2023-12-08T21:25:17.405257+0000","last_peered":"2023-12-08T21:25:17.405257+0000","last_clean":"2023-12-08T21:25:17.405257+0000","last_became_active":"2023-12-08T20:54:54.927814+0000","last_became_peered":"2023-12-08T20:54:54.927814+0000","last_unstale":"2023-12-08T21:25:17.405257+0000","last_undegraded":"2023-12-08T21:25:17.405257+0000","last_fullsized":"2023-12-08T21:25:17.405257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:04:22.986992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'64","reported_seq":93,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:32.160272+0000","last_change":"2023-12-08T20:55:04.523561+0000","last_active":"2023-12-08T21:24:32.160272+0000","last_peered":"2023-12-08T21:24:32.160272+0000","last_clean":"2023-12-08T21:24:32.160272+0000","last_became_active":"2023-12-08T20:55:04.522714+0000","last_became_peered":"2023-12-08T20:55:04.522714+0000","last_unstale":"2023-12-08T21:24:32.160272+0000","last_undegraded":"2023-12-08T21:24:32.160272+0000","last_fullsized":"2023-12-08T21:24:32.160272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:14.534456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":9451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.698634+0000","last_change":"2023-12-08T20:54:56.331268+0000","last_active":"2023-12-08T21:25:37.698634+0000","last_peered":"2023-12-08T21:25:37.698634+0000","last_clean":"2023-12-08T21:25:37.698634+0000","last_became_active":"2023-12-08T20:54:56.330508+0000","last_became_peered":"2023-12-08T20:54:56.330508+0000","last_unstale":"2023-12-08T21:25:37.698634+0000","last_undegraded":"2023-12-08T21:25:37.698634+0000","last_fullsized":"2023-12-08T21:25:37.698634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:52.392589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'333","reported_seq":368,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:32.174048+0000","last_change":"2023-12-08T20:54:54.982136+0000","last_active":"2023-12-08T21:25:32.174048+0000","last_peered":"2023-12-08T21:25:32.174048+0000","last_clean":"2023-12-08T21:25:32.174048+0000","last_became_active":"2023-12-08T20:54:54.981168+0000","last_became_peered":"2023-12-08T20:54:54.981168+0000","last_unstale":"2023-12-08T21:25:32.174048+0000","last_undegraded":"2023-12-08T21:25:32.174048+0000","last_fullsized":"2023-12-08T21:25:32.174048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:13.841870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'104","reported_seq":134,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.293300+0000","last_change":"2023-12-08T20:55:04.513360+0000","last_active":"2023-12-08T21:24:33.293300+0000","last_peered":"2023-12-08T21:24:33.293300+0000","last_clean":"2023-12-08T21:24:33.293300+0000","last_became_active":"2023-12-08T20:55:04.511032+0000","last_became_peered":"2023-12-08T20:55:04.511032+0000","last_unstale":"2023-12-08T21:24:33.293300+0000","last_undegraded":"2023-12-08T21:24:33.293300+0000","last_fullsized":"2023-12-08T21:24:33.293300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:38:04.841172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":14212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.469315+0000","last_change":"2023-12-08T20:54:56.409829+0000","last_active":"2023-12-08T21:25:37.469315+0000","last_peered":"2023-12-08T21:25:37.469315+0000","last_clean":"2023-12-08T21:25:37.469315+0000","last_became_active":"2023-12-08T20:54:56.409291+0000","last_became_peered":"2023-12-08T20:54:56.409291+0000","last_unstale":"2023-12-08T21:25:37.469315+0000","last_undegraded":"2023-12-08T21:25:37.469315+0000","last_fullsized":"2023-12-08T21:25:37.469315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:06:37.234510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.405216+0000","last_change":"2023-12-08T20:54:54.978750+0000","last_active":"2023-12-08T21:25:17.405216+0000","last_peered":"2023-12-08T21:25:17.405216+0000","last_clean":"2023-12-08T21:25:17.405216+0000","last_became_active":"2023-12-08T20:54:54.978416+0000","last_became_peered":"2023-12-08T20:54:54.978416+0000","last_unstale":"2023-12-08T21:25:17.405216+0000","last_undegraded":"2023-12-08T21:25:17.405216+0000","last_fullsized":"2023-12-08T21:25:17.405216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:00:08.584168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'75","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.504300+0000","last_change":"2023-12-08T20:55:04.507859+0000","last_active":"2023-12-08T21:24:30.504300+0000","last_peered":"2023-12-08T21:24:30.504300+0000","last_clean":"2023-12-08T21:24:30.504300+0000","last_became_active":"2023-12-08T20:55:04.507454+0000","last_became_peered":"2023-12-08T20:55:04.507454+0000","last_unstale":"2023-12-08T21:24:30.504300+0000","last_undegraded":"2023-12-08T21:24:30.504300+0000","last_fullsized":"2023-12-08T21:24:30.504300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:56:57.279368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'17","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.668121+0000","last_change":"2023-12-08T20:54:56.372983+0000","last_active":"2023-12-08T21:25:37.668121+0000","last_peered":"2023-12-08T21:25:37.668121+0000","last_clean":"2023-12-08T21:25:37.668121+0000","last_became_active":"2023-12-08T20:54:56.369974+0000","last_became_peered":"2023-12-08T20:54:56.369974+0000","last_unstale":"2023-12-08T21:25:37.668121+0000","last_undegraded":"2023-12-08T21:25:37.668121+0000","last_fullsized":"2023-12-08T21:25:37.668121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.229971+0000","last_change":"2023-12-08T20:54:54.925560+0000","last_active":"2023-12-08T21:25:17.229971+0000","last_peered":"2023-12-08T21:25:17.229971+0000","last_clean":"2023-12-08T21:25:17.229971+0000","last_became_active":"2023-12-08T20:54:54.925022+0000","last_became_peered":"2023-12-08T20:54:54.925022+0000","last_unstale":"2023-12-08T21:25:17.229971+0000","last_undegraded":"2023-12-08T21:25:17.229971+0000","last_fullsized":"2023-12-08T21:25:17.229971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:10:52.902793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'85","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:26.213718+0000","last_change":"2023-12-08T20:55:04.531931+0000","last_active":"2023-12-08T21:24:26.213718+0000","last_peered":"2023-12-08T21:24:26.213718+0000","last_clean":"2023-12-08T21:24:26.213718+0000","last_became_active":"2023-12-08T20:55:04.530774+0000","last_became_peered":"2023-12-08T20:55:04.530774+0000","last_unstale":"2023-12-08T21:24:26.213718+0000","last_undegraded":"2023-12-08T21:24:26.213718+0000","last_fullsized":"2023-12-08T21:24:26.213718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:39:26.927665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.560779+0000","last_change":"2023-12-08T20:54:56.391492+0000","last_active":"2023-12-08T21:25:37.560779+0000","last_peered":"2023-12-08T21:25:37.560779+0000","last_clean":"2023-12-08T21:25:37.560779+0000","last_became_active":"2023-12-08T20:54:56.385090+0000","last_became_peered":"2023-12-08T20:54:56.385090+0000","last_unstale":"2023-12-08T21:25:37.560779+0000","last_undegraded":"2023-12-08T21:25:37.560779+0000","last_fullsized":"2023-12-08T21:25:37.560779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:21:29.009005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'6","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:00.493188+0000","last_change":"2023-12-08T20:54:54.932503+0000","last_active":"2023-12-08T21:25:00.493188+0000","last_peered":"2023-12-08T21:25:00.493188+0000","last_clean":"2023-12-08T21:25:00.493188+0000","last_became_active":"2023-12-08T20:54:54.932121+0000","last_became_peered":"2023-12-08T20:54:54.932121+0000","last_unstale":"2023-12-08T21:25:00.493188+0000","last_undegraded":"2023-12-08T21:25:00.493188+0000","last_fullsized":"2023-12-08T21:25:00.493188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:58.013744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'55","reported_seq":84,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:17.818790+0000","last_change":"2023-12-08T20:55:04.529911+0000","last_active":"2023-12-08T21:24:17.818790+0000","last_peered":"2023-12-08T21:24:17.818790+0000","last_clean":"2023-12-08T21:24:17.818790+0000","last_became_active":"2023-12-08T20:55:04.528698+0000","last_became_peered":"2023-12-08T20:55:04.528698+0000","last_unstale":"2023-12-08T21:24:17.818790+0000","last_undegraded":"2023-12-08T21:24:17.818790+0000","last_fullsized":"2023-12-08T21:24:17.818790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:33:11.874876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'24","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546193+0000","last_change":"2023-12-08T20:54:56.413886+0000","last_active":"2023-12-08T21:25:37.546193+0000","last_peered":"2023-12-08T21:25:37.546193+0000","last_clean":"2023-12-08T21:25:37.546193+0000","last_became_active":"2023-12-08T20:54:56.412786+0000","last_became_peered":"2023-12-08T20:54:56.412786+0000","last_unstale":"2023-12-08T21:25:37.546193+0000","last_undegraded":"2023-12-08T21:25:37.546193+0000","last_fullsized":"2023-12-08T21:25:37.546193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:39.331476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'576","reported_seq":1185,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:34.738873+0000","last_change":"2023-12-08T20:54:54.922605+0000","last_active":"2023-12-08T21:25:34.738873+0000","last_peered":"2023-12-08T21:25:34.738873+0000","last_clean":"2023-12-08T21:25:34.738873+0000","last_became_active":"2023-12-08T20:54:54.922014+0000","last_became_peered":"2023-12-08T20:54:54.922014+0000","last_unstale":"2023-12-08T21:25:34.738873+0000","last_undegraded":"2023-12-08T21:25:34.738873+0000","last_fullsized":"2023-12-08T21:25:34.738873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:08:48.601596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125475,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":574,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'71","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.296642+0000","last_change":"2023-12-08T20:55:04.509438+0000","last_active":"2023-12-08T21:24:33.296642+0000","last_peered":"2023-12-08T21:24:33.296642+0000","last_clean":"2023-12-08T21:24:33.296642+0000","last_became_active":"2023-12-08T20:55:04.508219+0000","last_became_peered":"2023-12-08T20:55:04.508219+0000","last_unstale":"2023-12-08T21:24:33.296642+0000","last_undegraded":"2023-12-08T21:24:33.296642+0000","last_fullsized":"2023-12-08T21:24:33.296642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:16:31.758437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'15","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.472707+0000","last_change":"2023-12-08T20:54:56.370599+0000","last_active":"2023-12-08T21:25:37.472707+0000","last_peered":"2023-12-08T21:25:37.472707+0000","last_clean":"2023-12-08T21:25:37.472707+0000","last_became_active":"2023-12-08T20:54:56.370121+0000","last_became_peered":"2023-12-08T20:54:56.370121+0000","last_unstale":"2023-12-08T21:25:37.472707+0000","last_undegraded":"2023-12-08T21:25:37.472707+0000","last_fullsized":"2023-12-08T21:25:37.472707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:58:13.927241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'5","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.082976+0000","last_change":"2023-12-08T20:54:54.927599+0000","last_active":"2023-12-08T21:25:04.082976+0000","last_peered":"2023-12-08T21:25:04.082976+0000","last_clean":"2023-12-08T21:25:04.082976+0000","last_became_active":"2023-12-08T20:54:54.927120+0000","last_became_peered":"2023-12-08T20:54:54.927120+0000","last_unstale":"2023-12-08T21:25:04.082976+0000","last_undegraded":"2023-12-08T21:25:04.082976+0000","last_fullsized":"2023-12-08T21:25:04.082976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:38.042201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'100","reported_seq":129,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.170138+0000","last_change":"2023-12-08T20:55:04.546945+0000","last_active":"2023-12-08T21:24:28.170138+0000","last_peered":"2023-12-08T21:24:28.170138+0000","last_clean":"2023-12-08T21:24:28.170138+0000","last_became_active":"2023-12-08T20:55:04.546439+0000","last_became_peered":"2023-12-08T20:55:04.546439+0000","last_unstale":"2023-12-08T21:24:28.170138+0000","last_undegraded":"2023-12-08T21:24:28.170138+0000","last_fullsized":"2023-12-08T21:24:28.170138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:30.484701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.698344+0000","last_change":"2023-12-08T20:54:56.372770+0000","last_active":"2023-12-08T21:25:37.698344+0000","last_peered":"2023-12-08T21:25:37.698344+0000","last_clean":"2023-12-08T21:25:37.698344+0000","last_became_active":"2023-12-08T20:54:56.372205+0000","last_became_peered":"2023-12-08T20:54:56.372205+0000","last_unstale":"2023-12-08T21:25:37.698344+0000","last_undegraded":"2023-12-08T21:25:37.698344+0000","last_fullsized":"2023-12-08T21:25:37.698344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:06.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:05.621357+0000","last_change":"2023-12-08T20:54:54.929937+0000","last_active":"2023-12-08T21:25:05.621357+0000","last_peered":"2023-12-08T21:25:05.621357+0000","last_clean":"2023-12-08T21:25:05.621357+0000","last_became_active":"2023-12-08T20:54:54.929177+0000","last_became_peered":"2023-12-08T20:54:54.929177+0000","last_unstale":"2023-12-08T21:25:05.621357+0000","last_undegraded":"2023-12-08T21:25:05.621357+0000","last_fullsized":"2023-12-08T21:25:05.621357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:39:58.988364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:22:24.292691+0000","last_change":"2023-12-08T20:54:16.149485+0000","last_active":"2023-12-08T21:22:24.292691+0000","last_peered":"2023-12-08T21:22:24.292691+0000","last_clean":"2023-12-08T21:22:24.292691+0000","last_became_active":"2023-12-08T20:54:16.147507+0000","last_became_peered":"2023-12-08T20:54:16.147507+0000","last_unstale":"2023-12-08T21:22:24.292691+0000","last_undegraded":"2023-12-08T21:22:24.292691+0000","last_fullsized":"2023-12-08T21:22:24.292691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_clean_scrub_stamp":"2023-12-08T20:54:14.141045+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:17.484651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'75","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:24.073710+0000","last_change":"2023-12-08T20:55:04.515531+0000","last_active":"2023-12-08T21:24:24.073710+0000","last_peered":"2023-12-08T21:24:24.073710+0000","last_clean":"2023-12-08T21:24:24.073710+0000","last_became_active":"2023-12-08T20:55:04.515200+0000","last_became_peered":"2023-12-08T20:55:04.515200+0000","last_unstale":"2023-12-08T21:24:24.073710+0000","last_undegraded":"2023-12-08T21:24:24.073710+0000","last_fullsized":"2023-12-08T21:24:24.073710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:00:08.085700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.528119+0000","last_change":"2023-12-08T20:54:56.318724+0000","last_active":"2023-12-08T21:25:37.528119+0000","last_peered":"2023-12-08T21:25:37.528119+0000","last_clean":"2023-12-08T21:25:37.528119+0000","last_became_active":"2023-12-08T20:54:56.318408+0000","last_became_peered":"2023-12-08T20:54:56.318408+0000","last_unstale":"2023-12-08T21:25:37.528119+0000","last_undegraded":"2023-12-08T21:25:37.528119+0000","last_fullsized":"2023-12-08T21:25:37.528119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:14:20.217847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:09.731159+0000","last_change":"2023-12-08T20:54:54.926031+0000","last_active":"2023-12-08T21:25:09.731159+0000","last_peered":"2023-12-08T21:25:09.731159+0000","last_clean":"2023-12-08T21:25:09.731159+0000","last_became_active":"2023-12-08T20:54:54.925610+0000","last_became_peered":"2023-12-08T20:54:54.925610+0000","last_unstale":"2023-12-08T21:25:09.731159+0000","last_undegraded":"2023-12-08T21:25:09.731159+0000","last_fullsized":"2023-12-08T21:25:09.731159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:05:08.857673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'78","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:25.041338+0000","last_change":"2023-12-08T20:55:04.523264+0000","last_active":"2023-12-08T21:24:25.041338+0000","last_peered":"2023-12-08T21:24:25.041338+0000","last_clean":"2023-12-08T21:24:25.041338+0000","last_became_active":"2023-12-08T20:55:04.522245+0000","last_became_peered":"2023-12-08T20:55:04.522245+0000","last_unstale":"2023-12-08T21:24:25.041338+0000","last_undegraded":"2023-12-08T21:24:25.041338+0000","last_fullsized":"2023-12-08T21:24:25.041338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:23.322536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.565005+0000","last_change":"2023-12-08T20:54:56.378291+0000","last_active":"2023-12-08T21:25:37.565005+0000","last_peered":"2023-12-08T21:25:37.565005+0000","last_clean":"2023-12-08T21:25:37.565005+0000","last_became_active":"2023-12-08T20:54:56.377762+0000","last_became_peered":"2023-12-08T20:54:56.377762+0000","last_unstale":"2023-12-08T21:25:37.565005+0000","last_undegraded":"2023-12-08T21:25:37.565005+0000","last_fullsized":"2023-12-08T21:25:37.565005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:11:11.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.548033+0000","last_change":"2023-12-08T20:54:54.936008+0000","last_active":"2023-12-08T21:25:04.548033+0000","last_peered":"2023-12-08T21:25:04.548033+0000","last_clean":"2023-12-08T21:25:04.548033+0000","last_became_active":"2023-12-08T20:54:54.935472+0000","last_became_peered":"2023-12-08T20:54:54.935472+0000","last_unstale":"2023-12-08T21:25:04.548033+0000","last_undegraded":"2023-12-08T21:25:04.548033+0000","last_fullsized":"2023-12-08T21:25:04.548033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:11:02.460764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'94","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:23.574475+0000","last_change":"2023-12-08T20:55:04.534674+0000","last_active":"2023-12-08T21:24:23.574475+0000","last_peered":"2023-12-08T21:24:23.574475+0000","last_clean":"2023-12-08T21:24:23.574475+0000","last_became_active":"2023-12-08T20:55:04.533305+0000","last_became_peered":"2023-12-08T20:55:04.533305+0000","last_unstale":"2023-12-08T21:24:23.574475+0000","last_undegraded":"2023-12-08T21:24:23.574475+0000","last_fullsized":"2023-12-08T21:24:23.574475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:18.790378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":6556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.570211+0000","last_change":"2023-12-08T20:54:56.380702+0000","last_active":"2023-12-08T21:25:37.570211+0000","last_peered":"2023-12-08T21:25:37.570211+0000","last_clean":"2023-12-08T21:25:37.570211+0000","last_became_active":"2023-12-08T20:54:56.379933+0000","last_became_peered":"2023-12-08T20:54:56.379933+0000","last_unstale":"2023-12-08T21:25:37.570211+0000","last_undegraded":"2023-12-08T21:25:37.570211+0000","last_fullsized":"2023-12-08T21:25:37.570211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:31:18.872161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:39.712705+0000","last_change":"2023-12-08T20:54:54.983221+0000","last_active":"2023-12-08T21:24:39.712705+0000","last_peered":"2023-12-08T21:24:39.712705+0000","last_clean":"2023-12-08T21:24:39.712705+0000","last_became_active":"2023-12-08T20:54:54.982414+0000","last_became_peered":"2023-12-08T20:54:54.982414+0000","last_unstale":"2023-12-08T21:24:39.712705+0000","last_undegraded":"2023-12-08T21:24:39.712705+0000","last_fullsized":"2023-12-08T21:24:39.712705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:36:42.874558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'68","reported_seq":97,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.192568+0000","last_change":"2023-12-08T20:55:04.515310+0000","last_active":"2023-12-08T21:24:31.192568+0000","last_peered":"2023-12-08T21:24:31.192568+0000","last_clean":"2023-12-08T21:24:31.192568+0000","last_became_active":"2023-12-08T20:55:04.514907+0000","last_became_peered":"2023-12-08T20:55:04.514907+0000","last_unstale":"2023-12-08T21:24:31.192568+0000","last_undegraded":"2023-12-08T21:24:31.192568+0000","last_fullsized":"2023-12-08T21:24:31.192568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:26:19.536478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.683664+0000","last_change":"2023-12-08T20:54:56.378176+0000","last_active":"2023-12-08T21:25:37.683664+0000","last_peered":"2023-12-08T21:25:37.683664+0000","last_clean":"2023-12-08T21:25:37.683664+0000","last_became_active":"2023-12-08T20:54:56.377430+0000","last_became_peered":"2023-12-08T20:54:56.377430+0000","last_unstale":"2023-12-08T21:25:37.683664+0000","last_undegraded":"2023-12-08T21:25:37.683664+0000","last_fullsized":"2023-12-08T21:25:37.683664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'3","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:43.669821+0000","last_change":"2023-12-08T20:54:54.926769+0000","last_active":"2023-12-08T21:24:43.669821+0000","last_peered":"2023-12-08T21:24:43.669821+0000","last_clean":"2023-12-08T21:24:43.669821+0000","last_became_active":"2023-12-08T20:54:54.926386+0000","last_became_peered":"2023-12-08T20:54:54.926386+0000","last_unstale":"2023-12-08T21:24:43.669821+0000","last_undegraded":"2023-12-08T21:24:43.669821+0000","last_fullsized":"2023-12-08T21:24:43.669821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:05.933965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'113","reported_seq":142,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.299532+0000","last_change":"2023-12-08T20:55:04.523709+0000","last_active":"2023-12-08T21:24:33.299532+0000","last_peered":"2023-12-08T21:24:33.299532+0000","last_clean":"2023-12-08T21:24:33.299532+0000","last_became_active":"2023-12-08T20:55:04.523074+0000","last_became_peered":"2023-12-08T20:55:04.523074+0000","last_unstale":"2023-12-08T21:24:33.299532+0000","last_undegraded":"2023-12-08T21:24:33.299532+0000","last_fullsized":"2023-12-08T21:24:33.299532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":11577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.525199+0000","last_change":"2023-12-08T20:54:56.373188+0000","last_active":"2023-12-08T21:25:37.525199+0000","last_peered":"2023-12-08T21:25:37.525199+0000","last_clean":"2023-12-08T21:25:37.525199+0000","last_became_active":"2023-12-08T20:54:56.371132+0000","last_became_peered":"2023-12-08T20:54:56.371132+0000","last_unstale":"2023-12-08T21:25:37.525199+0000","last_undegraded":"2023-12-08T21:25:37.525199+0000","last_fullsized":"2023-12-08T21:25:37.525199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:30:06.387412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'14","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:28.682828+0000","last_change":"2023-12-08T20:54:54.985432+0000","last_active":"2023-12-08T21:25:28.682828+0000","last_peered":"2023-12-08T21:25:28.682828+0000","last_clean":"2023-12-08T21:25:28.682828+0000","last_became_active":"2023-12-08T20:54:54.984661+0000","last_became_peered":"2023-12-08T20:54:54.984661+0000","last_unstale":"2023-12-08T21:25:28.682828+0000","last_undegraded":"2023-12-08T21:25:28.682828+0000","last_fullsized":"2023-12-08T21:25:28.682828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:16:34.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'88","reported_seq":115,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.177978+0000","last_change":"2023-12-08T20:55:04.543349+0000","last_active":"2023-12-08T21:24:31.177978+0000","last_peered":"2023-12-08T21:24:31.177978+0000","last_clean":"2023-12-08T21:24:31.177978+0000","last_became_active":"2023-12-08T20:55:04.541074+0000","last_became_peered":"2023-12-08T20:55:04.541074+0000","last_unstale":"2023-12-08T21:24:31.177978+0000","last_undegraded":"2023-12-08T21:24:31.177978+0000","last_fullsized":"2023-12-08T21:24:31.177978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:35.399668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.566458+0000","last_change":"2023-12-08T20:54:56.413772+0000","last_active":"2023-12-08T21:25:37.566458+0000","last_peered":"2023-12-08T21:25:37.566458+0000","last_clean":"2023-12-08T21:25:37.566458+0000","last_became_active":"2023-12-08T20:54:56.413023+0000","last_became_peered":"2023-12-08T20:54:56.413023+0000","last_unstale":"2023-12-08T21:25:37.566458+0000","last_undegraded":"2023-12-08T21:25:37.566458+0000","last_fullsized":"2023-12-08T21:25:37.566458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'1","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:54.150090+0000","last_change":"2023-12-08T20:54:54.929238+0000","last_active":"2023-12-08T21:24:54.150090+0000","last_peered":"2023-12-08T21:24:54.150090+0000","last_clean":"2023-12-08T21:24:54.150090+0000","last_became_active":"2023-12-08T20:54:54.928543+0000","last_became_peered":"2023-12-08T20:54:54.928543+0000","last_unstale":"2023-12-08T21:24:54.150090+0000","last_undegraded":"2023-12-08T21:24:54.150090+0000","last_fullsized":"2023-12-08T21:24:54.150090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:04.997415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'85","reported_seq":112,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.170336+0000","last_change":"2023-12-08T20:55:04.540347+0000","last_active":"2023-12-08T21:24:31.170336+0000","last_peered":"2023-12-08T21:24:31.170336+0000","last_clean":"2023-12-08T21:24:31.170336+0000","last_became_active":"2023-12-08T20:55:04.535002+0000","last_became_peered":"2023-12-08T20:55:04.535002+0000","last_unstale":"2023-12-08T21:24:31.170336+0000","last_undegraded":"2023-12-08T21:24:31.170336+0000","last_fullsized":"2023-12-08T21:24:31.170336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:09.576246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'40","reported_seq":80,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526171+0000","last_change":"2023-12-08T20:56:00.382392+0000","last_active":"2023-12-08T21:25:37.526171+0000","last_peered":"2023-12-08T21:25:37.526171+0000","last_clean":"2023-12-08T21:25:37.526171+0000","last_became_active":"2023-12-08T20:56:00.381771+0000","last_became_peered":"2023-12-08T20:56:00.381771+0000","last_unstale":"2023-12-08T21:25:37.526171+0000","last_undegraded":"2023-12-08T21:25:37.526171+0000","last_fullsized":"2023-12-08T21:25:37.526171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:08:00.588477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'5","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:26.733534+0000","last_change":"2023-12-08T20:54:54.930839+0000","last_active":"2023-12-08T21:25:26.733534+0000","last_peered":"2023-12-08T21:25:26.733534+0000","last_clean":"2023-12-08T21:25:26.733534+0000","last_became_active":"2023-12-08T20:54:54.928065+0000","last_became_peered":"2023-12-08T20:54:54.928065+0000","last_unstale":"2023-12-08T21:25:26.733534+0000","last_undegraded":"2023-12-08T21:25:26.733534+0000","last_fullsized":"2023-12-08T21:25:26.733534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:28.708543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'59","reported_seq":87,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.072418+0000","last_change":"2023-12-08T20:55:04.520698+0000","last_active":"2023-12-08T21:24:31.072418+0000","last_peered":"2023-12-08T21:24:31.072418+0000","last_clean":"2023-12-08T21:24:31.072418+0000","last_became_active":"2023-12-08T20:55:04.516783+0000","last_became_peered":"2023-12-08T20:55:04.516783+0000","last_unstale":"2023-12-08T21:24:31.072418+0000","last_undegraded":"2023-12-08T21:24:31.072418+0000","last_fullsized":"2023-12-08T21:24:31.072418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:46:00.331700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.459902+0000","last_change":"2023-12-08T20:54:56.331045+0000","last_active":"2023-12-08T21:25:37.459902+0000","last_peered":"2023-12-08T21:25:37.459902+0000","last_clean":"2023-12-08T21:25:37.459902+0000","last_became_active":"2023-12-08T20:54:56.330346+0000","last_became_peered":"2023-12-08T20:54:56.330346+0000","last_unstale":"2023-12-08T21:25:37.459902+0000","last_undegraded":"2023-12-08T21:25:37.459902+0000","last_fullsized":"2023-12-08T21:25:37.459902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:43:36.950589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:58.411679+0000","last_change":"2023-12-08T20:54:54.927094+0000","last_active":"2023-12-08T21:24:58.411679+0000","last_peered":"2023-12-08T21:24:58.411679+0000","last_clean":"2023-12-08T21:24:58.411679+0000","last_became_active":"2023-12-08T20:54:54.926435+0000","last_became_peered":"2023-12-08T20:54:54.926435+0000","last_unstale":"2023-12-08T21:24:58.411679+0000","last_undegraded":"2023-12-08T21:24:58.411679+0000","last_fullsized":"2023-12-08T21:24:58.411679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'79","reported_seq":106,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.481627+0000","last_change":"2023-12-08T20:55:04.534630+0000","last_active":"2023-12-08T21:24:30.481627+0000","last_peered":"2023-12-08T21:24:30.481627+0000","last_clean":"2023-12-08T21:24:30.481627+0000","last_became_active":"2023-12-08T20:55:04.534289+0000","last_became_peered":"2023-12-08T20:55:04.534289+0000","last_unstale":"2023-12-08T21:24:30.481627+0000","last_undegraded":"2023-12-08T21:24:30.481627+0000","last_fullsized":"2023-12-08T21:24:30.481627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:36:33.771845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'24","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.564735+0000","last_change":"2023-12-08T20:54:56.376691+0000","last_active":"2023-12-08T21:25:37.564735+0000","last_peered":"2023-12-08T21:25:37.564735+0000","last_clean":"2023-12-08T21:25:37.564735+0000","last_became_active":"2023-12-08T20:54:56.375922+0000","last_became_peered":"2023-12-08T20:54:56.375922+0000","last_unstale":"2023-12-08T21:25:37.564735+0000","last_undegraded":"2023-12-08T21:25:37.564735+0000","last_fullsized":"2023-12-08T21:25:37.564735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:37:56.593406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'890","reported_seq":924,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.079615+0000","last_change":"2023-12-08T20:54:54.978427+0000","last_active":"2023-12-08T21:25:24.079615+0000","last_peered":"2023-12-08T21:25:24.079615+0000","last_clean":"2023-12-08T21:25:24.079615+0000","last_became_active":"2023-12-08T20:54:54.977999+0000","last_became_peered":"2023-12-08T20:54:54.977999+0000","last_unstale":"2023-12-08T21:25:24.079615+0000","last_undegraded":"2023-12-08T21:25:24.079615+0000","last_fullsized":"2023-12-08T21:25:24.079615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":887,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'80","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.225499+0000","last_change":"2023-12-08T20:55:04.522691+0000","last_active":"2023-12-08T21:24:28.225499+0000","last_peered":"2023-12-08T21:24:28.225499+0000","last_clean":"2023-12-08T21:24:28.225499+0000","last_became_active":"2023-12-08T20:55:04.522190+0000","last_became_peered":"2023-12-08T20:55:04.522190+0000","last_unstale":"2023-12-08T21:24:28.225499+0000","last_undegraded":"2023-12-08T21:24:28.225499+0000","last_fullsized":"2023-12-08T21:24:28.225499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:52.945031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526963+0000","last_change":"2023-12-08T20:54:56.384439+0000","last_active":"2023-12-08T21:25:37.526963+0000","last_peered":"2023-12-08T21:25:37.526963+0000","last_clean":"2023-12-08T21:25:37.526963+0000","last_became_active":"2023-12-08T20:54:56.383561+0000","last_became_peered":"2023-12-08T20:54:56.383561+0000","last_unstale":"2023-12-08T21:25:37.526963+0000","last_undegraded":"2023-12-08T21:25:37.526963+0000","last_fullsized":"2023-12-08T21:25:37.526963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:01.328480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'406","reported_seq":439,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:28.706595+0000","last_change":"2023-12-08T20:54:54.980625+0000","last_active":"2023-12-08T21:25:28.706595+0000","last_peered":"2023-12-08T21:25:28.706595+0000","last_clean":"2023-12-08T21:25:28.706595+0000","last_became_active":"2023-12-08T20:54:54.980023+0000","last_became_peered":"2023-12-08T20:54:54.980023+0000","last_unstale":"2023-12-08T21:25:28.706595+0000","last_undegraded":"2023-12-08T21:25:28.706595+0000","last_fullsized":"2023-12-08T21:25:28.706595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:44:27.401600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'116","reported_seq":144,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.295564+0000","last_change":"2023-12-08T20:55:04.523658+0000","last_active":"2023-12-08T21:24:33.295564+0000","last_peered":"2023-12-08T21:24:33.295564+0000","last_clean":"2023-12-08T21:24:33.295564+0000","last_became_active":"2023-12-08T20:55:04.522325+0000","last_became_peered":"2023-12-08T20:55:04.522325+0000","last_unstale":"2023-12-08T21:24:33.295564+0000","last_undegraded":"2023-12-08T21:24:33.295564+0000","last_fullsized":"2023-12-08T21:24:33.295564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:32:03.125815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":12653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'29","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546655+0000","last_change":"2023-12-08T20:54:56.410075+0000","last_active":"2023-12-08T21:25:37.546655+0000","last_peered":"2023-12-08T21:25:37.546655+0000","last_clean":"2023-12-08T21:25:37.546655+0000","last_became_active":"2023-12-08T20:54:56.409539+0000","last_became_peered":"2023-12-08T20:54:56.409539+0000","last_unstale":"2023-12-08T21:25:37.546655+0000","last_undegraded":"2023-12-08T21:25:37.546655+0000","last_fullsized":"2023-12-08T21:25:37.546655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:37:03.173965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:11.858914+0000","last_change":"2023-12-08T20:54:54.936311+0000","last_active":"2023-12-08T21:25:11.858914+0000","last_peered":"2023-12-08T21:25:11.858914+0000","last_clean":"2023-12-08T21:25:11.858914+0000","last_became_active":"2023-12-08T20:54:54.935889+0000","last_became_peered":"2023-12-08T20:54:54.935889+0000","last_unstale":"2023-12-08T21:25:11.858914+0000","last_undegraded":"2023-12-08T21:25:11.858914+0000","last_fullsized":"2023-12-08T21:25:11.858914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:13.785495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'68","reported_seq":92,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:08.154547+0000","last_change":"2023-12-08T20:56:00.560908+0000","last_active":"2023-12-08T21:24:08.154547+0000","last_peered":"2023-12-08T21:24:08.154547+0000","last_clean":"2023-12-08T21:24:08.154547+0000","last_became_active":"2023-12-08T20:56:00.560282+0000","last_became_peered":"2023-12-08T20:56:00.560282+0000","last_unstale":"2023-12-08T21:24:08.154547+0000","last_undegraded":"2023-12-08T21:24:08.154547+0000","last_fullsized":"2023-12-08T21:24:08.154547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:48:24.748646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":7515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.687754+0000","last_change":"2023-12-08T20:54:56.376709+0000","last_active":"2023-12-08T21:25:37.687754+0000","last_peered":"2023-12-08T21:25:37.687754+0000","last_clean":"2023-12-08T21:25:37.687754+0000","last_became_active":"2023-12-08T20:54:56.369709+0000","last_became_peered":"2023-12-08T20:54:56.369709+0000","last_unstale":"2023-12-08T21:25:37.687754+0000","last_undegraded":"2023-12-08T21:25:37.687754+0000","last_fullsized":"2023-12-08T21:25:37.687754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:06.577773+0000","last_change":"2023-12-08T20:54:54.980040+0000","last_active":"2023-12-08T21:25:06.577773+0000","last_peered":"2023-12-08T21:25:06.577773+0000","last_clean":"2023-12-08T21:25:06.577773+0000","last_became_active":"2023-12-08T20:54:54.979751+0000","last_became_peered":"2023-12-08T20:54:54.979751+0000","last_unstale":"2023-12-08T21:25:06.577773+0000","last_undegraded":"2023-12-08T21:25:06.577773+0000","last_fullsized":"2023-12-08T21:25:06.577773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:08.789175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'79","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.293956+0000","last_change":"2023-12-08T20:55:04.513429+0000","last_active":"2023-12-08T21:24:33.293956+0000","last_peered":"2023-12-08T21:24:33.293956+0000","last_clean":"2023-12-08T21:24:33.293956+0000","last_became_active":"2023-12-08T20:55:04.511405+0000","last_became_peered":"2023-12-08T20:55:04.511405+0000","last_unstale":"2023-12-08T21:24:33.293956+0000","last_undegraded":"2023-12-08T21:24:33.293956+0000","last_fullsized":"2023-12-08T21:24:33.293956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:48:08.081679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.225720+0000","last_change":"2023-12-08T20:55:04.537067+0000","last_active":"2023-12-08T21:24:28.225720+0000","last_peered":"2023-12-08T21:24:28.225720+0000","last_clean":"2023-12-08T21:24:28.225720+0000","last_became_active":"2023-12-08T20:55:04.536497+0000","last_became_peered":"2023-12-08T20:55:04.536497+0000","last_unstale":"2023-12-08T21:24:28.225720+0000","last_undegraded":"2023-12-08T21:24:28.225720+0000","last_fullsized":"2023-12-08T21:24:28.225720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:49.322641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.702440+0000","last_change":"2023-12-08T20:54:56.318249+0000","last_active":"2023-12-08T21:25:37.702440+0000","last_peered":"2023-12-08T21:25:37.702440+0000","last_clean":"2023-12-08T21:25:37.702440+0000","last_became_active":"2023-12-08T20:54:56.317895+0000","last_became_peered":"2023-12-08T20:54:56.317895+0000","last_unstale":"2023-12-08T21:25:37.702440+0000","last_undegraded":"2023-12-08T21:25:37.702440+0000","last_fullsized":"2023-12-08T21:25:37.702440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:47:45.185235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'4","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:20.438586+0000","last_change":"2023-12-08T20:54:54.935924+0000","last_active":"2023-12-08T21:25:20.438586+0000","last_peered":"2023-12-08T21:25:20.438586+0000","last_clean":"2023-12-08T21:25:20.438586+0000","last_became_active":"2023-12-08T20:54:54.935578+0000","last_became_peered":"2023-12-08T20:54:54.935578+0000","last_unstale":"2023-12-08T21:25:20.438586+0000","last_undegraded":"2023-12-08T21:25:20.438586+0000","last_fullsized":"2023-12-08T21:25:20.438586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:22.627774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'80","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:25.039486+0000","last_change":"2023-12-08T20:55:04.535940+0000","last_active":"2023-12-08T21:24:25.039486+0000","last_peered":"2023-12-08T21:24:25.039486+0000","last_clean":"2023-12-08T21:24:25.039486+0000","last_became_active":"2023-12-08T20:55:04.535525+0000","last_became_peered":"2023-12-08T20:55:04.535525+0000","last_unstale":"2023-12-08T21:24:25.039486+0000","last_undegraded":"2023-12-08T21:24:25.039486+0000","last_fullsized":"2023-12-08T21:24:25.039486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:30:14.451021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":11364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546710+0000","last_change":"2023-12-08T20:54:56.413484+0000","last_active":"2023-12-08T21:25:37.546710+0000","last_peered":"2023-12-08T21:25:37.546710+0000","last_clean":"2023-12-08T21:25:37.546710+0000","last_became_active":"2023-12-08T20:54:56.412133+0000","last_became_peered":"2023-12-08T20:54:56.412133+0000","last_unstale":"2023-12-08T21:25:37.546710+0000","last_undegraded":"2023-12-08T21:25:37.546710+0000","last_fullsized":"2023-12-08T21:25:37.546710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:41:41.172811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:54.123528+0000","last_change":"2023-12-08T20:54:54.927237+0000","last_active":"2023-12-08T21:24:54.123528+0000","last_peered":"2023-12-08T21:24:54.123528+0000","last_clean":"2023-12-08T21:24:54.123528+0000","last_became_active":"2023-12-08T20:54:54.926804+0000","last_became_peered":"2023-12-08T20:54:54.926804+0000","last_unstale":"2023-12-08T21:24:54.123528+0000","last_undegraded":"2023-12-08T21:24:54.123528+0000","last_fullsized":"2023-12-08T21:24:54.123528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:30:21.341630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'615","reported_seq":648,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:27.777967+0000","last_change":"2023-12-08T20:54:54.931212+0000","last_active":"2023-12-08T21:25:27.777967+0000","last_peered":"2023-12-08T21:25:27.777967+0000","last_clean":"2023-12-08T21:25:27.777967+0000","last_became_active":"2023-12-08T20:54:54.930324+0000","last_became_peered":"2023-12-08T20:54:54.930324+0000","last_unstale":"2023-12-08T21:25:27.777967+0000","last_undegraded":"2023-12-08T21:25:27.777967+0000","last_fullsized":"2023-12-08T21:25:27.777967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:54.461219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.704911+0000","last_change":"2023-12-08T20:54:56.383879+0000","last_active":"2023-12-08T21:25:37.704911+0000","last_peered":"2023-12-08T21:25:37.704911+0000","last_clean":"2023-12-08T21:25:37.704911+0000","last_became_active":"2023-12-08T20:54:56.383467+0000","last_became_peered":"2023-12-08T20:54:56.383467+0000","last_unstale":"2023-12-08T21:25:37.704911+0000","last_undegraded":"2023-12-08T21:25:37.704911+0000","last_fullsized":"2023-12-08T21:25:37.704911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:59.236467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'50","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.296513+0000","last_change":"2023-12-08T20:55:04.541743+0000","last_active":"2023-12-08T21:24:33.296513+0000","last_peered":"2023-12-08T21:24:33.296513+0000","last_clean":"2023-12-08T21:24:33.296513+0000","last_became_active":"2023-12-08T20:55:04.536537+0000","last_became_peered":"2023-12-08T20:55:04.536537+0000","last_unstale":"2023-12-08T21:24:33.296513+0000","last_undegraded":"2023-12-08T21:24:33.296513+0000","last_fullsized":"2023-12-08T21:24:33.296513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:45.443252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'553","reported_seq":586,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:09.778328+0000","last_change":"2023-12-08T20:54:54.925711+0000","last_active":"2023-12-08T21:25:09.778328+0000","last_peered":"2023-12-08T21:25:09.778328+0000","last_clean":"2023-12-08T21:25:09.778328+0000","last_became_active":"2023-12-08T20:54:54.925229+0000","last_became_peered":"2023-12-08T20:54:54.925229+0000","last_unstale":"2023-12-08T21:25:09.778328+0000","last_undegraded":"2023-12-08T21:25:09.778328+0000","last_fullsized":"2023-12-08T21:25:09.778328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:33:15.472131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'20","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.570598+0000","last_change":"2023-12-08T20:54:56.404755+0000","last_active":"2023-12-08T21:25:37.570598+0000","last_peered":"2023-12-08T21:25:37.570598+0000","last_clean":"2023-12-08T21:25:37.570598+0000","last_became_active":"2023-12-08T20:54:56.403996+0000","last_became_peered":"2023-12-08T20:54:56.403996+0000","last_unstale":"2023-12-08T21:25:37.570598+0000","last_undegraded":"2023-12-08T21:25:37.570598+0000","last_fullsized":"2023-12-08T21:25:37.570598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'97","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.091219+0000","last_change":"2023-12-08T20:55:04.523477+0000","last_active":"2023-12-08T21:24:30.091219+0000","last_peered":"2023-12-08T21:24:30.091219+0000","last_clean":"2023-12-08T21:24:30.091219+0000","last_became_active":"2023-12-08T20:55:04.523137+0000","last_became_peered":"2023-12-08T20:55:04.523137+0000","last_unstale":"2023-12-08T21:24:30.091219+0000","last_undegraded":"2023-12-08T21:24:30.091219+0000","last_fullsized":"2023-12-08T21:24:30.091219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"30'37","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.669831+0000","last_change":"2023-12-08T20:54:56.379055+0000","last_active":"2023-12-08T21:25:37.669831+0000","last_peered":"2023-12-08T21:25:37.669831+0000","last_clean":"2023-12-08T21:25:37.669831+0000","last_became_active":"2023-12-08T20:54:56.373080+0000","last_became_peered":"2023-12-08T20:54:56.373080+0000","last_unstale":"2023-12-08T21:25:37.669831+0000","last_undegraded":"2023-12-08T21:25:37.669831+0000","last_fullsized":"2023-12-08T21:25:37.669831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'27","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.464046+0000","last_change":"2023-12-08T20:54:56.378688+0000","last_active":"2023-12-08T21:25:37.464046+0000","last_peered":"2023-12-08T21:25:37.464046+0000","last_clean":"2023-12-08T21:25:37.464046+0000","last_became_active":"2023-12-08T20:54:56.378154+0000","last_became_peered":"2023-12-08T20:54:56.378154+0000","last_unstale":"2023-12-08T21:25:37.464046+0000","last_undegraded":"2023-12-08T21:25:37.464046+0000","last_fullsized":"2023-12-08T21:25:37.464046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:22:06.625769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'26","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526690+0000","last_change":"2023-12-08T20:54:56.410526+0000","last_active":"2023-12-08T21:25:37.526690+0000","last_peered":"2023-12-08T21:25:37.526690+0000","last_clean":"2023-12-08T21:25:37.526690+0000","last_became_active":"2023-12-08T20:54:56.409863+0000","last_became_peered":"2023-12-08T20:54:56.409863+0000","last_unstale":"2023-12-08T21:25:37.526690+0000","last_undegraded":"2023-12-08T21:25:37.526690+0000","last_fullsized":"2023-12-08T21:25:37.526690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:10.542611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546309+0000","last_change":"2023-12-08T20:54:56.408750+0000","last_active":"2023-12-08T21:25:37.546309+0000","last_peered":"2023-12-08T21:25:37.546309+0000","last_clean":"2023-12-08T21:25:37.546309+0000","last_became_active":"2023-12-08T20:54:56.408205+0000","last_became_peered":"2023-12-08T20:54:56.408205+0000","last_unstale":"2023-12-08T21:25:37.546309+0000","last_undegraded":"2023-12-08T21:25:37.546309+0000","last_fullsized":"2023-12-08T21:25:37.546309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:55.750494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'16","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.474033+0000","last_change":"2023-12-08T20:54:56.386660+0000","last_active":"2023-12-08T21:25:37.474033+0000","last_peered":"2023-12-08T21:25:37.474033+0000","last_clean":"2023-12-08T21:25:37.474033+0000","last_became_active":"2023-12-08T20:54:56.386344+0000","last_became_peered":"2023-12-08T20:54:56.386344+0000","last_unstale":"2023-12-08T21:25:37.474033+0000","last_undegraded":"2023-12-08T21:25:37.474033+0000","last_fullsized":"2023-12-08T21:25:37.474033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:33:27.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.466511+0000","last_change":"2023-12-08T20:54:56.367640+0000","last_active":"2023-12-08T21:25:37.466511+0000","last_peered":"2023-12-08T21:25:37.466511+0000","last_clean":"2023-12-08T21:25:37.466511+0000","last_became_active":"2023-12-08T20:54:56.366967+0000","last_became_peered":"2023-12-08T20:54:56.366967+0000","last_unstale":"2023-12-08T21:25:37.466511+0000","last_undegraded":"2023-12-08T21:25:37.466511+0000","last_fullsized":"2023-12-08T21:25:37.466511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:22:24.171129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'32","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.686312+0000","last_change":"2023-12-08T20:54:56.376663+0000","last_active":"2023-12-08T21:25:37.686312+0000","last_peered":"2023-12-08T21:25:37.686312+0000","last_clean":"2023-12-08T21:25:37.686312+0000","last_became_active":"2023-12-08T20:54:56.371954+0000","last_became_peered":"2023-12-08T20:54:56.371954+0000","last_unstale":"2023-12-08T21:25:37.686312+0000","last_undegraded":"2023-12-08T21:25:37.686312+0000","last_fullsized":"2023-12-08T21:25:37.686312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546047+0000","last_change":"2023-12-08T20:54:56.410398+0000","last_active":"2023-12-08T21:25:37.546047+0000","last_peered":"2023-12-08T21:25:37.546047+0000","last_clean":"2023-12-08T21:25:37.546047+0000","last_became_active":"2023-12-08T20:54:56.409462+0000","last_became_peered":"2023-12-08T20:54:56.409462+0000","last_unstale":"2023-12-08T21:25:37.546047+0000","last_undegraded":"2023-12-08T21:25:37.546047+0000","last_fullsized":"2023-12-08T21:25:37.546047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:07:04.340773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'18","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526793+0000","last_change":"2023-12-08T20:54:56.415800+0000","last_active":"2023-12-08T21:25:37.526793+0000","last_peered":"2023-12-08T21:25:37.526793+0000","last_clean":"2023-12-08T21:25:37.526793+0000","last_became_active":"2023-12-08T20:54:56.415176+0000","last_became_peered":"2023-12-08T20:54:56.415176+0000","last_unstale":"2023-12-08T21:25:37.526793+0000","last_undegraded":"2023-12-08T21:25:37.526793+0000","last_fullsized":"2023-12-08T21:25:37.526793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:24:27.173941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548502+0000","last_change":"2023-12-08T20:54:56.401521+0000","last_active":"2023-12-08T21:25:37.548502+0000","last_peered":"2023-12-08T21:25:37.548502+0000","last_clean":"2023-12-08T21:25:37.548502+0000","last_became_active":"2023-12-08T20:54:56.400980+0000","last_became_peered":"2023-12-08T20:54:56.400980+0000","last_unstale":"2023-12-08T21:25:37.548502+0000","last_undegraded":"2023-12-08T21:25:37.548502+0000","last_fullsized":"2023-12-08T21:25:37.548502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:42.093754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.570548+0000","last_change":"2023-12-08T20:54:56.387218+0000","last_active":"2023-12-08T21:25:37.570548+0000","last_peered":"2023-12-08T21:25:37.570548+0000","last_clean":"2023-12-08T21:25:37.570548+0000","last_became_active":"2023-12-08T20:54:56.386413+0000","last_became_peered":"2023-12-08T20:54:56.386413+0000","last_unstale":"2023-12-08T21:25:37.570548+0000","last_undegraded":"2023-12-08T21:25:37.570548+0000","last_fullsized":"2023-12-08T21:25:37.570548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.704536+0000","last_change":"2023-12-08T20:54:56.371962+0000","last_active":"2023-12-08T21:25:37.704536+0000","last_peered":"2023-12-08T21:25:37.704536+0000","last_clean":"2023-12-08T21:25:37.704536+0000","last_became_active":"2023-12-08T20:54:56.371456+0000","last_became_peered":"2023-12-08T20:54:56.371456+0000","last_unstale":"2023-12-08T21:25:37.704536+0000","last_undegraded":"2023-12-08T21:25:37.704536+0000","last_fullsized":"2023-12-08T21:25:37.704536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:01.725223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572196+0000","last_change":"2023-12-08T20:54:56.381311+0000","last_active":"2023-12-08T21:25:37.572196+0000","last_peered":"2023-12-08T21:25:37.572196+0000","last_clean":"2023-12-08T21:25:37.572196+0000","last_became_active":"2023-12-08T20:54:56.380860+0000","last_became_peered":"2023-12-08T20:54:56.380860+0000","last_unstale":"2023-12-08T21:25:37.572196+0000","last_undegraded":"2023-12-08T21:25:37.572196+0000","last_fullsized":"2023-12-08T21:25:37.572196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:11:11.173329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.527856+0000","last_change":"2023-12-08T20:54:56.261370+0000","last_active":"2023-12-08T21:25:37.527856+0000","last_peered":"2023-12-08T21:25:37.527856+0000","last_clean":"2023-12-08T21:25:37.527856+0000","last_became_active":"2023-12-08T20:54:56.260387+0000","last_became_peered":"2023-12-08T20:54:56.260387+0000","last_unstale":"2023-12-08T21:25:37.527856+0000","last_undegraded":"2023-12-08T21:25:37.527856+0000","last_fullsized":"2023-12-08T21:25:37.527856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:17:07.046357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.468545+0000","last_change":"2023-12-08T20:54:56.388280+0000","last_active":"2023-12-08T21:25:37.468545+0000","last_peered":"2023-12-08T21:25:37.468545+0000","last_clean":"2023-12-08T21:25:37.468545+0000","last_became_active":"2023-12-08T20:54:56.387774+0000","last_became_peered":"2023-12-08T20:54:56.387774+0000","last_unstale":"2023-12-08T21:25:37.468545+0000","last_undegraded":"2023-12-08T21:25:37.468545+0000","last_fullsized":"2023-12-08T21:25:37.468545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:15:20.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.530020+0000","last_change":"2023-12-08T20:54:56.378804+0000","last_active":"2023-12-08T21:25:37.530020+0000","last_peered":"2023-12-08T21:25:37.530020+0000","last_clean":"2023-12-08T21:25:37.530020+0000","last_became_active":"2023-12-08T20:54:56.377029+0000","last_became_peered":"2023-12-08T20:54:56.377029+0000","last_unstale":"2023-12-08T21:25:37.530020+0000","last_undegraded":"2023-12-08T21:25:37.530020+0000","last_fullsized":"2023-12-08T21:25:37.530020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:55:29.247824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526742+0000","last_change":"2023-12-08T20:54:56.372118+0000","last_active":"2023-12-08T21:25:37.526742+0000","last_peered":"2023-12-08T21:25:37.526742+0000","last_clean":"2023-12-08T21:25:37.526742+0000","last_became_active":"2023-12-08T20:54:56.370707+0000","last_became_peered":"2023-12-08T20:54:56.370707+0000","last_unstale":"2023-12-08T21:25:37.526742+0000","last_undegraded":"2023-12-08T21:25:37.526742+0000","last_fullsized":"2023-12-08T21:25:37.526742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:35.994091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.552611+0000","last_change":"2023-12-08T20:54:56.405033+0000","last_active":"2023-12-08T21:25:37.552611+0000","last_peered":"2023-12-08T21:25:37.552611+0000","last_clean":"2023-12-08T21:25:37.552611+0000","last_became_active":"2023-12-08T20:54:56.401544+0000","last_became_peered":"2023-12-08T20:54:56.401544+0000","last_unstale":"2023-12-08T21:25:37.552611+0000","last_undegraded":"2023-12-08T21:25:37.552611+0000","last_fullsized":"2023-12-08T21:25:37.552611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:59.303019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.473127+0000","last_change":"2023-12-08T20:54:56.366037+0000","last_active":"2023-12-08T21:25:37.473127+0000","last_peered":"2023-12-08T21:25:37.473127+0000","last_clean":"2023-12-08T21:25:37.473127+0000","last_became_active":"2023-12-08T20:54:56.365432+0000","last_became_peered":"2023-12-08T20:54:56.365432+0000","last_unstale":"2023-12-08T21:25:37.473127+0000","last_undegraded":"2023-12-08T21:25:37.473127+0000","last_fullsized":"2023-12-08T21:25:37.473127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:48:49.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'32","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.474444+0000","last_change":"2023-12-08T20:54:56.393022+0000","last_active":"2023-12-08T21:25:37.474444+0000","last_peered":"2023-12-08T21:25:37.474444+0000","last_clean":"2023-12-08T21:25:37.474444+0000","last_became_active":"2023-12-08T20:54:56.392408+0000","last_became_peered":"2023-12-08T20:54:56.392408+0000","last_unstale":"2023-12-08T21:25:37.474444+0000","last_undegraded":"2023-12-08T21:25:37.474444+0000","last_fullsized":"2023-12-08T21:25:37.474444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:30:22.435898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572384+0000","last_change":"2023-12-08T20:54:56.380654+0000","last_active":"2023-12-08T21:25:37.572384+0000","last_peered":"2023-12-08T21:25:37.572384+0000","last_clean":"2023-12-08T21:25:37.572384+0000","last_became_active":"2023-12-08T20:54:56.380137+0000","last_became_peered":"2023-12-08T20:54:56.380137+0000","last_unstale":"2023-12-08T21:25:37.572384+0000","last_undegraded":"2023-12-08T21:25:37.572384+0000","last_fullsized":"2023-12-08T21:25:37.572384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:47:59.833913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'21","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.571319+0000","last_change":"2023-12-08T20:54:56.392997+0000","last_active":"2023-12-08T21:25:37.571319+0000","last_peered":"2023-12-08T21:25:37.571319+0000","last_clean":"2023-12-08T21:25:37.571319+0000","last_became_active":"2023-12-08T20:54:56.391299+0000","last_became_peered":"2023-12-08T20:54:56.391299+0000","last_unstale":"2023-12-08T21:25:37.571319+0000","last_undegraded":"2023-12-08T21:25:37.571319+0000","last_fullsized":"2023-12-08T21:25:37.571319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:37.195485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'32","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.563701+0000","last_change":"2023-12-08T20:54:56.393461+0000","last_active":"2023-12-08T21:25:37.563701+0000","last_peered":"2023-12-08T21:25:37.563701+0000","last_clean":"2023-12-08T21:25:37.563701+0000","last_became_active":"2023-12-08T20:54:56.392708+0000","last_became_peered":"2023-12-08T20:54:56.392708+0000","last_unstale":"2023-12-08T21:25:37.563701+0000","last_undegraded":"2023-12-08T21:25:37.563701+0000","last_fullsized":"2023-12-08T21:25:37.563701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:44.697264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'30","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.568850+0000","last_change":"2023-12-08T20:54:56.319183+0000","last_active":"2023-12-08T21:25:37.568850+0000","last_peered":"2023-12-08T21:25:37.568850+0000","last_clean":"2023-12-08T21:25:37.568850+0000","last_became_active":"2023-12-08T20:54:56.318400+0000","last_became_peered":"2023-12-08T20:54:56.318400+0000","last_unstale":"2023-12-08T21:25:37.568850+0000","last_undegraded":"2023-12-08T21:25:37.568850+0000","last_fullsized":"2023-12-08T21:25:37.568850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'20","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.552441+0000","last_change":"2023-12-08T20:54:56.414028+0000","last_active":"2023-12-08T21:25:37.552441+0000","last_peered":"2023-12-08T21:25:37.552441+0000","last_clean":"2023-12-08T21:25:37.552441+0000","last_became_active":"2023-12-08T20:54:56.413220+0000","last_became_peered":"2023-12-08T20:54:56.413220+0000","last_unstale":"2023-12-08T21:25:37.552441+0000","last_undegraded":"2023-12-08T21:25:37.552441+0000","last_fullsized":"2023-12-08T21:25:37.552441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:23.917049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.553915+0000","last_change":"2023-12-08T20:54:56.366203+0000","last_active":"2023-12-08T21:25:37.553915+0000","last_peered":"2023-12-08T21:25:37.553915+0000","last_clean":"2023-12-08T21:25:37.553915+0000","last_became_active":"2023-12-08T20:54:56.365448+0000","last_became_peered":"2023-12-08T20:54:56.365448+0000","last_unstale":"2023-12-08T21:25:37.553915+0000","last_undegraded":"2023-12-08T21:25:37.553915+0000","last_fullsized":"2023-12-08T21:25:37.553915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:10.405742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'25","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.673045+0000","last_change":"2023-12-08T20:54:56.373847+0000","last_active":"2023-12-08T21:25:37.673045+0000","last_peered":"2023-12-08T21:25:37.673045+0000","last_clean":"2023-12-08T21:25:37.673045+0000","last_became_active":"2023-12-08T20:54:56.369574+0000","last_became_peered":"2023-12-08T20:54:56.369574+0000","last_unstale":"2023-12-08T21:25:37.673045+0000","last_undegraded":"2023-12-08T21:25:37.673045+0000","last_fullsized":"2023-12-08T21:25:37.673045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:10.078450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'21","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.554262+0000","last_change":"2023-12-08T20:54:56.411972+0000","last_active":"2023-12-08T21:25:37.554262+0000","last_peered":"2023-12-08T21:25:37.554262+0000","last_clean":"2023-12-08T21:25:37.554262+0000","last_became_active":"2023-12-08T20:54:56.411339+0000","last_became_peered":"2023-12-08T20:54:56.411339+0000","last_unstale":"2023-12-08T21:25:37.554262+0000","last_undegraded":"2023-12-08T21:25:37.554262+0000","last_fullsized":"2023-12-08T21:25:37.554262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:41.074875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'17","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.668142+0000","last_change":"2023-12-08T20:54:56.370763+0000","last_active":"2023-12-08T21:25:37.668142+0000","last_peered":"2023-12-08T21:25:37.668142+0000","last_clean":"2023-12-08T21:25:37.668142+0000","last_became_active":"2023-12-08T20:54:56.369650+0000","last_became_peered":"2023-12-08T20:54:56.369650+0000","last_unstale":"2023-12-08T21:25:37.668142+0000","last_undegraded":"2023-12-08T21:25:37.668142+0000","last_fullsized":"2023-12-08T21:25:37.668142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548529+0000","last_change":"2023-12-08T20:54:56.409124+0000","last_active":"2023-12-08T21:25:37.548529+0000","last_peered":"2023-12-08T21:25:37.548529+0000","last_clean":"2023-12-08T21:25:37.548529+0000","last_became_active":"2023-12-08T20:54:56.408861+0000","last_became_peered":"2023-12-08T20:54:56.408861+0000","last_unstale":"2023-12-08T21:25:37.548529+0000","last_undegraded":"2023-12-08T21:25:37.548529+0000","last_fullsized":"2023-12-08T21:25:37.548529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:40:00.277639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'19","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.545814+0000","last_change":"2023-12-08T20:54:56.407010+0000","last_active":"2023-12-08T21:25:37.545814+0000","last_peered":"2023-12-08T21:25:37.545814+0000","last_clean":"2023-12-08T21:25:37.545814+0000","last_became_active":"2023-12-08T20:54:56.404697+0000","last_became_peered":"2023-12-08T20:54:56.404697+0000","last_unstale":"2023-12-08T21:25:37.545814+0000","last_undegraded":"2023-12-08T21:25:37.545814+0000","last_fullsized":"2023-12-08T21:25:37.545814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:58:49.474462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.554838+0000","last_change":"2023-12-08T20:54:56.378873+0000","last_active":"2023-12-08T21:25:37.554838+0000","last_peered":"2023-12-08T21:25:37.554838+0000","last_clean":"2023-12-08T21:25:37.554838+0000","last_became_active":"2023-12-08T20:54:56.377835+0000","last_became_peered":"2023-12-08T20:54:56.377835+0000","last_unstale":"2023-12-08T21:25:37.554838+0000","last_undegraded":"2023-12-08T21:25:37.554838+0000","last_fullsized":"2023-12-08T21:25:37.554838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:54:57.439693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2350,"num_write_kb":252630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2525,"ondisk_log_size":2525,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1552,"ondisk_log_size":1552,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23858448,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":5673,"num_write_kb":26542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32464896,"data_stored":47716896,"data_compressed":4732252,"data_compressed_allocated":7307264,"data_compressed_original":22618112,"omap_allocated":0,"internal_metadata":0},"log_size":5209,"ondisk_log_size":5209,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509821,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":4588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":4698112,"data_stored":7801495,"data_compressed":855543,"data_compressed_allocated":1261568,"data_compressed_original":4567040,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.91400000000000003,"15min":0.878},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.371},"max":{"1min":1.268,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.157},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.93200000000000005,"15min":0.94299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.499},"max":{"1min":1.2649999999999999,"5min":1.4710000000000001,"15min":1.6479999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96299999999999997,"15min":0.92700000000000005},"min":{"1min":0.56299999999999994,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3280000000000001,"5min":1.405,"15min":1.405},"last":1.2869999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.93300000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.48599999999999999},"max":{"1min":1.1519999999999999,"5min":1.3640000000000001,"15min":1.504},"last":0.93000000000000005}]},{"osd":2,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.94699999999999995,"15min":0.91800000000000004},"min":{"1min":0.67100000000000004,"5min":0.54600000000000004,"15min":0.51900000000000002},"max":{"1min":1.2290000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98199999999999998,"15min":0.98999999999999999},"min":{"1min":0.69399999999999995,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":1.3049999999999999,"5min":1.361,"15min":1.776},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0169999999999999,"15min":1.0089999999999999},"min":{"1min":0.75900000000000001,"5min":0.64100000000000001,"15min":0.46700000000000003},"max":{"1min":1.355,"5min":1.363,"15min":2.0840000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0720000000000001,"15min":1.0800000000000001},"min":{"1min":0.82099999999999995,"5min":0.61399999999999999,"15min":0.44800000000000001},"max":{"1min":1.276,"5min":1.468,"15min":2.181},"last":1.0660000000000001}]},{"osd":4,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.90400000000000003,"15min":0.91500000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.30199999999999999},"max":{"1min":1.173,"5min":1.444,"15min":1.972},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.995,"5min":1.0249999999999999,"15min":1.0289999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4099999999999999,"5min":1.4830000000000001,"15min":1.8149999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.008,"15min":1.0189999999999999},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.41799999999999998},"max":{"1min":1.327,"5min":1.5760000000000001,"15min":2.3069999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0469999999999999,"15min":1.0669999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52100000000000002},"max":{"1min":1.3140000000000001,"5min":1.4470000000000001,"15min":1.8959999999999999},"last":1.2529999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1080000000000001,"15min":1.107},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.56999999999999995},"max":{"1min":1.353,"5min":1.5760000000000001,"15min":1.71},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1519999999999999,"15min":1.167},"min":{"1min":0.69599999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3959999999999999,"5min":1.7110000000000001,"15min":1.8600000000000001},"last":1.401}]}]},{"osd":3,"up_from":15,"seq":64424509821,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62188,"kb_used_data":8804,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309652,"statfs":{"total":96636764160,"available":96573083648,"internally_reserved":0,"allocated":9015296,"data_stored":12714767,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.53600000000000003,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":1.3520000000000001,"5min":1.3700000000000001,"15min":1.655},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81299999999999994,"15min":0.78400000000000003},"min":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.34699999999999998},"max":{"1min":1.383,"5min":1.504,"15min":1.7809999999999999},"last":0.375}]},{"osd":1,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.83799999999999997,"15min":0.82099999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.30399999999999999},"max":{"1min":1.254,"5min":1.5189999999999999,"15min":1.5329999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.93300000000000005,"15min":0.93600000000000005},"min":{"1min":0.52600000000000002,"5min":0.46200000000000002,"15min":0.26900000000000002},"max":{"1min":1.3700000000000001,"5min":1.4490000000000001,"15min":2.036},"last":0.84599999999999997}]},{"osd":2,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.56599999999999995,"5min":0.48099999999999998,"15min":0.45500000000000002},"max":{"1min":1.5349999999999999,"5min":1.585,"15min":1.9470000000000001},"last":0.441},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.002,"15min":0.98799999999999999},"min":{"1min":0.63900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.377,"5min":1.534,"15min":1.786},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.091,"15min":1.0820000000000001},"min":{"1min":0.79800000000000004,"5min":0.65500000000000003,"15min":0.52000000000000002},"max":{"1min":1.6839999999999999,"5min":1.73,"15min":1.73},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.171,"15min":1.143},"min":{"1min":0.85399999999999998,"5min":0.66300000000000003,"15min":0.53700000000000003},"max":{"1min":1.554,"5min":1.875,"15min":2.3039999999999998},"last":0.89800000000000002}]},{"osd":5,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.80800000000000005,"5min":0.70999999999999996,"15min":0.65700000000000003},"max":{"1min":1.679,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.272,"15min":1.272},"min":{"1min":0.89500000000000002,"5min":0.747,"15min":0.55000000000000004},"max":{"1min":1.798,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.0669999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3089999999999999,"15min":1.296},"min":{"1min":0.747,"5min":0.747,"15min":0.629},"max":{"1min":1.9179999999999999,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.234,"15min":1.2150000000000001},"min":{"1min":0.98299999999999998,"5min":0.83599999999999997,"15min":0.621},"max":{"1min":1.478,"5min":1.8460000000000001,"15min":1.9059999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.282,"15min":1.2609999999999999},"min":{"1min":0.94699999999999995,"5min":0.72099999999999997,"15min":0.58899999999999997},"max":{"1min":1.6000000000000001,"5min":1.849,"15min":1.849},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.379,"5min":1.327,"15min":1.306},"min":{"1min":1.05,"5min":0.81799999999999995,"15min":0.58499999999999996},"max":{"1min":1.9239999999999999,"5min":1.966,"15min":2.1640000000000001},"last":0.64100000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509820,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37588,"kb_used_data":6412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334252,"statfs":{"total":96636764160,"available":96598274048,"internally_reserved":0,"allocated":6565888,"data_stored":8520553,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.747,"15min":0.748},"min":{"1min":0.50800000000000001,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.93200000000000005,"5min":1.296,"15min":1.4670000000000001},"last":1.097},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.81599999999999995,"15min":0.80500000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.316},"max":{"1min":1.262,"5min":1.429,"15min":1.482},"last":0.66300000000000003}]},{"osd":1,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.59299999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4430000000000001,"5min":1.466,"15min":1.6599999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.92600000000000005,"15min":0.90800000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":1.2809999999999999,"5min":1.3919999999999999,"15min":4.5620000000000003},"last":1.0129999999999999}]},{"osd":3,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.88400000000000001,"15min":0.85699999999999998},"min":{"1min":0.63500000000000001,"5min":0.52400000000000002,"15min":0.39300000000000002},"max":{"1min":1.5049999999999999,"5min":1.704,"15min":1.704},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.048,"15min":1.014},"min":{"1min":0.75,"5min":0.63600000000000001,"15min":0.44500000000000001},"max":{"1min":1.643,"5min":1.643,"15min":1.661},"last":0.96599999999999997}]},{"osd":4,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.1259999999999999,"15min":1.105},"min":{"1min":0.67800000000000005,"5min":0.65600000000000003,"15min":0.51200000000000001},"max":{"1min":1.3799999999999999,"5min":1.647,"15min":1.726},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.085,"15min":1.046},"min":{"1min":0.80300000000000005,"5min":0.67400000000000004,"15min":0.53700000000000003},"max":{"1min":1.359,"5min":1.609,"15min":1.6240000000000001},"last":1.0629999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.218,"15min":1.196},"min":{"1min":0.83199999999999996,"5min":0.74099999999999999,"15min":0.624},"max":{"1min":1.458,"5min":1.7649999999999999,"15min":1.8009999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.204,"15min":1.194},"min":{"1min":0.96599999999999997,"5min":0.85499999999999998,"15min":0.61099999999999999},"max":{"1min":1.466,"5min":1.7470000000000001,"15min":1.855},"last":1.1419999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1519999999999999,"15min":1.139},"min":{"1min":0.84699999999999998,"5min":0.80600000000000005,"15min":0.66300000000000003},"max":{"1min":1.478,"5min":1.5209999999999999,"15min":1.7270000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.246,"5min":1.282,"15min":1.2689999999999999},"min":{"1min":0.93999999999999995,"5min":0.77800000000000002,"15min":0.54700000000000004},"max":{"1min":1.5469999999999999,"5min":1.919,"15min":2.0150000000000001},"last":1.3320000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3,"15min":1.2729999999999999},"min":{"1min":1.0109999999999999,"5min":0.76200000000000001,"15min":0.56999999999999995},"max":{"1min":1.5489999999999999,"5min":1.8400000000000001,"15min":1.9810000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.2430000000000001,"15min":1.22},"min":{"1min":0.97499999999999998,"5min":0.82099999999999995,"15min":0.68500000000000005},"max":{"1min":1.6040000000000001,"5min":1.7869999999999999,"15min":1.8240000000000001},"last":0.89300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509822,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":721711,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.50900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.7689999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.85799999999999998,"15min":0.80700000000000005},"min":{"1min":0.61299999999999999,"5min":0.34200000000000003,"15min":0.33700000000000002},"max":{"1min":1.3340000000000001,"5min":1.556,"15min":1.556},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.75},"min":{"1min":0.54000000000000004,"5min":0.41699999999999998,"15min":0.41599999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.4510000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96699999999999997,"15min":0.91800000000000004},"min":{"1min":0.60599999999999998,"5min":0.50800000000000001,"15min":0.33500000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":2.0019999999999998},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.002,"15min":0.95999999999999996},"min":{"1min":0.51100000000000001,"5min":0.46100000000000002,"15min":0.32400000000000001},"max":{"1min":1.3819999999999999,"5min":1.639,"15min":1.948},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97599999999999998,"15min":0.94099999999999995},"min":{"1min":0.69999999999999996,"5min":0.48699999999999999,"15min":0.35199999999999998},"max":{"1min":1.4099999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.63}]},{"osd":4,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1339999999999999,"15min":1.0760000000000001},"min":{"1min":0.80500000000000005,"5min":0.67700000000000005,"15min":0.57299999999999995},"max":{"1min":1.577,"5min":1.879,"15min":1.879},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.194,"15min":1.163},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.626},"max":{"1min":1.5,"5min":1.7470000000000001,"15min":2.0259999999999998},"last":1.175}]},{"osd":5,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2190000000000001,"15min":1.163},"min":{"1min":0.76100000000000001,"5min":0.71899999999999997,"15min":0.60199999999999998},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.9179999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2270000000000001,"15min":1.1679999999999999},"min":{"1min":0.92800000000000005,"5min":0.65300000000000002,"15min":0.64600000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.91400000000000003}]},{"osd":6,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.284,"15min":1.242},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.569,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.28,"15min":1.238},"min":{"1min":1.008,"5min":0.85299999999999998,"15min":0.66200000000000003},"max":{"1min":1.631,"5min":1.7529999999999999,"15min":2.0259999999999998},"last":1.0189999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3360000000000001,"15min":1.28},"min":{"1min":1.0640000000000001,"5min":0.82799999999999996,"15min":0.66600000000000004},"max":{"1min":1.526,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.139},{"interface":"front","average":{"1min":1.264,"5min":1.298,"15min":1.2450000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.67300000000000004},"max":{"1min":1.786,"5min":1.873,"15min":2.1880000000000002},"last":1.105}]}]},{"osd":0,"up_from":15,"seq":64424509821,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42508,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329332,"statfs":{"total":96636764160,"available":96593235968,"internally_reserved":0,"allocated":3084288,"data_stored":4325633,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.52500000000000002,"5min":0.35699999999999998,"15min":0.35099999999999998},"max":{"1min":1.2430000000000001,"5min":1.3819999999999999,"15min":1.698},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82299999999999995,"15min":0.81299999999999994},"min":{"1min":0.629,"5min":0.46200000000000002,"15min":0.40600000000000003},"max":{"1min":1.4650000000000001,"5min":1.788,"15min":1.907},"last":0.91000000000000003}]},{"osd":2,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84399999999999997,"15min":0.84699999999999998},"min":{"1min":0.60599999999999998,"5min":0.41999999999999998,"15min":0.34100000000000003},"max":{"1min":1.286,"5min":1.633,"15min":1.633},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":0.92300000000000004,"15min":0.88500000000000001},"min":{"1min":0.68899999999999995,"5min":0.432,"15min":0.38400000000000001},"max":{"1min":1.47,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.82999999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":1.292,"5min":1.2969999999999999,"15min":1.657},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0389999999999999,"15min":1.02},"min":{"1min":0.83499999999999996,"5min":0.40999999999999998,"15min":0.38400000000000001},"max":{"1min":1.631,"5min":1.694,"15min":2.2850000000000001},"last":1.1799999999999999}]},{"osd":4,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.117,"15min":1.105},"min":{"1min":0.84499999999999997,"5min":0.64000000000000001,"15min":0.61299999999999999},"max":{"1min":1.3620000000000001,"5min":1.8480000000000001,"15min":2.1000000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.2330000000000001,"15min":1.1160000000000001},"min":{"1min":0.82799999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.617,"5min":14.787000000000001,"15min":14.787000000000001},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2330000000000001,"15min":1.1890000000000001},"min":{"1min":0.79700000000000004,"5min":0.68000000000000005,"15min":0.61699999999999999},"max":{"1min":1.534,"5min":2.218,"15min":2.218},"last":1.071},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2350000000000001,"15min":1.1970000000000001},"min":{"1min":1.071,"5min":0.85499999999999998,"15min":0.66900000000000004},"max":{"1min":1.6870000000000001,"5min":2.0739999999999998,"15min":2.2309999999999999},"last":1.3660000000000001}]},{"osd":6,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.167,"15min":1.145},"min":{"1min":0.82499999999999996,"5min":0.66600000000000004,"15min":0.65400000000000003},"max":{"1min":1.7390000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.323,"15min":1.284},"min":{"1min":1.046,"5min":0.747,"15min":0.68500000000000005},"max":{"1min":1.782,"5min":1.9379999999999999,"15min":2.1480000000000001},"last":1.3100000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.302,"15min":1.2669999999999999},"min":{"1min":1.0249999999999999,"5min":0.83499999999999996,"15min":0.60199999999999998},"max":{"1min":1.784,"5min":2.0059999999999998,"15min":2.3300000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.226,"15min":1.216},"min":{"1min":1.0109999999999999,"5min":0.67000000000000004,"15min":0.58099999999999996},"max":{"1min":1.873,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.2709999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542525,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29016,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342824,"statfs":{"total":96636764160,"available":96607051776,"internally_reserved":0,"allocated":2048000,"data_stored":3016855,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.92600000000000005,"15min":0.91200000000000003},"min":{"1min":0.63400000000000001,"5min":0.55200000000000005,"15min":0.38100000000000001},"max":{"1min":1.2669999999999999,"5min":1.8069999999999999,"15min":1.8939999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.208,"5min":1.948,"15min":1.948},"last":1.0189999999999999}]},{"osd":1,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.96899999999999997,"15min":0.93700000000000006},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.244,"5min":3.246,"15min":3.246},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95299999999999996,"15min":0.94599999999999995},"min":{"1min":0.72299999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.282,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.0960000000000001}]},{"osd":2,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97999999999999998,"15min":0.97499999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.712,"15min":1.9399999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.97499999999999998,"15min":0.97899999999999998},"min":{"1min":0.79000000000000004,"5min":0.50700000000000001,"15min":0.47799999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.8280000000000001},"last":1.296}]},{"osd":3,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0509999999999999,"15min":1.036},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.55300000000000005},"max":{"1min":1.3400000000000001,"5min":1.528,"15min":1.528},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.002,"5min":1.024,"15min":1.0109999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.359,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.95099999999999996}]},{"osd":4,"last update":"Fri Dec 8 21:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93999999999999995,"15min":0.96499999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.55300000000000005},"max":{"1min":1.272,"5min":1.3859999999999999,"15min":1.45},"last":1.242},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.92600000000000005,"15min":0.98899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2709999999999999,"5min":1.371,"15min":1.5680000000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92800000000000005,"15min":0.98099999999999998},"min":{"1min":0.63800000000000001,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.2270000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.085,"5min":1.0920000000000001,"15min":1.127},"min":{"1min":0.67800000000000005,"5min":0.66200000000000003,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.6419999999999999,"15min":1.857},"last":1.052}]},{"osd":6,"last update":"Fri Dec 8 21:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0289999999999999,"15min":1.079},"min":{"1min":0.77400000000000002,"5min":0.68799999999999994,"15min":0.57399999999999995},"max":{"1min":1.2789999999999999,"5min":1.8380000000000001,"15min":1.948},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.202,"5min":1.194,"15min":1.212},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6399999999999999,"5min":1.6639999999999999,"15min":2.0019999999999998},"last":1.143}]}]},{"osd":6,"up_from":14,"seq":60129542526,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42332,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329508,"statfs":{"total":96636764160,"available":96593416192,"internally_reserved":0,"allocated":2904064,"data_stored":4325577,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.92700000000000005,"15min":0.90100000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48799999999999999},"max":{"1min":1.3919999999999999,"5min":1.395,"15min":1.4430000000000001},"last":1.069},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.94199999999999995,"15min":0.90300000000000002},"min":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.44900000000000001},"max":{"1min":1.3420000000000001,"5min":1.3979999999999999,"15min":1.4790000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.96899999999999997,"15min":0.93300000000000005},"min":{"1min":0.65400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2849999999999999,"5min":1.49,"15min":1.49},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.64300000000000002,"5min":0.53600000000000003,"15min":0.48699999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.512},"last":0.97899999999999998}]},{"osd":2,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98099999999999998,"15min":0.93799999999999994},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.45900000000000002},"max":{"1min":1.357,"5min":1.421,"15min":1.421},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0169999999999999,"15min":0.99199999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.51300000000000001},"max":{"1min":1.4410000000000001,"5min":1.546,"15min":1.546},"last":1.107}]},{"osd":3,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0229999999999999,"15min":1.0209999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.56000000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.708},"last":1.135},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.72499999999999998,"5min":0.627,"15min":0.54700000000000004},"max":{"1min":1.389,"5min":1.542,"15min":1.7},"last":1.24}]},{"osd":4,"last update":"Fri Dec 8 21:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.96099999999999997,"15min":0.97499999999999998},"min":{"1min":0.68400000000000005,"5min":0.60499999999999998,"15min":0.50900000000000001},"max":{"1min":1.319,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.022,"15min":1.0029999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.57899999999999996},"max":{"1min":1.55,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.67500000000000004,"5min":0.56499999999999995,"15min":0.53100000000000003},"max":{"1min":1.2110000000000001,"5min":1.79,"15min":1.79},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1140000000000001,"15min":1.111},"min":{"1min":0.80200000000000005,"5min":0.69399999999999995,"15min":0.432},"max":{"1min":1.6120000000000001,"5min":1.694,"15min":1.694},"last":1.3220000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:24:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0609999999999999,"15min":1.0640000000000001},"min":{"1min":0.72899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.696,"5min":1.732,"15min":1.732},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.196,"15min":1.1990000000000001},"min":{"1min":0.78600000000000003,"5min":0.71499999999999997,"15min":0.47299999999999998},"max":{"1min":1.532,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.3979999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542524,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55520,"kb_used_data":6296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316320,"statfs":{"total":96636764160,"available":96579911680,"internally_reserved":0,"allocated":6447104,"data_stored":8521225,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.90200000000000002},"min":{"1min":0.63900000000000001,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.6000000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92200000000000004,"15min":0.90800000000000003},"min":{"1min":0.54200000000000004,"5min":0.51000000000000001,"15min":0.41399999999999998},"max":{"1min":1.1359999999999999,"5min":1.3440000000000001,"15min":1.391},"last":1.0489999999999999}]},{"osd":1,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93799999999999994,"15min":0.91100000000000003},"min":{"1min":0.64100000000000001,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":1.2629999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0289999999999999,"15min":0.998},"min":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.46100000000000002},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4570000000000001},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0029999999999999,"15min":1.0089999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3400000000000001,"5min":1.4710000000000001,"15min":1.681},"last":1.365},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.95399999999999996,"15min":0.94899999999999995},"min":{"1min":0.67700000000000005,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.1479999999999999,"5min":1.52,"15min":1.52},"last":0.97199999999999998}]},{"osd":3,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.996,"15min":0.98699999999999999},"min":{"1min":0.65500000000000003,"5min":0.63100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2150000000000001,"5min":1.927,"15min":1.927},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.143,"15min":1.1140000000000001},"min":{"1min":0.84199999999999997,"5min":0.64100000000000001,"15min":0.433},"max":{"1min":1.3680000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.2789999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.876,"15min":0.91700000000000004},"min":{"1min":0.63700000000000001,"5min":0.56599999999999995,"15min":0.46300000000000002},"max":{"1min":1.034,"5min":1.28,"15min":1.504},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0069999999999999,"15min":0.998},"min":{"1min":0.74299999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.409}]},{"osd":6,"last update":"Fri Dec 8 21:25:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.03,"15min":1.0549999999999999},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.54500000000000004},"max":{"1min":1.415,"5min":1.478,"15min":1.617},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0660000000000001,"15min":1.0569999999999999},"min":{"1min":0.80600000000000005,"5min":0.69899999999999995,"15min":0.52900000000000003},"max":{"1min":1.294,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.23}]},{"osd":7,"last update":"Fri Dec 8 21:25:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.159,"15min":1.157},"min":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.39400000000000002},"max":{"1min":1.524,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.45},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0800000000000001,"15min":1.0960000000000001},"min":{"1min":0.72699999999999998,"5min":0.58299999999999996,"15min":0.45400000000000001},"max":{"1min":1.238,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.91200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":4194360,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6246400,"data_stored":8389280,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8695808,"data_stored":12583494,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":8389952,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4313088,"data_stored":7079854,"data_compressed":822166,"data_compressed_allocated":1216512,"data_compressed_original":3993600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":4194304,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1728512,"data_stored":2885582,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T21:25:45.250 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-08T21:25:45.251 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T21:25:45.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.415+0000 7f08a8f07640 1 Processor -- start 2023-12-08T21:25:45.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.415+0000 7f08a8f07640 1 -- start start 2023-12-08T21:25:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.419+0000 7f08a8f07640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f08a40ceed0 0x7f08a40cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.419+0000 7f08a8f07640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a40cb190 con 0x7f08a40ca2f0 2023-12-08T21:25:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.419+0000 7f08a8f07640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a40cc2d0 con 0x7f08a4153910 2023-12-08T21:25:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.419+0000 7f08a8f07640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a40ca120 con 0x7f08a40ceed0 2023-12-08T21:25:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.419+0000 7f08a2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f08a40ceed0 0x7f08a40cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.419+0000 7f08a1d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f08a40ca2f0 0x7f08a40c3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40830/0 (socket says 172.21.15.53:40830) 2023-12-08T21:25:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.419+0000 7f08a1d9b640 1 -- 172.21.15.53:0/3347273945 learned_addr learned my addr 172.21.15.53:0/3347273945 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:45.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.423+0000 7f08a2d9d640 1 -- 172.21.15.53:0/3347273945 >> v1:172.21.15.146:6789/0 conn(0x7f08a4153910 legacy=0x7f08a415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:45.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.423+0000 7f08a2d9d640 1 -- 172.21.15.53:0/3347273945 >> v1:172.21.15.53:6789/0 conn(0x7f08a40ca2f0 legacy=0x7f08a40c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:45.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.423+0000 7f08a2d9d640 1 -- 172.21.15.53:0/3347273945 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a40ca730 con 0x7f08a40ceed0 2023-12-08T21:25:45.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.427+0000 7f08a2d9d640 1 --2- 172.21.15.53:0/3347273945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08a40ceed0 0x7f08a40cf340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f089c009d90 tx=0x7f089c01f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c8be96d38f11fd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:45.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a159a640 1 -- 172.21.15.53:0/3347273945 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c0af600 con 0x7f08a40ceed0 2023-12-08T21:25:45.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a159a640 1 -- 172.21.15.53:0/3347273945 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c0ab050 con 0x7f08a40ceed0 2023-12-08T21:25:45.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a159a640 1 -- 172.21.15.53:0/3347273945 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c0af980 con 0x7f08a40ceed0 2023-12-08T21:25:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 -- 172.21.15.53:0/3347273945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08a40ceed0 msgr2=0x7f08a40cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 --2- 172.21.15.53:0/3347273945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08a40ceed0 0x7f08a40cf340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f089c009d90 tx=0x7f089c01f100 comp rx=0 tx=0).stop 2023-12-08T21:25:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 -- 172.21.15.53:0/3347273945 shutdown_connections 2023-12-08T21:25:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 --2- 172.21.15.53:0/3347273945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08a40ceed0 0x7f08a40cf340 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 -- 172.21.15.53:0/3347273945 >> 172.21.15.53:0/3347273945 conn(0x7f08a408afc0 msgr2=0x7f08a408b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 -- 172.21.15.53:0/3347273945 shutdown_connections 2023-12-08T21:25:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 -- 172.21.15.53:0/3347273945 wait complete. 2023-12-08T21:25:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 Processor -- start 2023-12-08T21:25:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 -- start start 2023-12-08T21:25:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08a40ca2f0 0x7f08a414ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a40ceed0 0x7f08a41eef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08a4153910 0x7f08a41ef480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4145f10 con 0x7f08a4153910 2023-12-08T21:25:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4149440 con 0x7f08a40ceed0 2023-12-08T21:25:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.431+0000 7f08a8f07640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4149720 con 0x7f08a40ca2f0 2023-12-08T21:25:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.435+0000 7f08a2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08a4153910 0x7f08a41ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.435+0000 7f08a2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08a4153910 0x7f08a41ef480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60186/0 (socket says 172.21.15.53:60186) 2023-12-08T21:25:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.435+0000 7f08a2d9d640 1 -- 172.21.15.53:0/1378517761 learned_addr learned my addr 172.21.15.53:0/1378517761 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.439+0000 7f08a2d9d640 1 -- 172.21.15.53:0/1378517761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08a40ca2f0 msgr2=0x7f08a414ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.439+0000 7f08a2d9d640 1 --2- 172.21.15.53:0/1378517761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08a40ca2f0 0x7f08a414ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.439+0000 7f08a2d9d640 1 -- 172.21.15.53:0/1378517761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a40ceed0 msgr2=0x7f08a41eef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.439+0000 7f08a2d9d640 1 --2- 172.21.15.53:0/1378517761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a40ceed0 0x7f08a41eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.439+0000 7f08a2d9d640 1 -- 172.21.15.53:0/1378517761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c009a70 con 0x7f08a4153910 2023-12-08T21:25:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.439+0000 7f08a2d9d640 1 --2- 172.21.15.53:0/1378517761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08a4153910 0x7f08a41ef480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f089c01cd30 tx=0x7f089c01bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.443+0000 7f0892ffd640 1 -- 172.21.15.53:0/1378517761 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c0b9610 con 0x7f08a4153910 2023-12-08T21:25:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.443+0000 7f0892ffd640 1 -- 172.21.15.53:0/1378517761 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c0b9770 con 0x7f08a4153910 2023-12-08T21:25:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.443+0000 7f0892ffd640 1 -- 172.21.15.53:0/1378517761 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c0b9b00 con 0x7f08a4153910 2023-12-08T21:25:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.443+0000 7f08a8f07640 1 -- 172.21.15.53:0/1378517761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a4144420 con 0x7f08a4153910 2023-12-08T21:25:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.443+0000 7f08a8f07640 1 -- 172.21.15.53:0/1378517761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a41449e0 con 0x7f08a4153910 2023-12-08T21:25:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.447+0000 7f08a8f07640 1 -- 172.21.15.53:0/1378517761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a40675b0 con 0x7f08a4153910 2023-12-08T21:25:45.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.719+0000 7f0892ffd640 1 -- 172.21.15.53:0/1378517761 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f089c0b6050 con 0x7f08a4153910 2023-12-08T21:25:45.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.719+0000 7f0892ffd640 1 --2- 172.21.15.53:0/1378517761 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f08840664c0 0x7f0884068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:45.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.719+0000 7f08a259c640 1 --2- 172.21.15.53:0/1378517761 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f08840664c0 0x7f0884068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:45.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.723+0000 7f08a259c640 1 --2- 172.21.15.53:0/1378517761 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f08840664c0 0x7f0884068980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0894007fd0 tx=0x7f08940079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.755+0000 7f0892ffd640 1 -- 172.21.15.53:0/1378517761 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f089c0f48b0 con 0x7f08a4153910 2023-12-08T21:25:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.755+0000 7f0892ffd640 1 -- 172.21.15.53:0/1378517761 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f089c0f04f0 con 0x7f08a4153910 2023-12-08T21:25:45.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.919+0000 7f08a8f07640 1 -- 172.21.15.53:0/1378517761 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08a40cb6c0 con 0x7f08840664c0 2023-12-08T21:25:45.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.947+0000 7f0892ffd640 1 -- 172.21.15.53:0/1378517761 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369263 (secure 0 0 0) 0x7f08940050d0 con 0x7f08840664c0 2023-12-08T21:25:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:25:45.953 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-12-08T21:25:45.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.955+0000 7f08a8f07640 1 -- 172.21.15.53:0/1378517761 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f08840664c0 msgr2=0x7f0884068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:45.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.955+0000 7f08a8f07640 1 --2- 172.21.15.53:0/1378517761 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f08840664c0 0x7f0884068980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0894007fd0 tx=0x7f08940079a0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.955+0000 7f08a8f07640 1 -- 172.21.15.53:0/1378517761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08a4153910 msgr2=0x7f08a41ef480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:45.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.955+0000 7f08a8f07640 1 --2- 172.21.15.53:0/1378517761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08a4153910 0x7f08a41ef480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f089c01cd30 tx=0x7f089c01bea0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.955+0000 7f08a8f07640 1 -- 172.21.15.53:0/1378517761 shutdown_connections 2023-12-08T21:25:45.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.955+0000 7f08a8f07640 1 --2- 172.21.15.53:0/1378517761 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f08840664c0 0x7f0884068980 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.955+0000 7f08a8f07640 1 --2- 172.21.15.53:0/1378517761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08a4153910 0x7f08a41ef480 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.955+0000 7f08a8f07640 1 --2- 172.21.15.53:0/1378517761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a40ceed0 0x7f08a41eef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.955+0000 7f08a8f07640 1 --2- 172.21.15.53:0/1378517761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08a40ca2f0 0x7f08a414ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:45.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.955+0000 7f08a8f07640 1 -- 172.21.15.53:0/1378517761 >> 172.21.15.53:0/1378517761 conn(0x7f08a408afc0 msgr2=0x7f08a408b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:45.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.955+0000 7f08a8f07640 1 -- 172.21.15.53:0/1378517761 shutdown_connections 2023-12-08T21:25:45.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:45.955+0000 7f08a8f07640 1 -- 172.21.15.53:0/1378517761 wait complete. 2023-12-08T21:25:45.976 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":973,"stamp":"2023-12-08T21:25:44.046440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24448816,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":690,"num_read_kb":695,"num_write":8182,"num_write_kb":281588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9403,"ondisk_log_size":9403,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":328152,"kb_used_data":34328,"kb_used_omap":12,"kb_used_meta":293747,"kb_avail":754646568,"statfs":{"total":773094113280,"available":772758085632,"internally_reserved":0,"allocated":35151872,"data_stored":49947816,"data_compressed":4799006,"data_compressed_allocated":7397376,"data_compressed_original":23764992,"omap_allocated":12752,"internal_metadata":300797488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11621,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":23,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004831"},"pg_stats":[{"pgid":"2.1f","version":"30'720","reported_seq":755,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:07.393324+0000","last_change":"2023-12-08T20:54:54.983255+0000","last_active":"2023-12-08T21:24:07.393324+0000","last_peered":"2023-12-08T21:24:07.393324+0000","last_clean":"2023-12-08T21:24:07.393324+0000","last_became_active":"2023-12-08T20:54:54.982479+0000","last_became_peered":"2023-12-08T20:54:54.982479+0000","last_unstale":"2023-12-08T21:24:07.393324+0000","last_undegraded":"2023-12-08T21:24:07.393324+0000","last_fullsized":"2023-12-08T21:24:07.393324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:17:36.784429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":4491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.545912+0000","last_change":"2023-12-08T20:54:56.407614+0000","last_active":"2023-12-08T21:25:37.545912+0000","last_peered":"2023-12-08T21:25:37.545912+0000","last_clean":"2023-12-08T21:25:37.545912+0000","last_became_active":"2023-12-08T20:54:56.406245+0000","last_became_peered":"2023-12-08T20:54:56.406245+0000","last_unstale":"2023-12-08T21:25:37.545912+0000","last_undegraded":"2023-12-08T21:25:37.545912+0000","last_fullsized":"2023-12-08T21:25:37.545912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:29.997818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'66","reported_seq":93,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:29.730895+0000","last_change":"2023-12-08T20:55:04.459400+0000","last_active":"2023-12-08T21:24:29.730895+0000","last_peered":"2023-12-08T21:24:29.730895+0000","last_clean":"2023-12-08T21:24:29.730895+0000","last_became_active":"2023-12-08T20:55:04.458087+0000","last_became_peered":"2023-12-08T20:55:04.458087+0000","last_unstale":"2023-12-08T21:24:29.730895+0000","last_undegraded":"2023-12-08T21:24:29.730895+0000","last_fullsized":"2023-12-08T21:24:29.730895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:23.378911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'290","reported_seq":326,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.211179+0000","last_change":"2023-12-08T20:54:54.929925+0000","last_active":"2023-12-08T21:25:37.211179+0000","last_peered":"2023-12-08T21:25:37.211179+0000","last_clean":"2023-12-08T21:25:37.211179+0000","last_became_active":"2023-12-08T20:54:54.929391+0000","last_became_peered":"2023-12-08T20:54:54.929391+0000","last_unstale":"2023-12-08T21:25:37.211179+0000","last_undegraded":"2023-12-08T21:25:37.211179+0000","last_fullsized":"2023-12-08T21:25:37.211179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:15:29.148520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759983,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":2843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.565498+0000","last_change":"2023-12-08T20:54:56.409201+0000","last_active":"2023-12-08T21:25:37.565498+0000","last_peered":"2023-12-08T21:25:37.565498+0000","last_clean":"2023-12-08T21:25:37.565498+0000","last_became_active":"2023-12-08T20:54:56.408361+0000","last_became_peered":"2023-12-08T20:54:56.408361+0000","last_unstale":"2023-12-08T21:25:37.565498+0000","last_undegraded":"2023-12-08T21:25:37.565498+0000","last_fullsized":"2023-12-08T21:25:37.565498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:43:42.044530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'74","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:08.280157+0000","last_change":"2023-12-08T20:55:04.529086+0000","last_active":"2023-12-08T21:24:08.280157+0000","last_peered":"2023-12-08T21:24:08.280157+0000","last_clean":"2023-12-08T21:24:08.280157+0000","last_became_active":"2023-12-08T20:55:04.528732+0000","last_became_peered":"2023-12-08T20:55:04.528732+0000","last_unstale":"2023-12-08T21:24:08.280157+0000","last_undegraded":"2023-12-08T21:24:08.280157+0000","last_fullsized":"2023-12-08T21:24:08.280157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:09:07.484233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'9","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:20.382538+0000","last_change":"2023-12-08T20:54:54.935973+0000","last_active":"2023-12-08T21:25:20.382538+0000","last_peered":"2023-12-08T21:25:20.382538+0000","last_clean":"2023-12-08T21:25:20.382538+0000","last_became_active":"2023-12-08T20:54:54.935620+0000","last_became_peered":"2023-12-08T20:54:54.935620+0000","last_unstale":"2023-12-08T21:25:20.382538+0000","last_undegraded":"2023-12-08T21:25:20.382538+0000","last_fullsized":"2023-12-08T21:25:20.382538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:57.947192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'23","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572529+0000","last_change":"2023-12-08T20:54:56.382016+0000","last_active":"2023-12-08T21:25:37.572529+0000","last_peered":"2023-12-08T21:25:37.572529+0000","last_clean":"2023-12-08T21:25:37.572529+0000","last_became_active":"2023-12-08T20:54:56.380927+0000","last_became_peered":"2023-12-08T20:54:56.380927+0000","last_unstale":"2023-12-08T21:25:37.572529+0000","last_undegraded":"2023-12-08T21:25:37.572529+0000","last_fullsized":"2023-12-08T21:25:37.572529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'75","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.127325+0000","last_change":"2023-12-08T20:55:04.527024+0000","last_active":"2023-12-08T21:24:30.127325+0000","last_peered":"2023-12-08T21:24:30.127325+0000","last_clean":"2023-12-08T21:24:30.127325+0000","last_became_active":"2023-12-08T20:55:04.526605+0000","last_became_peered":"2023-12-08T20:55:04.526605+0000","last_unstale":"2023-12-08T21:24:30.127325+0000","last_undegraded":"2023-12-08T21:24:30.127325+0000","last_fullsized":"2023-12-08T21:24:30.127325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:15.471006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:54.122416+0000","last_change":"2023-12-08T20:54:54.929388+0000","last_active":"2023-12-08T21:24:54.122416+0000","last_peered":"2023-12-08T21:24:54.122416+0000","last_clean":"2023-12-08T21:24:54.122416+0000","last_became_active":"2023-12-08T20:54:54.926132+0000","last_became_peered":"2023-12-08T20:54:54.926132+0000","last_unstale":"2023-12-08T21:24:54.122416+0000","last_undegraded":"2023-12-08T21:24:54.122416+0000","last_fullsized":"2023-12-08T21:24:54.122416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:00.435948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.531175+0000","last_change":"2023-12-08T20:54:56.388306+0000","last_active":"2023-12-08T21:25:37.531175+0000","last_peered":"2023-12-08T21:25:37.531175+0000","last_clean":"2023-12-08T21:25:37.531175+0000","last_became_active":"2023-12-08T20:54:56.387528+0000","last_became_peered":"2023-12-08T20:54:56.387528+0000","last_unstale":"2023-12-08T21:25:37.531175+0000","last_undegraded":"2023-12-08T21:25:37.531175+0000","last_fullsized":"2023-12-08T21:25:37.531175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:22.236935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'65","reported_seq":92,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:32.160514+0000","last_change":"2023-12-08T20:55:04.523251+0000","last_active":"2023-12-08T21:24:32.160514+0000","last_peered":"2023-12-08T21:24:32.160514+0000","last_clean":"2023-12-08T21:24:32.160514+0000","last_became_active":"2023-12-08T20:55:04.522777+0000","last_became_peered":"2023-12-08T20:55:04.522777+0000","last_unstale":"2023-12-08T21:24:32.160514+0000","last_undegraded":"2023-12-08T21:24:32.160514+0000","last_fullsized":"2023-12-08T21:24:32.160514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:09.972989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'17","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.527629+0000","last_change":"2023-12-08T20:54:56.319638+0000","last_active":"2023-12-08T21:25:37.527629+0000","last_peered":"2023-12-08T21:25:37.527629+0000","last_clean":"2023-12-08T21:25:37.527629+0000","last_became_active":"2023-12-08T20:54:56.318855+0000","last_became_peered":"2023-12-08T20:54:56.318855+0000","last_unstale":"2023-12-08T21:25:37.527629+0000","last_undegraded":"2023-12-08T21:25:37.527629+0000","last_fullsized":"2023-12-08T21:25:37.527629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:27.151902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'722","reported_seq":756,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.547932+0000","last_change":"2023-12-08T20:54:54.929584+0000","last_active":"2023-12-08T21:25:04.547932+0000","last_peered":"2023-12-08T21:25:04.547932+0000","last_clean":"2023-12-08T21:25:04.547932+0000","last_became_active":"2023-12-08T20:54:54.928702+0000","last_became_peered":"2023-12-08T20:54:54.928702+0000","last_unstale":"2023-12-08T21:25:04.547932+0000","last_undegraded":"2023-12-08T21:25:04.547932+0000","last_fullsized":"2023-12-08T21:25:04.547932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:40.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'78","reported_seq":106,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.189347+0000","last_change":"2023-12-08T20:55:04.535786+0000","last_active":"2023-12-08T21:24:31.189347+0000","last_peered":"2023-12-08T21:24:31.189347+0000","last_clean":"2023-12-08T21:24:31.189347+0000","last_became_active":"2023-12-08T20:55:04.535119+0000","last_became_peered":"2023-12-08T20:55:04.535119+0000","last_unstale":"2023-12-08T21:24:31.189347+0000","last_undegraded":"2023-12-08T21:24:31.189347+0000","last_fullsized":"2023-12-08T21:24:31.189347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:23:32.647822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":12383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.475615+0000","last_change":"2023-12-08T20:54:56.370877+0000","last_active":"2023-12-08T21:25:37.475615+0000","last_peered":"2023-12-08T21:25:37.475615+0000","last_clean":"2023-12-08T21:25:37.475615+0000","last_became_active":"2023-12-08T20:54:56.370044+0000","last_became_peered":"2023-12-08T20:54:56.370044+0000","last_unstale":"2023-12-08T21:25:37.475615+0000","last_undegraded":"2023-12-08T21:25:37.475615+0000","last_fullsized":"2023-12-08T21:25:37.475615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:26.733660+0000","last_change":"2023-12-08T20:54:54.923604+0000","last_active":"2023-12-08T21:25:26.733660+0000","last_peered":"2023-12-08T21:25:26.733660+0000","last_clean":"2023-12-08T21:25:26.733660+0000","last_became_active":"2023-12-08T20:54:54.922960+0000","last_became_peered":"2023-12-08T20:54:54.922960+0000","last_unstale":"2023-12-08T21:25:26.733660+0000","last_undegraded":"2023-12-08T21:25:26.733660+0000","last_fullsized":"2023-12-08T21:25:26.733660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:41:46.444603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'95","reported_seq":123,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.193518+0000","last_change":"2023-12-08T20:55:04.522655+0000","last_active":"2023-12-08T21:24:28.193518+0000","last_peered":"2023-12-08T21:24:28.193518+0000","last_clean":"2023-12-08T21:24:28.193518+0000","last_became_active":"2023-12-08T20:55:04.522172+0000","last_became_peered":"2023-12-08T20:55:04.522172+0000","last_unstale":"2023-12-08T21:24:28.193518+0000","last_undegraded":"2023-12-08T21:24:28.193518+0000","last_fullsized":"2023-12-08T21:24:28.193518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:09:00.038275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.700497+0000","last_change":"2023-12-08T20:54:56.366227+0000","last_active":"2023-12-08T21:25:37.700497+0000","last_peered":"2023-12-08T21:25:37.700497+0000","last_clean":"2023-12-08T21:25:37.700497+0000","last_became_active":"2023-12-08T20:54:56.365552+0000","last_became_peered":"2023-12-08T20:54:56.365552+0000","last_unstale":"2023-12-08T21:25:37.700497+0000","last_undegraded":"2023-12-08T21:25:37.700497+0000","last_fullsized":"2023-12-08T21:25:37.700497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:00.821031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.043833+0000","last_change":"2023-12-08T20:54:54.980466+0000","last_active":"2023-12-08T21:25:17.043833+0000","last_peered":"2023-12-08T21:25:17.043833+0000","last_clean":"2023-12-08T21:25:17.043833+0000","last_became_active":"2023-12-08T20:54:54.979668+0000","last_became_peered":"2023-12-08T20:54:54.979668+0000","last_unstale":"2023-12-08T21:25:17.043833+0000","last_undegraded":"2023-12-08T21:25:17.043833+0000","last_fullsized":"2023-12-08T21:25:17.043833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:53.529738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'67","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.342620+0000","last_change":"2023-12-08T20:55:04.513186+0000","last_active":"2023-12-08T21:24:30.342620+0000","last_peered":"2023-12-08T21:24:30.342620+0000","last_clean":"2023-12-08T21:24:30.342620+0000","last_became_active":"2023-12-08T20:55:04.512549+0000","last_became_peered":"2023-12-08T20:55:04.512549+0000","last_unstale":"2023-12-08T21:24:30.342620+0000","last_undegraded":"2023-12-08T21:24:30.342620+0000","last_fullsized":"2023-12-08T21:24:30.342620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:49:31.307794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:19.086943+0000","last_change":"2023-12-08T20:54:56.261452+0000","last_active":"2023-12-08T21:25:19.086943+0000","last_peered":"2023-12-08T21:25:19.086943+0000","last_clean":"2023-12-08T21:25:19.086943+0000","last_became_active":"2023-12-08T20:54:56.260355+0000","last_became_peered":"2023-12-08T20:54:56.260355+0000","last_unstale":"2023-12-08T21:25:19.086943+0000","last_undegraded":"2023-12-08T21:25:19.086943+0000","last_fullsized":"2023-12-08T21:25:19.086943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:47:02.249125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'6","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:15.054410+0000","last_change":"2023-12-08T20:54:54.926546+0000","last_active":"2023-12-08T21:25:15.054410+0000","last_peered":"2023-12-08T21:25:15.054410+0000","last_clean":"2023-12-08T21:25:15.054410+0000","last_became_active":"2023-12-08T20:54:54.925888+0000","last_became_peered":"2023-12-08T20:54:54.925888+0000","last_unstale":"2023-12-08T21:25:15.054410+0000","last_undegraded":"2023-12-08T21:25:15.054410+0000","last_fullsized":"2023-12-08T21:25:15.054410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:25:20.796728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'77","reported_seq":105,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.244645+0000","last_change":"2023-12-08T20:55:04.529041+0000","last_active":"2023-12-08T21:24:28.244645+0000","last_peered":"2023-12-08T21:24:28.244645+0000","last_clean":"2023-12-08T21:24:28.244645+0000","last_became_active":"2023-12-08T20:55:04.528640+0000","last_became_peered":"2023-12-08T20:55:04.528640+0000","last_unstale":"2023-12-08T21:24:28.244645+0000","last_undegraded":"2023-12-08T21:24:28.244645+0000","last_fullsized":"2023-12-08T21:24:28.244645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:18.653508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.700875+0000","last_change":"2023-12-08T20:54:56.365339+0000","last_active":"2023-12-08T21:25:37.700875+0000","last_peered":"2023-12-08T21:25:37.700875+0000","last_clean":"2023-12-08T21:25:37.700875+0000","last_became_active":"2023-12-08T20:54:56.364597+0000","last_became_peered":"2023-12-08T20:54:56.364597+0000","last_unstale":"2023-12-08T21:25:37.700875+0000","last_undegraded":"2023-12-08T21:25:37.700875+0000","last_fullsized":"2023-12-08T21:25:37.700875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:17:58.931401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.405257+0000","last_change":"2023-12-08T20:54:54.928399+0000","last_active":"2023-12-08T21:25:17.405257+0000","last_peered":"2023-12-08T21:25:17.405257+0000","last_clean":"2023-12-08T21:25:17.405257+0000","last_became_active":"2023-12-08T20:54:54.927814+0000","last_became_peered":"2023-12-08T20:54:54.927814+0000","last_unstale":"2023-12-08T21:25:17.405257+0000","last_undegraded":"2023-12-08T21:25:17.405257+0000","last_fullsized":"2023-12-08T21:25:17.405257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:04:22.986992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'64","reported_seq":93,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:32.160272+0000","last_change":"2023-12-08T20:55:04.523561+0000","last_active":"2023-12-08T21:24:32.160272+0000","last_peered":"2023-12-08T21:24:32.160272+0000","last_clean":"2023-12-08T21:24:32.160272+0000","last_became_active":"2023-12-08T20:55:04.522714+0000","last_became_peered":"2023-12-08T20:55:04.522714+0000","last_unstale":"2023-12-08T21:24:32.160272+0000","last_undegraded":"2023-12-08T21:24:32.160272+0000","last_fullsized":"2023-12-08T21:24:32.160272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:14.534456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":9451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.698634+0000","last_change":"2023-12-08T20:54:56.331268+0000","last_active":"2023-12-08T21:25:37.698634+0000","last_peered":"2023-12-08T21:25:37.698634+0000","last_clean":"2023-12-08T21:25:37.698634+0000","last_became_active":"2023-12-08T20:54:56.330508+0000","last_became_peered":"2023-12-08T20:54:56.330508+0000","last_unstale":"2023-12-08T21:25:37.698634+0000","last_undegraded":"2023-12-08T21:25:37.698634+0000","last_fullsized":"2023-12-08T21:25:37.698634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:52.392589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'333","reported_seq":368,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:32.174048+0000","last_change":"2023-12-08T20:54:54.982136+0000","last_active":"2023-12-08T21:25:32.174048+0000","last_peered":"2023-12-08T21:25:32.174048+0000","last_clean":"2023-12-08T21:25:32.174048+0000","last_became_active":"2023-12-08T20:54:54.981168+0000","last_became_peered":"2023-12-08T20:54:54.981168+0000","last_unstale":"2023-12-08T21:25:32.174048+0000","last_undegraded":"2023-12-08T21:25:32.174048+0000","last_fullsized":"2023-12-08T21:25:32.174048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:13.841870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'104","reported_seq":134,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.293300+0000","last_change":"2023-12-08T20:55:04.513360+0000","last_active":"2023-12-08T21:24:33.293300+0000","last_peered":"2023-12-08T21:24:33.293300+0000","last_clean":"2023-12-08T21:24:33.293300+0000","last_became_active":"2023-12-08T20:55:04.511032+0000","last_became_peered":"2023-12-08T20:55:04.511032+0000","last_unstale":"2023-12-08T21:24:33.293300+0000","last_undegraded":"2023-12-08T21:24:33.293300+0000","last_fullsized":"2023-12-08T21:24:33.293300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:38:04.841172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":14212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.469315+0000","last_change":"2023-12-08T20:54:56.409829+0000","last_active":"2023-12-08T21:25:37.469315+0000","last_peered":"2023-12-08T21:25:37.469315+0000","last_clean":"2023-12-08T21:25:37.469315+0000","last_became_active":"2023-12-08T20:54:56.409291+0000","last_became_peered":"2023-12-08T20:54:56.409291+0000","last_unstale":"2023-12-08T21:25:37.469315+0000","last_undegraded":"2023-12-08T21:25:37.469315+0000","last_fullsized":"2023-12-08T21:25:37.469315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:06:37.234510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.405216+0000","last_change":"2023-12-08T20:54:54.978750+0000","last_active":"2023-12-08T21:25:17.405216+0000","last_peered":"2023-12-08T21:25:17.405216+0000","last_clean":"2023-12-08T21:25:17.405216+0000","last_became_active":"2023-12-08T20:54:54.978416+0000","last_became_peered":"2023-12-08T20:54:54.978416+0000","last_unstale":"2023-12-08T21:25:17.405216+0000","last_undegraded":"2023-12-08T21:25:17.405216+0000","last_fullsized":"2023-12-08T21:25:17.405216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:00:08.584168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'75","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.504300+0000","last_change":"2023-12-08T20:55:04.507859+0000","last_active":"2023-12-08T21:24:30.504300+0000","last_peered":"2023-12-08T21:24:30.504300+0000","last_clean":"2023-12-08T21:24:30.504300+0000","last_became_active":"2023-12-08T20:55:04.507454+0000","last_became_peered":"2023-12-08T20:55:04.507454+0000","last_unstale":"2023-12-08T21:24:30.504300+0000","last_undegraded":"2023-12-08T21:24:30.504300+0000","last_fullsized":"2023-12-08T21:24:30.504300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:56:57.279368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'17","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.668121+0000","last_change":"2023-12-08T20:54:56.372983+0000","last_active":"2023-12-08T21:25:37.668121+0000","last_peered":"2023-12-08T21:25:37.668121+0000","last_clean":"2023-12-08T21:25:37.668121+0000","last_became_active":"2023-12-08T20:54:56.369974+0000","last_became_peered":"2023-12-08T20:54:56.369974+0000","last_unstale":"2023-12-08T21:25:37.668121+0000","last_undegraded":"2023-12-08T21:25:37.668121+0000","last_fullsized":"2023-12-08T21:25:37.668121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.229971+0000","last_change":"2023-12-08T20:54:54.925560+0000","last_active":"2023-12-08T21:25:17.229971+0000","last_peered":"2023-12-08T21:25:17.229971+0000","last_clean":"2023-12-08T21:25:17.229971+0000","last_became_active":"2023-12-08T20:54:54.925022+0000","last_became_peered":"2023-12-08T20:54:54.925022+0000","last_unstale":"2023-12-08T21:25:17.229971+0000","last_undegraded":"2023-12-08T21:25:17.229971+0000","last_fullsized":"2023-12-08T21:25:17.229971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:10:52.902793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'85","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:26.213718+0000","last_change":"2023-12-08T20:55:04.531931+0000","last_active":"2023-12-08T21:24:26.213718+0000","last_peered":"2023-12-08T21:24:26.213718+0000","last_clean":"2023-12-08T21:24:26.213718+0000","last_became_active":"2023-12-08T20:55:04.530774+0000","last_became_peered":"2023-12-08T20:55:04.530774+0000","last_unstale":"2023-12-08T21:24:26.213718+0000","last_undegraded":"2023-12-08T21:24:26.213718+0000","last_fullsized":"2023-12-08T21:24:26.213718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:39:26.927665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.560779+0000","last_change":"2023-12-08T20:54:56.391492+0000","last_active":"2023-12-08T21:25:37.560779+0000","last_peered":"2023-12-08T21:25:37.560779+0000","last_clean":"2023-12-08T21:25:37.560779+0000","last_became_active":"2023-12-08T20:54:56.385090+0000","last_became_peered":"2023-12-08T20:54:56.385090+0000","last_unstale":"2023-12-08T21:25:37.560779+0000","last_undegraded":"2023-12-08T21:25:37.560779+0000","last_fullsized":"2023-12-08T21:25:37.560779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:21:29.009005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'6","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:00.493188+0000","last_change":"2023-12-08T20:54:54.932503+0000","last_active":"2023-12-08T21:25:00.493188+0000","last_peered":"2023-12-08T21:25:00.493188+0000","last_clean":"2023-12-08T21:25:00.493188+0000","last_became_active":"2023-12-08T20:54:54.932121+0000","last_became_peered":"2023-12-08T20:54:54.932121+0000","last_unstale":"2023-12-08T21:25:00.493188+0000","last_undegraded":"2023-12-08T21:25:00.493188+0000","last_fullsized":"2023-12-08T21:25:00.493188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:58.013744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'55","reported_seq":84,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:17.818790+0000","last_change":"2023-12-08T20:55:04.529911+0000","last_active":"2023-12-08T21:24:17.818790+0000","last_peered":"2023-12-08T21:24:17.818790+0000","last_clean":"2023-12-08T21:24:17.818790+0000","last_became_active":"2023-12-08T20:55:04.528698+0000","last_became_peered":"2023-12-08T20:55:04.528698+0000","last_unstale":"2023-12-08T21:24:17.818790+0000","last_undegraded":"2023-12-08T21:24:17.818790+0000","last_fullsized":"2023-12-08T21:24:17.818790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:33:11.874876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'24","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546193+0000","last_change":"2023-12-08T20:54:56.413886+0000","last_active":"2023-12-08T21:25:37.546193+0000","last_peered":"2023-12-08T21:25:37.546193+0000","last_clean":"2023-12-08T21:25:37.546193+0000","last_became_active":"2023-12-08T20:54:56.412786+0000","last_became_peered":"2023-12-08T20:54:56.412786+0000","last_unstale":"2023-12-08T21:25:37.546193+0000","last_undegraded":"2023-12-08T21:25:37.546193+0000","last_fullsized":"2023-12-08T21:25:37.546193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:39.331476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'576","reported_seq":1185,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:34.738873+0000","last_change":"2023-12-08T20:54:54.922605+0000","last_active":"2023-12-08T21:25:34.738873+0000","last_peered":"2023-12-08T21:25:34.738873+0000","last_clean":"2023-12-08T21:25:34.738873+0000","last_became_active":"2023-12-08T20:54:54.922014+0000","last_became_peered":"2023-12-08T20:54:54.922014+0000","last_unstale":"2023-12-08T21:25:34.738873+0000","last_undegraded":"2023-12-08T21:25:34.738873+0000","last_fullsized":"2023-12-08T21:25:34.738873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:08:48.601596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125475,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":574,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'71","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.296642+0000","last_change":"2023-12-08T20:55:04.509438+0000","last_active":"2023-12-08T21:24:33.296642+0000","last_peered":"2023-12-08T21:24:33.296642+0000","last_clean":"2023-12-08T21:24:33.296642+0000","last_became_active":"2023-12-08T20:55:04.508219+0000","last_became_peered":"2023-12-08T20:55:04.508219+0000","last_unstale":"2023-12-08T21:24:33.296642+0000","last_undegraded":"2023-12-08T21:24:33.296642+0000","last_fullsized":"2023-12-08T21:24:33.296642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:16:31.758437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'15","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.472707+0000","last_change":"2023-12-08T20:54:56.370599+0000","last_active":"2023-12-08T21:25:37.472707+0000","last_peered":"2023-12-08T21:25:37.472707+0000","last_clean":"2023-12-08T21:25:37.472707+0000","last_became_active":"2023-12-08T20:54:56.370121+0000","last_became_peered":"2023-12-08T20:54:56.370121+0000","last_unstale":"2023-12-08T21:25:37.472707+0000","last_undegraded":"2023-12-08T21:25:37.472707+0000","last_fullsized":"2023-12-08T21:25:37.472707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:58:13.927241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'5","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.082976+0000","last_change":"2023-12-08T20:54:54.927599+0000","last_active":"2023-12-08T21:25:04.082976+0000","last_peered":"2023-12-08T21:25:04.082976+0000","last_clean":"2023-12-08T21:25:04.082976+0000","last_became_active":"2023-12-08T20:54:54.927120+0000","last_became_peered":"2023-12-08T20:54:54.927120+0000","last_unstale":"2023-12-08T21:25:04.082976+0000","last_undegraded":"2023-12-08T21:25:04.082976+0000","last_fullsized":"2023-12-08T21:25:04.082976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:03:38.042201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'100","reported_seq":129,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.170138+0000","last_change":"2023-12-08T20:55:04.546945+0000","last_active":"2023-12-08T21:24:28.170138+0000","last_peered":"2023-12-08T21:24:28.170138+0000","last_clean":"2023-12-08T21:24:28.170138+0000","last_became_active":"2023-12-08T20:55:04.546439+0000","last_became_peered":"2023-12-08T20:55:04.546439+0000","last_unstale":"2023-12-08T21:24:28.170138+0000","last_undegraded":"2023-12-08T21:24:28.170138+0000","last_fullsized":"2023-12-08T21:24:28.170138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:21:30.484701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.698344+0000","last_change":"2023-12-08T20:54:56.372770+0000","last_active":"2023-12-08T21:25:37.698344+0000","last_peered":"2023-12-08T21:25:37.698344+0000","last_clean":"2023-12-08T21:25:37.698344+0000","last_became_active":"2023-12-08T20:54:56.372205+0000","last_became_peered":"2023-12-08T20:54:56.372205+0000","last_unstale":"2023-12-08T21:25:37.698344+0000","last_undegraded":"2023-12-08T21:25:37.698344+0000","last_fullsized":"2023-12-08T21:25:37.698344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:06.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:05.621357+0000","last_change":"2023-12-08T20:54:54.929937+0000","last_active":"2023-12-08T21:25:05.621357+0000","last_peered":"2023-12-08T21:25:05.621357+0000","last_clean":"2023-12-08T21:25:05.621357+0000","last_became_active":"2023-12-08T20:54:54.929177+0000","last_became_peered":"2023-12-08T20:54:54.929177+0000","last_unstale":"2023-12-08T21:25:05.621357+0000","last_undegraded":"2023-12-08T21:25:05.621357+0000","last_fullsized":"2023-12-08T21:25:05.621357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:39:58.988364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:22:24.292691+0000","last_change":"2023-12-08T20:54:16.149485+0000","last_active":"2023-12-08T21:22:24.292691+0000","last_peered":"2023-12-08T21:22:24.292691+0000","last_clean":"2023-12-08T21:22:24.292691+0000","last_became_active":"2023-12-08T20:54:16.147507+0000","last_became_peered":"2023-12-08T20:54:16.147507+0000","last_unstale":"2023-12-08T21:22:24.292691+0000","last_undegraded":"2023-12-08T21:22:24.292691+0000","last_fullsized":"2023-12-08T21:22:24.292691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:14.141045+0000","last_clean_scrub_stamp":"2023-12-08T20:54:14.141045+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:17.484651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'75","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:24.073710+0000","last_change":"2023-12-08T20:55:04.515531+0000","last_active":"2023-12-08T21:24:24.073710+0000","last_peered":"2023-12-08T21:24:24.073710+0000","last_clean":"2023-12-08T21:24:24.073710+0000","last_became_active":"2023-12-08T20:55:04.515200+0000","last_became_peered":"2023-12-08T20:55:04.515200+0000","last_unstale":"2023-12-08T21:24:24.073710+0000","last_undegraded":"2023-12-08T21:24:24.073710+0000","last_fullsized":"2023-12-08T21:24:24.073710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:00:08.085700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.528119+0000","last_change":"2023-12-08T20:54:56.318724+0000","last_active":"2023-12-08T21:25:37.528119+0000","last_peered":"2023-12-08T21:25:37.528119+0000","last_clean":"2023-12-08T21:25:37.528119+0000","last_became_active":"2023-12-08T20:54:56.318408+0000","last_became_peered":"2023-12-08T20:54:56.318408+0000","last_unstale":"2023-12-08T21:25:37.528119+0000","last_undegraded":"2023-12-08T21:25:37.528119+0000","last_fullsized":"2023-12-08T21:25:37.528119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:14:20.217847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:09.731159+0000","last_change":"2023-12-08T20:54:54.926031+0000","last_active":"2023-12-08T21:25:09.731159+0000","last_peered":"2023-12-08T21:25:09.731159+0000","last_clean":"2023-12-08T21:25:09.731159+0000","last_became_active":"2023-12-08T20:54:54.925610+0000","last_became_peered":"2023-12-08T20:54:54.925610+0000","last_unstale":"2023-12-08T21:25:09.731159+0000","last_undegraded":"2023-12-08T21:25:09.731159+0000","last_fullsized":"2023-12-08T21:25:09.731159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:05:08.857673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'78","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:25.041338+0000","last_change":"2023-12-08T20:55:04.523264+0000","last_active":"2023-12-08T21:24:25.041338+0000","last_peered":"2023-12-08T21:24:25.041338+0000","last_clean":"2023-12-08T21:24:25.041338+0000","last_became_active":"2023-12-08T20:55:04.522245+0000","last_became_peered":"2023-12-08T20:55:04.522245+0000","last_unstale":"2023-12-08T21:24:25.041338+0000","last_undegraded":"2023-12-08T21:24:25.041338+0000","last_fullsized":"2023-12-08T21:24:25.041338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:23.322536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.565005+0000","last_change":"2023-12-08T20:54:56.378291+0000","last_active":"2023-12-08T21:25:37.565005+0000","last_peered":"2023-12-08T21:25:37.565005+0000","last_clean":"2023-12-08T21:25:37.565005+0000","last_became_active":"2023-12-08T20:54:56.377762+0000","last_became_peered":"2023-12-08T20:54:56.377762+0000","last_unstale":"2023-12-08T21:25:37.565005+0000","last_undegraded":"2023-12-08T21:25:37.565005+0000","last_fullsized":"2023-12-08T21:25:37.565005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:11:11.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.548033+0000","last_change":"2023-12-08T20:54:54.936008+0000","last_active":"2023-12-08T21:25:04.548033+0000","last_peered":"2023-12-08T21:25:04.548033+0000","last_clean":"2023-12-08T21:25:04.548033+0000","last_became_active":"2023-12-08T20:54:54.935472+0000","last_became_peered":"2023-12-08T20:54:54.935472+0000","last_unstale":"2023-12-08T21:25:04.548033+0000","last_undegraded":"2023-12-08T21:25:04.548033+0000","last_fullsized":"2023-12-08T21:25:04.548033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:11:02.460764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'94","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:23.574475+0000","last_change":"2023-12-08T20:55:04.534674+0000","last_active":"2023-12-08T21:24:23.574475+0000","last_peered":"2023-12-08T21:24:23.574475+0000","last_clean":"2023-12-08T21:24:23.574475+0000","last_became_active":"2023-12-08T20:55:04.533305+0000","last_became_peered":"2023-12-08T20:55:04.533305+0000","last_unstale":"2023-12-08T21:24:23.574475+0000","last_undegraded":"2023-12-08T21:24:23.574475+0000","last_fullsized":"2023-12-08T21:24:23.574475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:18.790378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":6556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.570211+0000","last_change":"2023-12-08T20:54:56.380702+0000","last_active":"2023-12-08T21:25:37.570211+0000","last_peered":"2023-12-08T21:25:37.570211+0000","last_clean":"2023-12-08T21:25:37.570211+0000","last_became_active":"2023-12-08T20:54:56.379933+0000","last_became_peered":"2023-12-08T20:54:56.379933+0000","last_unstale":"2023-12-08T21:25:37.570211+0000","last_undegraded":"2023-12-08T21:25:37.570211+0000","last_fullsized":"2023-12-08T21:25:37.570211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:31:18.872161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:39.712705+0000","last_change":"2023-12-08T20:54:54.983221+0000","last_active":"2023-12-08T21:24:39.712705+0000","last_peered":"2023-12-08T21:24:39.712705+0000","last_clean":"2023-12-08T21:24:39.712705+0000","last_became_active":"2023-12-08T20:54:54.982414+0000","last_became_peered":"2023-12-08T20:54:54.982414+0000","last_unstale":"2023-12-08T21:24:39.712705+0000","last_undegraded":"2023-12-08T21:24:39.712705+0000","last_fullsized":"2023-12-08T21:24:39.712705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:36:42.874558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'68","reported_seq":97,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.192568+0000","last_change":"2023-12-08T20:55:04.515310+0000","last_active":"2023-12-08T21:24:31.192568+0000","last_peered":"2023-12-08T21:24:31.192568+0000","last_clean":"2023-12-08T21:24:31.192568+0000","last_became_active":"2023-12-08T20:55:04.514907+0000","last_became_peered":"2023-12-08T20:55:04.514907+0000","last_unstale":"2023-12-08T21:24:31.192568+0000","last_undegraded":"2023-12-08T21:24:31.192568+0000","last_fullsized":"2023-12-08T21:24:31.192568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:26:19.536478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.683664+0000","last_change":"2023-12-08T20:54:56.378176+0000","last_active":"2023-12-08T21:25:37.683664+0000","last_peered":"2023-12-08T21:25:37.683664+0000","last_clean":"2023-12-08T21:25:37.683664+0000","last_became_active":"2023-12-08T20:54:56.377430+0000","last_became_peered":"2023-12-08T20:54:56.377430+0000","last_unstale":"2023-12-08T21:25:37.683664+0000","last_undegraded":"2023-12-08T21:25:37.683664+0000","last_fullsized":"2023-12-08T21:25:37.683664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:32:27.478268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'3","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:43.669821+0000","last_change":"2023-12-08T20:54:54.926769+0000","last_active":"2023-12-08T21:24:43.669821+0000","last_peered":"2023-12-08T21:24:43.669821+0000","last_clean":"2023-12-08T21:24:43.669821+0000","last_became_active":"2023-12-08T20:54:54.926386+0000","last_became_peered":"2023-12-08T20:54:54.926386+0000","last_unstale":"2023-12-08T21:24:43.669821+0000","last_undegraded":"2023-12-08T21:24:43.669821+0000","last_fullsized":"2023-12-08T21:24:43.669821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:22:05.933965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'113","reported_seq":142,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.299532+0000","last_change":"2023-12-08T20:55:04.523709+0000","last_active":"2023-12-08T21:24:33.299532+0000","last_peered":"2023-12-08T21:24:33.299532+0000","last_clean":"2023-12-08T21:24:33.299532+0000","last_became_active":"2023-12-08T20:55:04.523074+0000","last_became_peered":"2023-12-08T20:55:04.523074+0000","last_unstale":"2023-12-08T21:24:33.299532+0000","last_undegraded":"2023-12-08T21:24:33.299532+0000","last_fullsized":"2023-12-08T21:24:33.299532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":11577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.525199+0000","last_change":"2023-12-08T20:54:56.373188+0000","last_active":"2023-12-08T21:25:37.525199+0000","last_peered":"2023-12-08T21:25:37.525199+0000","last_clean":"2023-12-08T21:25:37.525199+0000","last_became_active":"2023-12-08T20:54:56.371132+0000","last_became_peered":"2023-12-08T20:54:56.371132+0000","last_unstale":"2023-12-08T21:25:37.525199+0000","last_undegraded":"2023-12-08T21:25:37.525199+0000","last_fullsized":"2023-12-08T21:25:37.525199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:30:06.387412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'14","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:28.682828+0000","last_change":"2023-12-08T20:54:54.985432+0000","last_active":"2023-12-08T21:25:28.682828+0000","last_peered":"2023-12-08T21:25:28.682828+0000","last_clean":"2023-12-08T21:25:28.682828+0000","last_became_active":"2023-12-08T20:54:54.984661+0000","last_became_peered":"2023-12-08T20:54:54.984661+0000","last_unstale":"2023-12-08T21:25:28.682828+0000","last_undegraded":"2023-12-08T21:25:28.682828+0000","last_fullsized":"2023-12-08T21:25:28.682828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:16:34.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'88","reported_seq":115,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.177978+0000","last_change":"2023-12-08T20:55:04.543349+0000","last_active":"2023-12-08T21:24:31.177978+0000","last_peered":"2023-12-08T21:24:31.177978+0000","last_clean":"2023-12-08T21:24:31.177978+0000","last_became_active":"2023-12-08T20:55:04.541074+0000","last_became_peered":"2023-12-08T20:55:04.541074+0000","last_unstale":"2023-12-08T21:24:31.177978+0000","last_undegraded":"2023-12-08T21:24:31.177978+0000","last_fullsized":"2023-12-08T21:24:31.177978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:58:35.399668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.566458+0000","last_change":"2023-12-08T20:54:56.413772+0000","last_active":"2023-12-08T21:25:37.566458+0000","last_peered":"2023-12-08T21:25:37.566458+0000","last_clean":"2023-12-08T21:25:37.566458+0000","last_became_active":"2023-12-08T20:54:56.413023+0000","last_became_peered":"2023-12-08T20:54:56.413023+0000","last_unstale":"2023-12-08T21:25:37.566458+0000","last_undegraded":"2023-12-08T21:25:37.566458+0000","last_fullsized":"2023-12-08T21:25:37.566458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:31:28.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'1","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:54.150090+0000","last_change":"2023-12-08T20:54:54.929238+0000","last_active":"2023-12-08T21:24:54.150090+0000","last_peered":"2023-12-08T21:24:54.150090+0000","last_clean":"2023-12-08T21:24:54.150090+0000","last_became_active":"2023-12-08T20:54:54.928543+0000","last_became_peered":"2023-12-08T20:54:54.928543+0000","last_unstale":"2023-12-08T21:24:54.150090+0000","last_undegraded":"2023-12-08T21:24:54.150090+0000","last_fullsized":"2023-12-08T21:24:54.150090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:04.997415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'85","reported_seq":112,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.170336+0000","last_change":"2023-12-08T20:55:04.540347+0000","last_active":"2023-12-08T21:24:31.170336+0000","last_peered":"2023-12-08T21:24:31.170336+0000","last_clean":"2023-12-08T21:24:31.170336+0000","last_became_active":"2023-12-08T20:55:04.535002+0000","last_became_peered":"2023-12-08T20:55:04.535002+0000","last_unstale":"2023-12-08T21:24:31.170336+0000","last_undegraded":"2023-12-08T21:24:31.170336+0000","last_fullsized":"2023-12-08T21:24:31.170336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:09.576246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'40","reported_seq":80,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526171+0000","last_change":"2023-12-08T20:56:00.382392+0000","last_active":"2023-12-08T21:25:37.526171+0000","last_peered":"2023-12-08T21:25:37.526171+0000","last_clean":"2023-12-08T21:25:37.526171+0000","last_became_active":"2023-12-08T20:56:00.381771+0000","last_became_peered":"2023-12-08T20:56:00.381771+0000","last_unstale":"2023-12-08T21:25:37.526171+0000","last_undegraded":"2023-12-08T21:25:37.526171+0000","last_fullsized":"2023-12-08T21:25:37.526171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:08:00.588477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'5","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:26.733534+0000","last_change":"2023-12-08T20:54:54.930839+0000","last_active":"2023-12-08T21:25:26.733534+0000","last_peered":"2023-12-08T21:25:26.733534+0000","last_clean":"2023-12-08T21:25:26.733534+0000","last_became_active":"2023-12-08T20:54:54.928065+0000","last_became_peered":"2023-12-08T20:54:54.928065+0000","last_unstale":"2023-12-08T21:25:26.733534+0000","last_undegraded":"2023-12-08T21:25:26.733534+0000","last_fullsized":"2023-12-08T21:25:26.733534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:28.708543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'59","reported_seq":87,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.072418+0000","last_change":"2023-12-08T20:55:04.520698+0000","last_active":"2023-12-08T21:24:31.072418+0000","last_peered":"2023-12-08T21:24:31.072418+0000","last_clean":"2023-12-08T21:24:31.072418+0000","last_became_active":"2023-12-08T20:55:04.516783+0000","last_became_peered":"2023-12-08T20:55:04.516783+0000","last_unstale":"2023-12-08T21:24:31.072418+0000","last_undegraded":"2023-12-08T21:24:31.072418+0000","last_fullsized":"2023-12-08T21:24:31.072418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:46:00.331700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.459902+0000","last_change":"2023-12-08T20:54:56.331045+0000","last_active":"2023-12-08T21:25:37.459902+0000","last_peered":"2023-12-08T21:25:37.459902+0000","last_clean":"2023-12-08T21:25:37.459902+0000","last_became_active":"2023-12-08T20:54:56.330346+0000","last_became_peered":"2023-12-08T20:54:56.330346+0000","last_unstale":"2023-12-08T21:25:37.459902+0000","last_undegraded":"2023-12-08T21:25:37.459902+0000","last_fullsized":"2023-12-08T21:25:37.459902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:43:36.950589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:58.411679+0000","last_change":"2023-12-08T20:54:54.927094+0000","last_active":"2023-12-08T21:24:58.411679+0000","last_peered":"2023-12-08T21:24:58.411679+0000","last_clean":"2023-12-08T21:24:58.411679+0000","last_became_active":"2023-12-08T20:54:54.926435+0000","last_became_peered":"2023-12-08T20:54:54.926435+0000","last_unstale":"2023-12-08T21:24:58.411679+0000","last_undegraded":"2023-12-08T21:24:58.411679+0000","last_fullsized":"2023-12-08T21:24:58.411679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'79","reported_seq":106,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.481627+0000","last_change":"2023-12-08T20:55:04.534630+0000","last_active":"2023-12-08T21:24:30.481627+0000","last_peered":"2023-12-08T21:24:30.481627+0000","last_clean":"2023-12-08T21:24:30.481627+0000","last_became_active":"2023-12-08T20:55:04.534289+0000","last_became_peered":"2023-12-08T20:55:04.534289+0000","last_unstale":"2023-12-08T21:24:30.481627+0000","last_undegraded":"2023-12-08T21:24:30.481627+0000","last_fullsized":"2023-12-08T21:24:30.481627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:36:33.771845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'24","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.564735+0000","last_change":"2023-12-08T20:54:56.376691+0000","last_active":"2023-12-08T21:25:37.564735+0000","last_peered":"2023-12-08T21:25:37.564735+0000","last_clean":"2023-12-08T21:25:37.564735+0000","last_became_active":"2023-12-08T20:54:56.375922+0000","last_became_peered":"2023-12-08T20:54:56.375922+0000","last_unstale":"2023-12-08T21:25:37.564735+0000","last_undegraded":"2023-12-08T21:25:37.564735+0000","last_fullsized":"2023-12-08T21:25:37.564735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:37:56.593406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'890","reported_seq":924,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.079615+0000","last_change":"2023-12-08T20:54:54.978427+0000","last_active":"2023-12-08T21:25:24.079615+0000","last_peered":"2023-12-08T21:25:24.079615+0000","last_clean":"2023-12-08T21:25:24.079615+0000","last_became_active":"2023-12-08T20:54:54.977999+0000","last_became_peered":"2023-12-08T20:54:54.977999+0000","last_unstale":"2023-12-08T21:25:24.079615+0000","last_undegraded":"2023-12-08T21:25:24.079615+0000","last_fullsized":"2023-12-08T21:25:24.079615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":887,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'80","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.225499+0000","last_change":"2023-12-08T20:55:04.522691+0000","last_active":"2023-12-08T21:24:28.225499+0000","last_peered":"2023-12-08T21:24:28.225499+0000","last_clean":"2023-12-08T21:24:28.225499+0000","last_became_active":"2023-12-08T20:55:04.522190+0000","last_became_peered":"2023-12-08T20:55:04.522190+0000","last_unstale":"2023-12-08T21:24:28.225499+0000","last_undegraded":"2023-12-08T21:24:28.225499+0000","last_fullsized":"2023-12-08T21:24:28.225499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:52.945031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526963+0000","last_change":"2023-12-08T20:54:56.384439+0000","last_active":"2023-12-08T21:25:37.526963+0000","last_peered":"2023-12-08T21:25:37.526963+0000","last_clean":"2023-12-08T21:25:37.526963+0000","last_became_active":"2023-12-08T20:54:56.383561+0000","last_became_peered":"2023-12-08T20:54:56.383561+0000","last_unstale":"2023-12-08T21:25:37.526963+0000","last_undegraded":"2023-12-08T21:25:37.526963+0000","last_fullsized":"2023-12-08T21:25:37.526963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:01.328480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'406","reported_seq":439,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:28.706595+0000","last_change":"2023-12-08T20:54:54.980625+0000","last_active":"2023-12-08T21:25:28.706595+0000","last_peered":"2023-12-08T21:25:28.706595+0000","last_clean":"2023-12-08T21:25:28.706595+0000","last_became_active":"2023-12-08T20:54:54.980023+0000","last_became_peered":"2023-12-08T20:54:54.980023+0000","last_unstale":"2023-12-08T21:25:28.706595+0000","last_undegraded":"2023-12-08T21:25:28.706595+0000","last_fullsized":"2023-12-08T21:25:28.706595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:44:27.401600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'116","reported_seq":144,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.295564+0000","last_change":"2023-12-08T20:55:04.523658+0000","last_active":"2023-12-08T21:24:33.295564+0000","last_peered":"2023-12-08T21:24:33.295564+0000","last_clean":"2023-12-08T21:24:33.295564+0000","last_became_active":"2023-12-08T20:55:04.522325+0000","last_became_peered":"2023-12-08T20:55:04.522325+0000","last_unstale":"2023-12-08T21:24:33.295564+0000","last_undegraded":"2023-12-08T21:24:33.295564+0000","last_fullsized":"2023-12-08T21:24:33.295564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:32:03.125815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":12653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'29","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546655+0000","last_change":"2023-12-08T20:54:56.410075+0000","last_active":"2023-12-08T21:25:37.546655+0000","last_peered":"2023-12-08T21:25:37.546655+0000","last_clean":"2023-12-08T21:25:37.546655+0000","last_became_active":"2023-12-08T20:54:56.409539+0000","last_became_peered":"2023-12-08T20:54:56.409539+0000","last_unstale":"2023-12-08T21:25:37.546655+0000","last_undegraded":"2023-12-08T21:25:37.546655+0000","last_fullsized":"2023-12-08T21:25:37.546655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:37:03.173965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:11.858914+0000","last_change":"2023-12-08T20:54:54.936311+0000","last_active":"2023-12-08T21:25:11.858914+0000","last_peered":"2023-12-08T21:25:11.858914+0000","last_clean":"2023-12-08T21:25:11.858914+0000","last_became_active":"2023-12-08T20:54:54.935889+0000","last_became_peered":"2023-12-08T20:54:54.935889+0000","last_unstale":"2023-12-08T21:25:11.858914+0000","last_undegraded":"2023-12-08T21:25:11.858914+0000","last_fullsized":"2023-12-08T21:25:11.858914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:13.785495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'68","reported_seq":92,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:08.154547+0000","last_change":"2023-12-08T20:56:00.560908+0000","last_active":"2023-12-08T21:24:08.154547+0000","last_peered":"2023-12-08T21:24:08.154547+0000","last_clean":"2023-12-08T21:24:08.154547+0000","last_became_active":"2023-12-08T20:56:00.560282+0000","last_became_peered":"2023-12-08T20:56:00.560282+0000","last_unstale":"2023-12-08T21:24:08.154547+0000","last_undegraded":"2023-12-08T21:24:08.154547+0000","last_fullsized":"2023-12-08T21:24:08.154547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:48:24.748646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":7515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.687754+0000","last_change":"2023-12-08T20:54:56.376709+0000","last_active":"2023-12-08T21:25:37.687754+0000","last_peered":"2023-12-08T21:25:37.687754+0000","last_clean":"2023-12-08T21:25:37.687754+0000","last_became_active":"2023-12-08T20:54:56.369709+0000","last_became_peered":"2023-12-08T20:54:56.369709+0000","last_unstale":"2023-12-08T21:25:37.687754+0000","last_undegraded":"2023-12-08T21:25:37.687754+0000","last_fullsized":"2023-12-08T21:25:37.687754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:06.577773+0000","last_change":"2023-12-08T20:54:54.980040+0000","last_active":"2023-12-08T21:25:06.577773+0000","last_peered":"2023-12-08T21:25:06.577773+0000","last_clean":"2023-12-08T21:25:06.577773+0000","last_became_active":"2023-12-08T20:54:54.979751+0000","last_became_peered":"2023-12-08T20:54:54.979751+0000","last_unstale":"2023-12-08T21:25:06.577773+0000","last_undegraded":"2023-12-08T21:25:06.577773+0000","last_fullsized":"2023-12-08T21:25:06.577773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:08.789175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'79","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.293956+0000","last_change":"2023-12-08T20:55:04.513429+0000","last_active":"2023-12-08T21:24:33.293956+0000","last_peered":"2023-12-08T21:24:33.293956+0000","last_clean":"2023-12-08T21:24:33.293956+0000","last_became_active":"2023-12-08T20:55:04.511405+0000","last_became_peered":"2023-12-08T20:55:04.511405+0000","last_unstale":"2023-12-08T21:24:33.293956+0000","last_undegraded":"2023-12-08T21:24:33.293956+0000","last_fullsized":"2023-12-08T21:24:33.293956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:48:08.081679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.225720+0000","last_change":"2023-12-08T20:55:04.537067+0000","last_active":"2023-12-08T21:24:28.225720+0000","last_peered":"2023-12-08T21:24:28.225720+0000","last_clean":"2023-12-08T21:24:28.225720+0000","last_became_active":"2023-12-08T20:55:04.536497+0000","last_became_peered":"2023-12-08T20:55:04.536497+0000","last_unstale":"2023-12-08T21:24:28.225720+0000","last_undegraded":"2023-12-08T21:24:28.225720+0000","last_fullsized":"2023-12-08T21:24:28.225720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:49.322641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.702440+0000","last_change":"2023-12-08T20:54:56.318249+0000","last_active":"2023-12-08T21:25:37.702440+0000","last_peered":"2023-12-08T21:25:37.702440+0000","last_clean":"2023-12-08T21:25:37.702440+0000","last_became_active":"2023-12-08T20:54:56.317895+0000","last_became_peered":"2023-12-08T20:54:56.317895+0000","last_unstale":"2023-12-08T21:25:37.702440+0000","last_undegraded":"2023-12-08T21:25:37.702440+0000","last_fullsized":"2023-12-08T21:25:37.702440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:47:45.185235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'4","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:20.438586+0000","last_change":"2023-12-08T20:54:54.935924+0000","last_active":"2023-12-08T21:25:20.438586+0000","last_peered":"2023-12-08T21:25:20.438586+0000","last_clean":"2023-12-08T21:25:20.438586+0000","last_became_active":"2023-12-08T20:54:54.935578+0000","last_became_peered":"2023-12-08T20:54:54.935578+0000","last_unstale":"2023-12-08T21:25:20.438586+0000","last_undegraded":"2023-12-08T21:25:20.438586+0000","last_fullsized":"2023-12-08T21:25:20.438586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:22.627774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'80","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:25.039486+0000","last_change":"2023-12-08T20:55:04.535940+0000","last_active":"2023-12-08T21:24:25.039486+0000","last_peered":"2023-12-08T21:24:25.039486+0000","last_clean":"2023-12-08T21:24:25.039486+0000","last_became_active":"2023-12-08T20:55:04.535525+0000","last_became_peered":"2023-12-08T20:55:04.535525+0000","last_unstale":"2023-12-08T21:24:25.039486+0000","last_undegraded":"2023-12-08T21:24:25.039486+0000","last_fullsized":"2023-12-08T21:24:25.039486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:30:14.451021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":11364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546710+0000","last_change":"2023-12-08T20:54:56.413484+0000","last_active":"2023-12-08T21:25:37.546710+0000","last_peered":"2023-12-08T21:25:37.546710+0000","last_clean":"2023-12-08T21:25:37.546710+0000","last_became_active":"2023-12-08T20:54:56.412133+0000","last_became_peered":"2023-12-08T20:54:56.412133+0000","last_unstale":"2023-12-08T21:25:37.546710+0000","last_undegraded":"2023-12-08T21:25:37.546710+0000","last_fullsized":"2023-12-08T21:25:37.546710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:41:41.172811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:54.123528+0000","last_change":"2023-12-08T20:54:54.927237+0000","last_active":"2023-12-08T21:24:54.123528+0000","last_peered":"2023-12-08T21:24:54.123528+0000","last_clean":"2023-12-08T21:24:54.123528+0000","last_became_active":"2023-12-08T20:54:54.926804+0000","last_became_peered":"2023-12-08T20:54:54.926804+0000","last_unstale":"2023-12-08T21:24:54.123528+0000","last_undegraded":"2023-12-08T21:24:54.123528+0000","last_fullsized":"2023-12-08T21:24:54.123528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:30:21.341630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'615","reported_seq":648,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:27.777967+0000","last_change":"2023-12-08T20:54:54.931212+0000","last_active":"2023-12-08T21:25:27.777967+0000","last_peered":"2023-12-08T21:25:27.777967+0000","last_clean":"2023-12-08T21:25:27.777967+0000","last_became_active":"2023-12-08T20:54:54.930324+0000","last_became_peered":"2023-12-08T20:54:54.930324+0000","last_unstale":"2023-12-08T21:25:27.777967+0000","last_undegraded":"2023-12-08T21:25:27.777967+0000","last_fullsized":"2023-12-08T21:25:27.777967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:54.461219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.704911+0000","last_change":"2023-12-08T20:54:56.383879+0000","last_active":"2023-12-08T21:25:37.704911+0000","last_peered":"2023-12-08T21:25:37.704911+0000","last_clean":"2023-12-08T21:25:37.704911+0000","last_became_active":"2023-12-08T20:54:56.383467+0000","last_became_peered":"2023-12-08T20:54:56.383467+0000","last_unstale":"2023-12-08T21:25:37.704911+0000","last_undegraded":"2023-12-08T21:25:37.704911+0000","last_fullsized":"2023-12-08T21:25:37.704911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:59.236467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'50","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.296513+0000","last_change":"2023-12-08T20:55:04.541743+0000","last_active":"2023-12-08T21:24:33.296513+0000","last_peered":"2023-12-08T21:24:33.296513+0000","last_clean":"2023-12-08T21:24:33.296513+0000","last_became_active":"2023-12-08T20:55:04.536537+0000","last_became_peered":"2023-12-08T20:55:04.536537+0000","last_unstale":"2023-12-08T21:24:33.296513+0000","last_undegraded":"2023-12-08T21:24:33.296513+0000","last_fullsized":"2023-12-08T21:24:33.296513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:45.443252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'553","reported_seq":586,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:09.778328+0000","last_change":"2023-12-08T20:54:54.925711+0000","last_active":"2023-12-08T21:25:09.778328+0000","last_peered":"2023-12-08T21:25:09.778328+0000","last_clean":"2023-12-08T21:25:09.778328+0000","last_became_active":"2023-12-08T20:54:54.925229+0000","last_became_peered":"2023-12-08T20:54:54.925229+0000","last_unstale":"2023-12-08T21:25:09.778328+0000","last_undegraded":"2023-12-08T21:25:09.778328+0000","last_fullsized":"2023-12-08T21:25:09.778328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:33:15.472131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'20","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.570598+0000","last_change":"2023-12-08T20:54:56.404755+0000","last_active":"2023-12-08T21:25:37.570598+0000","last_peered":"2023-12-08T21:25:37.570598+0000","last_clean":"2023-12-08T21:25:37.570598+0000","last_became_active":"2023-12-08T20:54:56.403996+0000","last_became_peered":"2023-12-08T20:54:56.403996+0000","last_unstale":"2023-12-08T21:25:37.570598+0000","last_undegraded":"2023-12-08T21:25:37.570598+0000","last_fullsized":"2023-12-08T21:25:37.570598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'97","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.091219+0000","last_change":"2023-12-08T20:55:04.523477+0000","last_active":"2023-12-08T21:24:30.091219+0000","last_peered":"2023-12-08T21:24:30.091219+0000","last_clean":"2023-12-08T21:24:30.091219+0000","last_became_active":"2023-12-08T20:55:04.523137+0000","last_became_peered":"2023-12-08T20:55:04.523137+0000","last_unstale":"2023-12-08T21:24:30.091219+0000","last_undegraded":"2023-12-08T21:24:30.091219+0000","last_fullsized":"2023-12-08T21:24:30.091219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"30'37","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.669831+0000","last_change":"2023-12-08T20:54:56.379055+0000","last_active":"2023-12-08T21:25:37.669831+0000","last_peered":"2023-12-08T21:25:37.669831+0000","last_clean":"2023-12-08T21:25:37.669831+0000","last_became_active":"2023-12-08T20:54:56.373080+0000","last_became_peered":"2023-12-08T20:54:56.373080+0000","last_unstale":"2023-12-08T21:25:37.669831+0000","last_undegraded":"2023-12-08T21:25:37.669831+0000","last_fullsized":"2023-12-08T21:25:37.669831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'27","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.464046+0000","last_change":"2023-12-08T20:54:56.378688+0000","last_active":"2023-12-08T21:25:37.464046+0000","last_peered":"2023-12-08T21:25:37.464046+0000","last_clean":"2023-12-08T21:25:37.464046+0000","last_became_active":"2023-12-08T20:54:56.378154+0000","last_became_peered":"2023-12-08T20:54:56.378154+0000","last_unstale":"2023-12-08T21:25:37.464046+0000","last_undegraded":"2023-12-08T21:25:37.464046+0000","last_fullsized":"2023-12-08T21:25:37.464046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:22:06.625769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'26","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526690+0000","last_change":"2023-12-08T20:54:56.410526+0000","last_active":"2023-12-08T21:25:37.526690+0000","last_peered":"2023-12-08T21:25:37.526690+0000","last_clean":"2023-12-08T21:25:37.526690+0000","last_became_active":"2023-12-08T20:54:56.409863+0000","last_became_peered":"2023-12-08T20:54:56.409863+0000","last_unstale":"2023-12-08T21:25:37.526690+0000","last_undegraded":"2023-12-08T21:25:37.526690+0000","last_fullsized":"2023-12-08T21:25:37.526690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:37:10.542611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546309+0000","last_change":"2023-12-08T20:54:56.408750+0000","last_active":"2023-12-08T21:25:37.546309+0000","last_peered":"2023-12-08T21:25:37.546309+0000","last_clean":"2023-12-08T21:25:37.546309+0000","last_became_active":"2023-12-08T20:54:56.408205+0000","last_became_peered":"2023-12-08T20:54:56.408205+0000","last_unstale":"2023-12-08T21:25:37.546309+0000","last_undegraded":"2023-12-08T21:25:37.546309+0000","last_fullsized":"2023-12-08T21:25:37.546309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:57:55.750494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'16","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.474033+0000","last_change":"2023-12-08T20:54:56.386660+0000","last_active":"2023-12-08T21:25:37.474033+0000","last_peered":"2023-12-08T21:25:37.474033+0000","last_clean":"2023-12-08T21:25:37.474033+0000","last_became_active":"2023-12-08T20:54:56.386344+0000","last_became_peered":"2023-12-08T20:54:56.386344+0000","last_unstale":"2023-12-08T21:25:37.474033+0000","last_undegraded":"2023-12-08T21:25:37.474033+0000","last_fullsized":"2023-12-08T21:25:37.474033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:33:27.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.466511+0000","last_change":"2023-12-08T20:54:56.367640+0000","last_active":"2023-12-08T21:25:37.466511+0000","last_peered":"2023-12-08T21:25:37.466511+0000","last_clean":"2023-12-08T21:25:37.466511+0000","last_became_active":"2023-12-08T20:54:56.366967+0000","last_became_peered":"2023-12-08T20:54:56.366967+0000","last_unstale":"2023-12-08T21:25:37.466511+0000","last_undegraded":"2023-12-08T21:25:37.466511+0000","last_fullsized":"2023-12-08T21:25:37.466511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:22:24.171129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'32","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.686312+0000","last_change":"2023-12-08T20:54:56.376663+0000","last_active":"2023-12-08T21:25:37.686312+0000","last_peered":"2023-12-08T21:25:37.686312+0000","last_clean":"2023-12-08T21:25:37.686312+0000","last_became_active":"2023-12-08T20:54:56.371954+0000","last_became_peered":"2023-12-08T20:54:56.371954+0000","last_unstale":"2023-12-08T21:25:37.686312+0000","last_undegraded":"2023-12-08T21:25:37.686312+0000","last_fullsized":"2023-12-08T21:25:37.686312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:49.442890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546047+0000","last_change":"2023-12-08T20:54:56.410398+0000","last_active":"2023-12-08T21:25:37.546047+0000","last_peered":"2023-12-08T21:25:37.546047+0000","last_clean":"2023-12-08T21:25:37.546047+0000","last_became_active":"2023-12-08T20:54:56.409462+0000","last_became_peered":"2023-12-08T20:54:56.409462+0000","last_unstale":"2023-12-08T21:25:37.546047+0000","last_undegraded":"2023-12-08T21:25:37.546047+0000","last_fullsized":"2023-12-08T21:25:37.546047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:07:04.340773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'18","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526793+0000","last_change":"2023-12-08T20:54:56.415800+0000","last_active":"2023-12-08T21:25:37.526793+0000","last_peered":"2023-12-08T21:25:37.526793+0000","last_clean":"2023-12-08T21:25:37.526793+0000","last_became_active":"2023-12-08T20:54:56.415176+0000","last_became_peered":"2023-12-08T20:54:56.415176+0000","last_unstale":"2023-12-08T21:25:37.526793+0000","last_undegraded":"2023-12-08T21:25:37.526793+0000","last_fullsized":"2023-12-08T21:25:37.526793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:24:27.173941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548502+0000","last_change":"2023-12-08T20:54:56.401521+0000","last_active":"2023-12-08T21:25:37.548502+0000","last_peered":"2023-12-08T21:25:37.548502+0000","last_clean":"2023-12-08T21:25:37.548502+0000","last_became_active":"2023-12-08T20:54:56.400980+0000","last_became_peered":"2023-12-08T20:54:56.400980+0000","last_unstale":"2023-12-08T21:25:37.548502+0000","last_undegraded":"2023-12-08T21:25:37.548502+0000","last_fullsized":"2023-12-08T21:25:37.548502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:48:42.093754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.570548+0000","last_change":"2023-12-08T20:54:56.387218+0000","last_active":"2023-12-08T21:25:37.570548+0000","last_peered":"2023-12-08T21:25:37.570548+0000","last_clean":"2023-12-08T21:25:37.570548+0000","last_became_active":"2023-12-08T20:54:56.386413+0000","last_became_peered":"2023-12-08T20:54:56.386413+0000","last_unstale":"2023-12-08T21:25:37.570548+0000","last_undegraded":"2023-12-08T21:25:37.570548+0000","last_fullsized":"2023-12-08T21:25:37.570548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.704536+0000","last_change":"2023-12-08T20:54:56.371962+0000","last_active":"2023-12-08T21:25:37.704536+0000","last_peered":"2023-12-08T21:25:37.704536+0000","last_clean":"2023-12-08T21:25:37.704536+0000","last_became_active":"2023-12-08T20:54:56.371456+0000","last_became_peered":"2023-12-08T20:54:56.371456+0000","last_unstale":"2023-12-08T21:25:37.704536+0000","last_undegraded":"2023-12-08T21:25:37.704536+0000","last_fullsized":"2023-12-08T21:25:37.704536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:01.725223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572196+0000","last_change":"2023-12-08T20:54:56.381311+0000","last_active":"2023-12-08T21:25:37.572196+0000","last_peered":"2023-12-08T21:25:37.572196+0000","last_clean":"2023-12-08T21:25:37.572196+0000","last_became_active":"2023-12-08T20:54:56.380860+0000","last_became_peered":"2023-12-08T20:54:56.380860+0000","last_unstale":"2023-12-08T21:25:37.572196+0000","last_undegraded":"2023-12-08T21:25:37.572196+0000","last_fullsized":"2023-12-08T21:25:37.572196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:11:11.173329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.527856+0000","last_change":"2023-12-08T20:54:56.261370+0000","last_active":"2023-12-08T21:25:37.527856+0000","last_peered":"2023-12-08T21:25:37.527856+0000","last_clean":"2023-12-08T21:25:37.527856+0000","last_became_active":"2023-12-08T20:54:56.260387+0000","last_became_peered":"2023-12-08T20:54:56.260387+0000","last_unstale":"2023-12-08T21:25:37.527856+0000","last_undegraded":"2023-12-08T21:25:37.527856+0000","last_fullsized":"2023-12-08T21:25:37.527856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:17:07.046357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.468545+0000","last_change":"2023-12-08T20:54:56.388280+0000","last_active":"2023-12-08T21:25:37.468545+0000","last_peered":"2023-12-08T21:25:37.468545+0000","last_clean":"2023-12-08T21:25:37.468545+0000","last_became_active":"2023-12-08T20:54:56.387774+0000","last_became_peered":"2023-12-08T20:54:56.387774+0000","last_unstale":"2023-12-08T21:25:37.468545+0000","last_undegraded":"2023-12-08T21:25:37.468545+0000","last_fullsized":"2023-12-08T21:25:37.468545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:15:20.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.530020+0000","last_change":"2023-12-08T20:54:56.378804+0000","last_active":"2023-12-08T21:25:37.530020+0000","last_peered":"2023-12-08T21:25:37.530020+0000","last_clean":"2023-12-08T21:25:37.530020+0000","last_became_active":"2023-12-08T20:54:56.377029+0000","last_became_peered":"2023-12-08T20:54:56.377029+0000","last_unstale":"2023-12-08T21:25:37.530020+0000","last_undegraded":"2023-12-08T21:25:37.530020+0000","last_fullsized":"2023-12-08T21:25:37.530020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:55:29.247824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526742+0000","last_change":"2023-12-08T20:54:56.372118+0000","last_active":"2023-12-08T21:25:37.526742+0000","last_peered":"2023-12-08T21:25:37.526742+0000","last_clean":"2023-12-08T21:25:37.526742+0000","last_became_active":"2023-12-08T20:54:56.370707+0000","last_became_peered":"2023-12-08T20:54:56.370707+0000","last_unstale":"2023-12-08T21:25:37.526742+0000","last_undegraded":"2023-12-08T21:25:37.526742+0000","last_fullsized":"2023-12-08T21:25:37.526742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:35.994091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.552611+0000","last_change":"2023-12-08T20:54:56.405033+0000","last_active":"2023-12-08T21:25:37.552611+0000","last_peered":"2023-12-08T21:25:37.552611+0000","last_clean":"2023-12-08T21:25:37.552611+0000","last_became_active":"2023-12-08T20:54:56.401544+0000","last_became_peered":"2023-12-08T20:54:56.401544+0000","last_unstale":"2023-12-08T21:25:37.552611+0000","last_undegraded":"2023-12-08T21:25:37.552611+0000","last_fullsized":"2023-12-08T21:25:37.552611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:10:59.303019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.473127+0000","last_change":"2023-12-08T20:54:56.366037+0000","last_active":"2023-12-08T21:25:37.473127+0000","last_peered":"2023-12-08T21:25:37.473127+0000","last_clean":"2023-12-08T21:25:37.473127+0000","last_became_active":"2023-12-08T20:54:56.365432+0000","last_became_peered":"2023-12-08T20:54:56.365432+0000","last_unstale":"2023-12-08T21:25:37.473127+0000","last_undegraded":"2023-12-08T21:25:37.473127+0000","last_fullsized":"2023-12-08T21:25:37.473127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:48:49.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'32","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.474444+0000","last_change":"2023-12-08T20:54:56.393022+0000","last_active":"2023-12-08T21:25:37.474444+0000","last_peered":"2023-12-08T21:25:37.474444+0000","last_clean":"2023-12-08T21:25:37.474444+0000","last_became_active":"2023-12-08T20:54:56.392408+0000","last_became_peered":"2023-12-08T20:54:56.392408+0000","last_unstale":"2023-12-08T21:25:37.474444+0000","last_undegraded":"2023-12-08T21:25:37.474444+0000","last_fullsized":"2023-12-08T21:25:37.474444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:30:22.435898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572384+0000","last_change":"2023-12-08T20:54:56.380654+0000","last_active":"2023-12-08T21:25:37.572384+0000","last_peered":"2023-12-08T21:25:37.572384+0000","last_clean":"2023-12-08T21:25:37.572384+0000","last_became_active":"2023-12-08T20:54:56.380137+0000","last_became_peered":"2023-12-08T20:54:56.380137+0000","last_unstale":"2023-12-08T21:25:37.572384+0000","last_undegraded":"2023-12-08T21:25:37.572384+0000","last_fullsized":"2023-12-08T21:25:37.572384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:47:59.833913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'21","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.571319+0000","last_change":"2023-12-08T20:54:56.392997+0000","last_active":"2023-12-08T21:25:37.571319+0000","last_peered":"2023-12-08T21:25:37.571319+0000","last_clean":"2023-12-08T21:25:37.571319+0000","last_became_active":"2023-12-08T20:54:56.391299+0000","last_became_peered":"2023-12-08T20:54:56.391299+0000","last_unstale":"2023-12-08T21:25:37.571319+0000","last_undegraded":"2023-12-08T21:25:37.571319+0000","last_fullsized":"2023-12-08T21:25:37.571319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:37.195485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'32","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.563701+0000","last_change":"2023-12-08T20:54:56.393461+0000","last_active":"2023-12-08T21:25:37.563701+0000","last_peered":"2023-12-08T21:25:37.563701+0000","last_clean":"2023-12-08T21:25:37.563701+0000","last_became_active":"2023-12-08T20:54:56.392708+0000","last_became_peered":"2023-12-08T20:54:56.392708+0000","last_unstale":"2023-12-08T21:25:37.563701+0000","last_undegraded":"2023-12-08T21:25:37.563701+0000","last_fullsized":"2023-12-08T21:25:37.563701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:44.697264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'30","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.568850+0000","last_change":"2023-12-08T20:54:56.319183+0000","last_active":"2023-12-08T21:25:37.568850+0000","last_peered":"2023-12-08T21:25:37.568850+0000","last_clean":"2023-12-08T21:25:37.568850+0000","last_became_active":"2023-12-08T20:54:56.318400+0000","last_became_peered":"2023-12-08T20:54:56.318400+0000","last_unstale":"2023-12-08T21:25:37.568850+0000","last_undegraded":"2023-12-08T21:25:37.568850+0000","last_fullsized":"2023-12-08T21:25:37.568850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:18.147733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'20","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.552441+0000","last_change":"2023-12-08T20:54:56.414028+0000","last_active":"2023-12-08T21:25:37.552441+0000","last_peered":"2023-12-08T21:25:37.552441+0000","last_clean":"2023-12-08T21:25:37.552441+0000","last_became_active":"2023-12-08T20:54:56.413220+0000","last_became_peered":"2023-12-08T20:54:56.413220+0000","last_unstale":"2023-12-08T21:25:37.552441+0000","last_undegraded":"2023-12-08T21:25:37.552441+0000","last_fullsized":"2023-12-08T21:25:37.552441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:23.917049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.553915+0000","last_change":"2023-12-08T20:54:56.366203+0000","last_active":"2023-12-08T21:25:37.553915+0000","last_peered":"2023-12-08T21:25:37.553915+0000","last_clean":"2023-12-08T21:25:37.553915+0000","last_became_active":"2023-12-08T20:54:56.365448+0000","last_became_peered":"2023-12-08T20:54:56.365448+0000","last_unstale":"2023-12-08T21:25:37.553915+0000","last_undegraded":"2023-12-08T21:25:37.553915+0000","last_fullsized":"2023-12-08T21:25:37.553915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:09:10.405742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'25","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.673045+0000","last_change":"2023-12-08T20:54:56.373847+0000","last_active":"2023-12-08T21:25:37.673045+0000","last_peered":"2023-12-08T21:25:37.673045+0000","last_clean":"2023-12-08T21:25:37.673045+0000","last_became_active":"2023-12-08T20:54:56.369574+0000","last_became_peered":"2023-12-08T20:54:56.369574+0000","last_unstale":"2023-12-08T21:25:37.673045+0000","last_undegraded":"2023-12-08T21:25:37.673045+0000","last_fullsized":"2023-12-08T21:25:37.673045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:44:10.078450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'21","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.554262+0000","last_change":"2023-12-08T20:54:56.411972+0000","last_active":"2023-12-08T21:25:37.554262+0000","last_peered":"2023-12-08T21:25:37.554262+0000","last_clean":"2023-12-08T21:25:37.554262+0000","last_became_active":"2023-12-08T20:54:56.411339+0000","last_became_peered":"2023-12-08T20:54:56.411339+0000","last_unstale":"2023-12-08T21:25:37.554262+0000","last_undegraded":"2023-12-08T21:25:37.554262+0000","last_fullsized":"2023-12-08T21:25:37.554262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:41.074875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'17","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.668142+0000","last_change":"2023-12-08T20:54:56.370763+0000","last_active":"2023-12-08T21:25:37.668142+0000","last_peered":"2023-12-08T21:25:37.668142+0000","last_clean":"2023-12-08T21:25:37.668142+0000","last_became_active":"2023-12-08T20:54:56.369650+0000","last_became_peered":"2023-12-08T20:54:56.369650+0000","last_unstale":"2023-12-08T21:25:37.668142+0000","last_undegraded":"2023-12-08T21:25:37.668142+0000","last_fullsized":"2023-12-08T21:25:37.668142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:18:14.804127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548529+0000","last_change":"2023-12-08T20:54:56.409124+0000","last_active":"2023-12-08T21:25:37.548529+0000","last_peered":"2023-12-08T21:25:37.548529+0000","last_clean":"2023-12-08T21:25:37.548529+0000","last_became_active":"2023-12-08T20:54:56.408861+0000","last_became_peered":"2023-12-08T20:54:56.408861+0000","last_unstale":"2023-12-08T21:25:37.548529+0000","last_undegraded":"2023-12-08T21:25:37.548529+0000","last_fullsized":"2023-12-08T21:25:37.548529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:40:00.277639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'19","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.545814+0000","last_change":"2023-12-08T20:54:56.407010+0000","last_active":"2023-12-08T21:25:37.545814+0000","last_peered":"2023-12-08T21:25:37.545814+0000","last_clean":"2023-12-08T21:25:37.545814+0000","last_became_active":"2023-12-08T20:54:56.404697+0000","last_became_peered":"2023-12-08T20:54:56.404697+0000","last_unstale":"2023-12-08T21:25:37.545814+0000","last_undegraded":"2023-12-08T21:25:37.545814+0000","last_fullsized":"2023-12-08T21:25:37.545814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:58:49.474462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.554838+0000","last_change":"2023-12-08T20:54:56.378873+0000","last_active":"2023-12-08T21:25:37.554838+0000","last_peered":"2023-12-08T21:25:37.554838+0000","last_clean":"2023-12-08T21:25:37.554838+0000","last_became_active":"2023-12-08T20:54:56.377835+0000","last_became_peered":"2023-12-08T20:54:56.377835+0000","last_unstale":"2023-12-08T21:25:37.554838+0000","last_undegraded":"2023-12-08T21:25:37.554838+0000","last_fullsized":"2023-12-08T21:25:37.554838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:54:57.439693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2350,"num_write_kb":252630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2525,"ondisk_log_size":2525,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1552,"ondisk_log_size":1552,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23858448,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":5673,"num_write_kb":26542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32464896,"data_stored":47716896,"data_compressed":4732252,"data_compressed_allocated":7307264,"data_compressed_original":22618112,"omap_allocated":0,"internal_metadata":0},"log_size":5209,"ondisk_log_size":5209,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509821,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":4588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":4698112,"data_stored":7801495,"data_compressed":855543,"data_compressed_allocated":1261568,"data_compressed_original":4567040,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.91400000000000003,"15min":0.878},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.371},"max":{"1min":1.268,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.157},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.93200000000000005,"15min":0.94299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.499},"max":{"1min":1.2649999999999999,"5min":1.4710000000000001,"15min":1.6479999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96299999999999997,"15min":0.92700000000000005},"min":{"1min":0.56299999999999994,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3280000000000001,"5min":1.405,"15min":1.405},"last":1.2869999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.93300000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.48599999999999999},"max":{"1min":1.1519999999999999,"5min":1.3640000000000001,"15min":1.504},"last":0.93000000000000005}]},{"osd":2,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.94699999999999995,"15min":0.91800000000000004},"min":{"1min":0.67100000000000004,"5min":0.54600000000000004,"15min":0.51900000000000002},"max":{"1min":1.2290000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98199999999999998,"15min":0.98999999999999999},"min":{"1min":0.69399999999999995,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":1.3049999999999999,"5min":1.361,"15min":1.776},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0169999999999999,"15min":1.0089999999999999},"min":{"1min":0.75900000000000001,"5min":0.64100000000000001,"15min":0.46700000000000003},"max":{"1min":1.355,"5min":1.363,"15min":2.0840000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0720000000000001,"15min":1.0800000000000001},"min":{"1min":0.82099999999999995,"5min":0.61399999999999999,"15min":0.44800000000000001},"max":{"1min":1.276,"5min":1.468,"15min":2.181},"last":1.0660000000000001}]},{"osd":4,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.90400000000000003,"15min":0.91500000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.30199999999999999},"max":{"1min":1.173,"5min":1.444,"15min":1.972},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.995,"5min":1.0249999999999999,"15min":1.0289999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4099999999999999,"5min":1.4830000000000001,"15min":1.8149999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.008,"15min":1.0189999999999999},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.41799999999999998},"max":{"1min":1.327,"5min":1.5760000000000001,"15min":2.3069999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0469999999999999,"15min":1.0669999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52100000000000002},"max":{"1min":1.3140000000000001,"5min":1.4470000000000001,"15min":1.8959999999999999},"last":1.2529999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1080000000000001,"15min":1.107},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.56999999999999995},"max":{"1min":1.353,"5min":1.5760000000000001,"15min":1.71},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1519999999999999,"15min":1.167},"min":{"1min":0.69599999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3959999999999999,"5min":1.7110000000000001,"15min":1.8600000000000001},"last":1.401}]}]},{"osd":3,"up_from":15,"seq":64424509821,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62188,"kb_used_data":8804,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309652,"statfs":{"total":96636764160,"available":96573083648,"internally_reserved":0,"allocated":9015296,"data_stored":12714767,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.53600000000000003,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":1.3520000000000001,"5min":1.3700000000000001,"15min":1.655},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81299999999999994,"15min":0.78400000000000003},"min":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.34699999999999998},"max":{"1min":1.383,"5min":1.504,"15min":1.7809999999999999},"last":0.375}]},{"osd":1,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.83799999999999997,"15min":0.82099999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.30399999999999999},"max":{"1min":1.254,"5min":1.5189999999999999,"15min":1.5329999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.93300000000000005,"15min":0.93600000000000005},"min":{"1min":0.52600000000000002,"5min":0.46200000000000002,"15min":0.26900000000000002},"max":{"1min":1.3700000000000001,"5min":1.4490000000000001,"15min":2.036},"last":0.84599999999999997}]},{"osd":2,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.56599999999999995,"5min":0.48099999999999998,"15min":0.45500000000000002},"max":{"1min":1.5349999999999999,"5min":1.585,"15min":1.9470000000000001},"last":0.441},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.002,"15min":0.98799999999999999},"min":{"1min":0.63900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.377,"5min":1.534,"15min":1.786},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.091,"15min":1.0820000000000001},"min":{"1min":0.79800000000000004,"5min":0.65500000000000003,"15min":0.52000000000000002},"max":{"1min":1.6839999999999999,"5min":1.73,"15min":1.73},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.171,"15min":1.143},"min":{"1min":0.85399999999999998,"5min":0.66300000000000003,"15min":0.53700000000000003},"max":{"1min":1.554,"5min":1.875,"15min":2.3039999999999998},"last":0.89800000000000002}]},{"osd":5,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.80800000000000005,"5min":0.70999999999999996,"15min":0.65700000000000003},"max":{"1min":1.679,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.272,"15min":1.272},"min":{"1min":0.89500000000000002,"5min":0.747,"15min":0.55000000000000004},"max":{"1min":1.798,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.0669999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3089999999999999,"15min":1.296},"min":{"1min":0.747,"5min":0.747,"15min":0.629},"max":{"1min":1.9179999999999999,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.234,"15min":1.2150000000000001},"min":{"1min":0.98299999999999998,"5min":0.83599999999999997,"15min":0.621},"max":{"1min":1.478,"5min":1.8460000000000001,"15min":1.9059999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.282,"15min":1.2609999999999999},"min":{"1min":0.94699999999999995,"5min":0.72099999999999997,"15min":0.58899999999999997},"max":{"1min":1.6000000000000001,"5min":1.849,"15min":1.849},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.379,"5min":1.327,"15min":1.306},"min":{"1min":1.05,"5min":0.81799999999999995,"15min":0.58499999999999996},"max":{"1min":1.9239999999999999,"5min":1.966,"15min":2.1640000000000001},"last":0.64100000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509820,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37588,"kb_used_data":6412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334252,"statfs":{"total":96636764160,"available":96598274048,"internally_reserved":0,"allocated":6565888,"data_stored":8520553,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.747,"15min":0.748},"min":{"1min":0.50800000000000001,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.93200000000000005,"5min":1.296,"15min":1.4670000000000001},"last":1.097},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.81599999999999995,"15min":0.80500000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.316},"max":{"1min":1.262,"5min":1.429,"15min":1.482},"last":0.66300000000000003}]},{"osd":1,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.59299999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4430000000000001,"5min":1.466,"15min":1.6599999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.92600000000000005,"15min":0.90800000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":1.2809999999999999,"5min":1.3919999999999999,"15min":4.5620000000000003},"last":1.0129999999999999}]},{"osd":3,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.88400000000000001,"15min":0.85699999999999998},"min":{"1min":0.63500000000000001,"5min":0.52400000000000002,"15min":0.39300000000000002},"max":{"1min":1.5049999999999999,"5min":1.704,"15min":1.704},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.048,"15min":1.014},"min":{"1min":0.75,"5min":0.63600000000000001,"15min":0.44500000000000001},"max":{"1min":1.643,"5min":1.643,"15min":1.661},"last":0.96599999999999997}]},{"osd":4,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.1259999999999999,"15min":1.105},"min":{"1min":0.67800000000000005,"5min":0.65600000000000003,"15min":0.51200000000000001},"max":{"1min":1.3799999999999999,"5min":1.647,"15min":1.726},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.085,"15min":1.046},"min":{"1min":0.80300000000000005,"5min":0.67400000000000004,"15min":0.53700000000000003},"max":{"1min":1.359,"5min":1.609,"15min":1.6240000000000001},"last":1.0629999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.218,"15min":1.196},"min":{"1min":0.83199999999999996,"5min":0.74099999999999999,"15min":0.624},"max":{"1min":1.458,"5min":1.7649999999999999,"15min":1.8009999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.204,"15min":1.194},"min":{"1min":0.96599999999999997,"5min":0.85499999999999998,"15min":0.61099999999999999},"max":{"1min":1.466,"5min":1.7470000000000001,"15min":1.855},"last":1.1419999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1519999999999999,"15min":1.139},"min":{"1min":0.84699999999999998,"5min":0.80600000000000005,"15min":0.66300000000000003},"max":{"1min":1.478,"5min":1.5209999999999999,"15min":1.7270000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.246,"5min":1.282,"15min":1.2689999999999999},"min":{"1min":0.93999999999999995,"5min":0.77800000000000002,"15min":0.54700000000000004},"max":{"1min":1.5469999999999999,"5min":1.919,"15min":2.0150000000000001},"last":1.3320000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3,"15min":1.2729999999999999},"min":{"1min":1.0109999999999999,"5min":0.76200000000000001,"15min":0.56999999999999995},"max":{"1min":1.5489999999999999,"5min":1.8400000000000001,"15min":1.9810000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.2430000000000001,"15min":1.22},"min":{"1min":0.97499999999999998,"5min":0.82099999999999995,"15min":0.68500000000000005},"max":{"1min":1.6040000000000001,"5min":1.7869999999999999,"15min":1.8240000000000001},"last":0.89300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509822,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":721711,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.50900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.7689999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.85799999999999998,"15min":0.80700000000000005},"min":{"1min":0.61299999999999999,"5min":0.34200000000000003,"15min":0.33700000000000002},"max":{"1min":1.3340000000000001,"5min":1.556,"15min":1.556},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.75},"min":{"1min":0.54000000000000004,"5min":0.41699999999999998,"15min":0.41599999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.4510000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96699999999999997,"15min":0.91800000000000004},"min":{"1min":0.60599999999999998,"5min":0.50800000000000001,"15min":0.33500000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":2.0019999999999998},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.002,"15min":0.95999999999999996},"min":{"1min":0.51100000000000001,"5min":0.46100000000000002,"15min":0.32400000000000001},"max":{"1min":1.3819999999999999,"5min":1.639,"15min":1.948},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97599999999999998,"15min":0.94099999999999995},"min":{"1min":0.69999999999999996,"5min":0.48699999999999999,"15min":0.35199999999999998},"max":{"1min":1.4099999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.63}]},{"osd":4,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1339999999999999,"15min":1.0760000000000001},"min":{"1min":0.80500000000000005,"5min":0.67700000000000005,"15min":0.57299999999999995},"max":{"1min":1.577,"5min":1.879,"15min":1.879},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.194,"15min":1.163},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.626},"max":{"1min":1.5,"5min":1.7470000000000001,"15min":2.0259999999999998},"last":1.175}]},{"osd":5,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2190000000000001,"15min":1.163},"min":{"1min":0.76100000000000001,"5min":0.71899999999999997,"15min":0.60199999999999998},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.9179999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2270000000000001,"15min":1.1679999999999999},"min":{"1min":0.92800000000000005,"5min":0.65300000000000002,"15min":0.64600000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.91400000000000003}]},{"osd":6,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.284,"15min":1.242},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.569,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.28,"15min":1.238},"min":{"1min":1.008,"5min":0.85299999999999998,"15min":0.66200000000000003},"max":{"1min":1.631,"5min":1.7529999999999999,"15min":2.0259999999999998},"last":1.0189999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3360000000000001,"15min":1.28},"min":{"1min":1.0640000000000001,"5min":0.82799999999999996,"15min":0.66600000000000004},"max":{"1min":1.526,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.139},{"interface":"front","average":{"1min":1.264,"5min":1.298,"15min":1.2450000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.67300000000000004},"max":{"1min":1.786,"5min":1.873,"15min":2.1880000000000002},"last":1.105}]}]},{"osd":0,"up_from":15,"seq":64424509821,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42508,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329332,"statfs":{"total":96636764160,"available":96593235968,"internally_reserved":0,"allocated":3084288,"data_stored":4325633,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.52500000000000002,"5min":0.35699999999999998,"15min":0.35099999999999998},"max":{"1min":1.2430000000000001,"5min":1.3819999999999999,"15min":1.698},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82299999999999995,"15min":0.81299999999999994},"min":{"1min":0.629,"5min":0.46200000000000002,"15min":0.40600000000000003},"max":{"1min":1.4650000000000001,"5min":1.788,"15min":1.907},"last":0.91000000000000003}]},{"osd":2,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84399999999999997,"15min":0.84699999999999998},"min":{"1min":0.60599999999999998,"5min":0.41999999999999998,"15min":0.34100000000000003},"max":{"1min":1.286,"5min":1.633,"15min":1.633},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":0.92300000000000004,"15min":0.88500000000000001},"min":{"1min":0.68899999999999995,"5min":0.432,"15min":0.38400000000000001},"max":{"1min":1.47,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.82999999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":1.292,"5min":1.2969999999999999,"15min":1.657},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0389999999999999,"15min":1.02},"min":{"1min":0.83499999999999996,"5min":0.40999999999999998,"15min":0.38400000000000001},"max":{"1min":1.631,"5min":1.694,"15min":2.2850000000000001},"last":1.1799999999999999}]},{"osd":4,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.117,"15min":1.105},"min":{"1min":0.84499999999999997,"5min":0.64000000000000001,"15min":0.61299999999999999},"max":{"1min":1.3620000000000001,"5min":1.8480000000000001,"15min":2.1000000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.2330000000000001,"15min":1.1160000000000001},"min":{"1min":0.82799999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.617,"5min":14.787000000000001,"15min":14.787000000000001},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2330000000000001,"15min":1.1890000000000001},"min":{"1min":0.79700000000000004,"5min":0.68000000000000005,"15min":0.61699999999999999},"max":{"1min":1.534,"5min":2.218,"15min":2.218},"last":1.071},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2350000000000001,"15min":1.1970000000000001},"min":{"1min":1.071,"5min":0.85499999999999998,"15min":0.66900000000000004},"max":{"1min":1.6870000000000001,"5min":2.0739999999999998,"15min":2.2309999999999999},"last":1.3660000000000001}]},{"osd":6,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.167,"15min":1.145},"min":{"1min":0.82499999999999996,"5min":0.66600000000000004,"15min":0.65400000000000003},"max":{"1min":1.7390000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.323,"15min":1.284},"min":{"1min":1.046,"5min":0.747,"15min":0.68500000000000005},"max":{"1min":1.782,"5min":1.9379999999999999,"15min":2.1480000000000001},"last":1.3100000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.302,"15min":1.2669999999999999},"min":{"1min":1.0249999999999999,"5min":0.83499999999999996,"15min":0.60199999999999998},"max":{"1min":1.784,"5min":2.0059999999999998,"15min":2.3300000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.226,"15min":1.216},"min":{"1min":1.0109999999999999,"5min":0.67000000000000004,"15min":0.58099999999999996},"max":{"1min":1.873,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.2709999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542525,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29016,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342824,"statfs":{"total":96636764160,"available":96607051776,"internally_reserved":0,"allocated":2048000,"data_stored":3016855,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.92600000000000005,"15min":0.91200000000000003},"min":{"1min":0.63400000000000001,"5min":0.55200000000000005,"15min":0.38100000000000001},"max":{"1min":1.2669999999999999,"5min":1.8069999999999999,"15min":1.8939999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.208,"5min":1.948,"15min":1.948},"last":1.0189999999999999}]},{"osd":1,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.96899999999999997,"15min":0.93700000000000006},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.244,"5min":3.246,"15min":3.246},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95299999999999996,"15min":0.94599999999999995},"min":{"1min":0.72299999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.282,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.0960000000000001}]},{"osd":2,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97999999999999998,"15min":0.97499999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.712,"15min":1.9399999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.97499999999999998,"15min":0.97899999999999998},"min":{"1min":0.79000000000000004,"5min":0.50700000000000001,"15min":0.47799999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.8280000000000001},"last":1.296}]},{"osd":3,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0509999999999999,"15min":1.036},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.55300000000000005},"max":{"1min":1.3400000000000001,"5min":1.528,"15min":1.528},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.002,"5min":1.024,"15min":1.0109999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.359,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.95099999999999996}]},{"osd":4,"last update":"Fri Dec 8 21:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93999999999999995,"15min":0.96499999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.55300000000000005},"max":{"1min":1.272,"5min":1.3859999999999999,"15min":1.45},"last":1.242},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.92600000000000005,"15min":0.98899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2709999999999999,"5min":1.371,"15min":1.5680000000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92800000000000005,"15min":0.98099999999999998},"min":{"1min":0.63800000000000001,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.2270000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.085,"5min":1.0920000000000001,"15min":1.127},"min":{"1min":0.67800000000000005,"5min":0.66200000000000003,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.6419999999999999,"15min":1.857},"last":1.052}]},{"osd":6,"last update":"Fri Dec 8 21:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0289999999999999,"15min":1.079},"min":{"1min":0.77400000000000002,"5min":0.68799999999999994,"15min":0.57399999999999995},"max":{"1min":1.2789999999999999,"5min":1.8380000000000001,"15min":1.948},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.202,"5min":1.194,"15min":1.212},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6399999999999999,"5min":1.6639999999999999,"15min":2.0019999999999998},"last":1.143}]}]},{"osd":6,"up_from":14,"seq":60129542526,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42332,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329508,"statfs":{"total":96636764160,"available":96593416192,"internally_reserved":0,"allocated":2904064,"data_stored":4325577,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.92700000000000005,"15min":0.90100000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48799999999999999},"max":{"1min":1.3919999999999999,"5min":1.395,"15min":1.4430000000000001},"last":1.069},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.94199999999999995,"15min":0.90300000000000002},"min":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.44900000000000001},"max":{"1min":1.3420000000000001,"5min":1.3979999999999999,"15min":1.4790000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.96899999999999997,"15min":0.93300000000000005},"min":{"1min":0.65400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2849999999999999,"5min":1.49,"15min":1.49},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.64300000000000002,"5min":0.53600000000000003,"15min":0.48699999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.512},"last":0.97899999999999998}]},{"osd":2,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98099999999999998,"15min":0.93799999999999994},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.45900000000000002},"max":{"1min":1.357,"5min":1.421,"15min":1.421},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0169999999999999,"15min":0.99199999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.51300000000000001},"max":{"1min":1.4410000000000001,"5min":1.546,"15min":1.546},"last":1.107}]},{"osd":3,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0229999999999999,"15min":1.0209999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.56000000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.708},"last":1.135},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.72499999999999998,"5min":0.627,"15min":0.54700000000000004},"max":{"1min":1.389,"5min":1.542,"15min":1.7},"last":1.24}]},{"osd":4,"last update":"Fri Dec 8 21:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.96099999999999997,"15min":0.97499999999999998},"min":{"1min":0.68400000000000005,"5min":0.60499999999999998,"15min":0.50900000000000001},"max":{"1min":1.319,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.022,"15min":1.0029999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.57899999999999996},"max":{"1min":1.55,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.67500000000000004,"5min":0.56499999999999995,"15min":0.53100000000000003},"max":{"1min":1.2110000000000001,"5min":1.79,"15min":1.79},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1140000000000001,"15min":1.111},"min":{"1min":0.80200000000000005,"5min":0.69399999999999995,"15min":0.432},"max":{"1min":1.6120000000000001,"5min":1.694,"15min":1.694},"last":1.3220000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:24:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0609999999999999,"15min":1.0640000000000001},"min":{"1min":0.72899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.696,"5min":1.732,"15min":1.732},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.196,"15min":1.1990000000000001},"min":{"1min":0.78600000000000003,"5min":0.71499999999999997,"15min":0.47299999999999998},"max":{"1min":1.532,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.3979999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542524,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55520,"kb_used_data":6296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316320,"statfs":{"total":96636764160,"available":96579911680,"internally_reserved":0,"allocated":6447104,"data_stored":8521225,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.90200000000000002},"min":{"1min":0.63900000000000001,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.6000000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92200000000000004,"15min":0.90800000000000003},"min":{"1min":0.54200000000000004,"5min":0.51000000000000001,"15min":0.41399999999999998},"max":{"1min":1.1359999999999999,"5min":1.3440000000000001,"15min":1.391},"last":1.0489999999999999}]},{"osd":1,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93799999999999994,"15min":0.91100000000000003},"min":{"1min":0.64100000000000001,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":1.2629999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0289999999999999,"15min":0.998},"min":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.46100000000000002},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4570000000000001},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0029999999999999,"15min":1.0089999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3400000000000001,"5min":1.4710000000000001,"15min":1.681},"last":1.365},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.95399999999999996,"15min":0.94899999999999995},"min":{"1min":0.67700000000000005,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.1479999999999999,"5min":1.52,"15min":1.52},"last":0.97199999999999998}]},{"osd":3,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.996,"15min":0.98699999999999999},"min":{"1min":0.65500000000000003,"5min":0.63100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2150000000000001,"5min":1.927,"15min":1.927},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.143,"15min":1.1140000000000001},"min":{"1min":0.84199999999999997,"5min":0.64100000000000001,"15min":0.433},"max":{"1min":1.3680000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.2789999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.876,"15min":0.91700000000000004},"min":{"1min":0.63700000000000001,"5min":0.56599999999999995,"15min":0.46300000000000002},"max":{"1min":1.034,"5min":1.28,"15min":1.504},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0069999999999999,"15min":0.998},"min":{"1min":0.74299999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.409}]},{"osd":6,"last update":"Fri Dec 8 21:25:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.03,"15min":1.0549999999999999},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.54500000000000004},"max":{"1min":1.415,"5min":1.478,"15min":1.617},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0660000000000001,"15min":1.0569999999999999},"min":{"1min":0.80600000000000005,"5min":0.69899999999999995,"15min":0.52900000000000003},"max":{"1min":1.294,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.23}]},{"osd":7,"last update":"Fri Dec 8 21:25:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.159,"15min":1.157},"min":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.39400000000000002},"max":{"1min":1.524,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.45},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0800000000000001,"15min":1.0960000000000001},"min":{"1min":0.72699999999999998,"5min":0.58299999999999996,"15min":0.45400000000000001},"max":{"1min":1.238,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.91200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":4194360,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6246400,"data_stored":8389280,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8695808,"data_stored":12583494,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":8389952,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4313088,"data_stored":7079854,"data_compressed":822166,"data_compressed_allocated":1216512,"data_compressed_original":3993600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":4194304,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1728512,"data_stored":2885582,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T21:25:45.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T21:25:46.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.147+0000 7f71d7671640 1 Processor -- start 2023-12-08T21:25:46.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.147+0000 7f71d7671640 1 -- start start 2023-12-08T21:25:46.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.147+0000 7f71d7671640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71d00c2030 0x7f71d00c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:46.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.147+0000 7f71d7671640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71d00c81c0 0x7f71d015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.147+0000 7f71d7671640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d00c2f70 con 0x7f71d01516b0 2023-12-08T21:25:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.147+0000 7f71d7671640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d015b980 con 0x7f71d00c81c0 2023-12-08T21:25:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.147+0000 7f71d7671640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d015b6a0 con 0x7f71d00c2030 2023-12-08T21:25:46.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.147+0000 7f71d5c0e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71d00c81c0 0x7f71d015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:46.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.147+0000 7f71d5c0e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71d00c81c0 0x7f71d015a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60190/0 (socket says 172.21.15.53:60190) 2023-12-08T21:25:46.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.147+0000 7f71d5c0e640 1 -- 172.21.15.53:0/3492904101 learned_addr learned my addr 172.21.15.53:0/3492904101 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:46.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.147+0000 7f71d4c0c640 1 --2- 172.21.15.53:0/3492904101 >> v2:172.21.15.146:3300/0 conn(0x7f71d00c2030 0x7f71d00c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:46.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.151+0000 7f71d5c0e640 1 -- 172.21.15.53:0/3492904101 >> v2:172.21.15.146:3300/0 conn(0x7f71d00c2030 msgr2=0x7f71d00c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:46.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.151+0000 7f71d5c0e640 1 --2- 172.21.15.53:0/3492904101 >> v2:172.21.15.146:3300/0 conn(0x7f71d00c2030 0x7f71d00c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:46.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.151+0000 7f71d5c0e640 1 -- 172.21.15.53:0/3492904101 >> v1:172.21.15.146:6789/0 conn(0x7f71d01516b0 legacy=0x7f71d00c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:46.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.151+0000 7f71d5c0e640 1 -- 172.21.15.53:0/3492904101 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d00c2640 con 0x7f71d00c81c0 2023-12-08T21:25:46.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.155+0000 7f71d5c0e640 1 --2- 172.21.15.53:0/3492904101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71d00c81c0 0x7f71d015a9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f71d00b0560 tx=0x7f71c801f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f63b5ac78cc27fd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.159+0000 7f71c7fff640 1 -- 172.21.15.53:0/3492904101 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c80af400 con 0x7f71d00c81c0 2023-12-08T21:25:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.159+0000 7f71c7fff640 1 -- 172.21.15.53:0/3492904101 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c80ab050 con 0x7f71d00c81c0 2023-12-08T21:25:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.159+0000 7f71c7fff640 1 -- 172.21.15.53:0/3492904101 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c80af780 con 0x7f71d00c81c0 2023-12-08T21:25:46.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 -- 172.21.15.53:0/3492904101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71d00c81c0 msgr2=0x7f71d015a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:46.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 --2- 172.21.15.53:0/3492904101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71d00c81c0 0x7f71d015a9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f71d00b0560 tx=0x7f71c801f180 comp rx=0 tx=0).stop 2023-12-08T21:25:46.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 -- 172.21.15.53:0/3492904101 shutdown_connections 2023-12-08T21:25:46.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 --2- 172.21.15.53:0/3492904101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71d00c81c0 0x7f71d015a9f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:46.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 --2- 172.21.15.53:0/3492904101 >> v2:172.21.15.146:3300/0 conn(0x7f71d00c2030 0x7f71d00c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:46.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 -- 172.21.15.53:0/3492904101 >> 172.21.15.53:0/3492904101 conn(0x7f71d0070b20 msgr2=0x7f71d0070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:46.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 -- 172.21.15.53:0/3492904101 shutdown_connections 2023-12-08T21:25:46.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 -- 172.21.15.53:0/3492904101 wait complete. 2023-12-08T21:25:46.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 Processor -- start 2023-12-08T21:25:46.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 -- start start 2023-12-08T21:25:46.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d00c2030 0x7f71d01ef460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:46.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00c81c0 0x7f71d00b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:46.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71d01516b0 0x7f71d014e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:46.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d006c330 con 0x7f71d01516b0 2023-12-08T21:25:46.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00b2ac0 con 0x7f71d00c81c0 2023-12-08T21:25:46.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d7671640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00b1fb0 con 0x7f71d00c2030 2023-12-08T21:25:46.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.163+0000 7f71d5c0e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71d01516b0 0x7f71d014e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:46.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.167+0000 7f71d5c0e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71d01516b0 0x7f71d014e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60204/0 (socket says 172.21.15.53:60204) 2023-12-08T21:25:46.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.167+0000 7f71d5c0e640 1 -- 172.21.15.53:0/1956638283 learned_addr learned my addr 172.21.15.53:0/1956638283 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:46.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.167+0000 7f71d540d640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d00c2030 0x7f71d01ef460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:46.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.167+0000 7f71d4c0c640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00c81c0 0x7f71d00b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:46.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.171+0000 7f71d5c0e640 1 -- 172.21.15.53:0/1956638283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d00c2030 msgr2=0x7f71d01ef460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:46.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.171+0000 7f71d5c0e640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d00c2030 0x7f71d01ef460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:46.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.171+0000 7f71d5c0e640 1 -- 172.21.15.53:0/1956638283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00c81c0 msgr2=0x7f71d00b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:46.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.171+0000 7f71d5c0e640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00c81c0 0x7f71d00b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:46.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.171+0000 7f71d5c0e640 1 -- 172.21.15.53:0/1956638283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8009b30 con 0x7f71d01516b0 2023-12-08T21:25:46.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.171+0000 7f71d5c0e640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71d01516b0 0x7f71d014e470 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f71c801cdb0 tx=0x7f71c801bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:46.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.175+0000 7f71c5ffb640 1 -- 172.21.15.53:0/1956638283 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8009510 con 0x7f71d01516b0 2023-12-08T21:25:46.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.175+0000 7f71d7671640 1 -- 172.21.15.53:0/1956638283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d006bf90 con 0x7f71d01516b0 2023-12-08T21:25:46.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.175+0000 7f71d7671640 1 -- 172.21.15.53:0/1956638283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d00b2500 con 0x7f71d01516b0 2023-12-08T21:25:46.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.175+0000 7f71d7671640 1 -- 172.21.15.53:0/1956638283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d006bdf0 con 0x7f71d01516b0 2023-12-08T21:25:46.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.175+0000 7f71c5ffb640 1 -- 172.21.15.53:0/1956638283 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c80afad0 con 0x7f71d01516b0 2023-12-08T21:25:46.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.175+0000 7f71c5ffb640 1 -- 172.21.15.53:0/1956638283 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c80afe40 con 0x7f71d01516b0 2023-12-08T21:25:46.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.475+0000 7f71c5ffb640 1 -- 172.21.15.53:0/1956638283 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71c80b6040 con 0x7f71d01516b0 2023-12-08T21:25:46.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.475+0000 7f71c5ffb640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71b4066470 0x7f71b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:46.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.479+0000 7f71d540d640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71b4066470 0x7f71b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:46.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.479+0000 7f71d540d640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71b4066470 0x7f71b4068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0098e0 tx=0x7f71cc009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:46.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.515+0000 7f71c5ffb640 1 -- 172.21.15.53:0/1956638283 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f71c80f2cd0 con 0x7f71d01516b0 2023-12-08T21:25:46.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.515+0000 7f71c5ffb640 1 -- 172.21.15.53:0/1956638283 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71c80f2aa0 con 0x7f71d01516b0 2023-12-08T21:25:46.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.691+0000 7f71d7671640 1 -- 172.21.15.53:0/1956638283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71d006c470 con 0x7f71d01516b0 2023-12-08T21:25:46.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.751+0000 7f71c5ffb640 1 -- 172.21.15.53:0/1956638283 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18446 (secure 0 0 0) 0x7f71d006c470 con 0x7f71d01516b0 2023-12-08T21:25:46.753 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:25:46.753 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:59.702174+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T21:25:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.755+0000 7f71d7671640 1 -- 172.21.15.53:0/1956638283 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71b4066470 msgr2=0x7f71b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.755+0000 7f71d7671640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71b4066470 0x7f71b4068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0098e0 tx=0x7f71cc009060 comp rx=0 tx=0).stop 2023-12-08T21:25:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.755+0000 7f71d7671640 1 -- 172.21.15.53:0/1956638283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71d01516b0 msgr2=0x7f71d014e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.755+0000 7f71d7671640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71d01516b0 0x7f71d014e470 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f71c801cdb0 tx=0x7f71c801bf20 comp rx=0 tx=0).stop 2023-12-08T21:25:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.755+0000 7f71d7671640 1 -- 172.21.15.53:0/1956638283 shutdown_connections 2023-12-08T21:25:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.755+0000 7f71d7671640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f71b4066470 0x7f71b4068930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.755+0000 7f71d7671640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71d01516b0 0x7f71d014e470 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.755+0000 7f71d7671640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00c81c0 0x7f71d00b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.755+0000 7f71d7671640 1 --2- 172.21.15.53:0/1956638283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d00c2030 0x7f71d01ef460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.755+0000 7f71d7671640 1 -- 172.21.15.53:0/1956638283 >> 172.21.15.53:0/1956638283 conn(0x7f71d0070b20 msgr2=0x7f71d00c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.755+0000 7f71d7671640 1 -- 172.21.15.53:0/1956638283 shutdown_connections 2023-12-08T21:25:46.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:46.755+0000 7f71d7671640 1 -- 172.21.15.53:0/1956638283 wait complete. 2023-12-08T21:25:47.776 INFO:tasks.ceph:Scrubbing osd.0 2023-12-08T21:25:47.776 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-08T21:25:47.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.923+0000 7f3aec3a0640 1 Processor -- start 2023-12-08T21:25:47.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.923+0000 7f3aec3a0640 1 -- start start 2023-12-08T21:25:47.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.923+0000 7f3aec3a0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ae41597c0 0x7f3ae406f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:47.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.923+0000 7f3aec3a0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ae40c86d0 0x7f3ae406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:47.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.923+0000 7f3aec3a0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae4159ba0 0x7f3ae4153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:47.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.923+0000 7f3aec3a0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae406eee0 con 0x7f3ae41597c0 2023-12-08T21:25:47.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.923+0000 7f3aec3a0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae40c3f50 con 0x7f3ae40c86d0 2023-12-08T21:25:47.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.923+0000 7f3aec3a0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae406e8b0 con 0x7f3ae4159ba0 2023-12-08T21:25:47.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.923+0000 7f3aea13c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ae41597c0 0x7f3ae406f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:47.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.923+0000 7f3aea13c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ae41597c0 0x7f3ae406f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60216/0 (socket says 172.21.15.53:60216) 2023-12-08T21:25:47.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.923+0000 7f3aea13c640 1 -- 172.21.15.53:0/3164293615 learned_addr learned my addr 172.21.15.53:0/3164293615 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:47.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.923+0000 7f3aea93d640 1 --2- 172.21.15.53:0/3164293615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae4159ba0 0x7f3ae4153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:47.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.927+0000 7f3aea13c640 1 -- 172.21.15.53:0/3164293615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae4159ba0 msgr2=0x7f3ae4153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:47.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.927+0000 7f3aea13c640 1 --2- 172.21.15.53:0/3164293615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae4159ba0 0x7f3ae4153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:47.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.927+0000 7f3aea13c640 1 -- 172.21.15.53:0/3164293615 >> v2:172.21.15.146:3300/0 conn(0x7f3ae40c86d0 msgr2=0x7f3ae406c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:47.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.927+0000 7f3aea13c640 1 --2- 172.21.15.53:0/3164293615 >> v2:172.21.15.146:3300/0 conn(0x7f3ae40c86d0 0x7f3ae406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:47.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.927+0000 7f3aea13c640 1 -- 172.21.15.53:0/3164293615 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae406f8b0 con 0x7f3ae41597c0 2023-12-08T21:25:47.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:47.939+0000 7f3aea13c640 1 --2- 172.21.15.53:0/3164293615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae41597c0 0x7f3ae406f370 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40719d0 tx=0x7f3ae001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d74d0fecab953c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:48.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.023+0000 7f3ae913a640 1 -- 172.21.15.53:0/3164293615 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae00ac640 con 0x7f3ae41597c0 2023-12-08T21:25:48.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.027+0000 7f3ae913a640 1 -- 172.21.15.53:0/3164293615 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae00ac7a0 con 0x7f3ae41597c0 2023-12-08T21:25:48.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.027+0000 7f3ae913a640 1 -- 172.21.15.53:0/3164293615 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae00acb30 con 0x7f3ae41597c0 2023-12-08T21:25:48.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.031+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3164293615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae41597c0 msgr2=0x7f3ae406f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.031+0000 7f3aec3a0640 1 --2- 172.21.15.53:0/3164293615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae41597c0 0x7f3ae406f370 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40719d0 tx=0x7f3ae001c440 comp rx=0 tx=0).stop 2023-12-08T21:25:48.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.031+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3164293615 shutdown_connections 2023-12-08T21:25:48.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.031+0000 7f3aec3a0640 1 --2- 172.21.15.53:0/3164293615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae4159ba0 0x7f3ae4153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.031+0000 7f3aec3a0640 1 --2- 172.21.15.53:0/3164293615 >> v2:172.21.15.146:3300/0 conn(0x7f3ae40c86d0 0x7f3ae406c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.031+0000 7f3aec3a0640 1 --2- 172.21.15.53:0/3164293615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae41597c0 0x7f3ae406f370 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.031+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3164293615 >> 172.21.15.53:0/3164293615 conn(0x7f3ae4070c60 msgr2=0x7f3ae4071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:48.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.031+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3164293615 shutdown_connections 2023-12-08T21:25:48.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.031+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3164293615 wait complete. 2023-12-08T21:25:48.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.035+0000 7f3aec3a0640 1 Processor -- start 2023-12-08T21:25:48.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.035+0000 7f3aec3a0640 1 -- start start 2023-12-08T21:25:48.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.035+0000 7f3aec3a0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae40c86d0 0x7f3ae41f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.035+0000 7f3aec3a0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae41597c0 0x7f3ae41507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.035+0000 7f3aec3a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae4159ba0 0x7f3ae41513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.035+0000 7f3aec3a0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae40cba80 con 0x7f3ae4159ba0 2023-12-08T21:25:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.035+0000 7f3aec3a0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae40c61b0 con 0x7f3ae41597c0 2023-12-08T21:25:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.035+0000 7f3aec3a0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae40c69a0 con 0x7f3ae40c86d0 2023-12-08T21:25:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.039+0000 7f3aea93d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae4159ba0 0x7f3ae41513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.039+0000 7f3aea93d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae4159ba0 0x7f3ae41513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60230/0 (socket says 172.21.15.53:60230) 2023-12-08T21:25:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.039+0000 7f3aea93d640 1 -- 172.21.15.53:0/3506857181 learned_addr learned my addr 172.21.15.53:0/3506857181 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:48.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.043+0000 7f3aea93d640 1 -- 172.21.15.53:0/3506857181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae40c86d0 msgr2=0x7f3ae41f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.043+0000 7f3aea93d640 1 --2- 172.21.15.53:0/3506857181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae40c86d0 0x7f3ae41f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.043+0000 7f3aea93d640 1 -- 172.21.15.53:0/3506857181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae41597c0 msgr2=0x7f3ae41507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.043+0000 7f3aea93d640 1 --2- 172.21.15.53:0/3506857181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae41597c0 0x7f3ae41507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.043+0000 7f3aea93d640 1 -- 172.21.15.53:0/3506857181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00094d0 con 0x7f3ae4159ba0 2023-12-08T21:25:48.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.047+0000 7f3aea93d640 1 --2- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae4159ba0 0x7f3ae41513e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3adc007e90 tx=0x7f3adc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:48.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.055+0000 7f3adaffd640 1 -- 172.21.15.53:0/3506857181 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc014420 con 0x7f3ae4159ba0 2023-12-08T21:25:48.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.055+0000 7f3adaffd640 1 -- 172.21.15.53:0/3506857181 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3adc014580 con 0x7f3ae4159ba0 2023-12-08T21:25:48.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.055+0000 7f3adaffd640 1 -- 172.21.15.53:0/3506857181 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc014930 con 0x7f3ae4159ba0 2023-12-08T21:25:48.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.055+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3506857181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae41f5f50 con 0x7f3ae4159ba0 2023-12-08T21:25:48.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.055+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3506857181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae40c66c0 con 0x7f3ae4159ba0 2023-12-08T21:25:48.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.055+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3506857181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ae406fe70 con 0x7f3ae4159ba0 2023-12-08T21:25:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.095+0000 7f3adaffd640 1 -- 172.21.15.53:0/3506857181 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3adc014a90 con 0x7f3ae4159ba0 2023-12-08T21:25:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.095+0000 7f3adaffd640 1 --2- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ac80664c0 0x7f3ac8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.099+0000 7f3aea13c640 1 --2- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ac80664c0 0x7f3ac8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.099+0000 7f3aea13c640 1 --2- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ac80664c0 0x7f3ac8068980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00ae000 tx=0x7f3ae0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.103+0000 7f3adaffd640 1 -- 172.21.15.53:0/3506857181 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f3adc056a30 con 0x7f3ae4159ba0 2023-12-08T21:25:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.103+0000 7f3adaffd640 1 --2- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] conn(0x7f3ac806fac0 0x7f3ac8071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.103+0000 7f3adaffd640 1 -- 172.21.15.53:0/3506857181 --> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ac8072610 con 0x7f3ac806fac0 2023-12-08T21:25:48.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.103+0000 7f3adaffd640 1 -- 172.21.15.53:0/3506857181 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3adc052670 con 0x7f3ae4159ba0 2023-12-08T21:25:48.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.103+0000 7f3ae993b640 1 --2- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] conn(0x7f3ac806fac0 0x7f3ac8071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:48.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.103+0000 7f3ae993b640 1 --2- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] conn(0x7f3ac806fac0 0x7f3ac8071f40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:48.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.107+0000 7f3adaffd640 1 -- 172.21.15.53:0/3506857181 <== osd.0 v2:172.21.15.53:6811/1090159332 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3ac8072610 con 0x7f3ac806fac0 2023-12-08T21:25:48.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3506857181 --> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3ae4153ce0 con 0x7f3ac806fac0 2023-12-08T21:25:48.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3adaffd640 1 -- 172.21.15.53:0/3506857181 <== osd.0 v2:172.21.15.53:6811/1090159332 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3ad4009860 con 0x7f3ac806fac0 2023-12-08T21:25:48.127 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-12-08T21:25:48.127 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T21:25:48.127 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-12-08T21:25:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] conn(0x7f3ac806fac0 msgr2=0x7f3ac8071f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3aec3a0640 1 --2- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:6811/1090159332,v1:172.21.15.53:6813/1090159332] conn(0x7f3ac806fac0 0x7f3ac8071f40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ac80664c0 msgr2=0x7f3ac8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3aec3a0640 1 --2- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ac80664c0 0x7f3ac8068980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00ae000 tx=0x7f3ae0008040 comp rx=0 tx=0).stop 2023-12-08T21:25:48.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae4159ba0 msgr2=0x7f3ae41513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3aec3a0640 1 --2- 172.21.15.53:0/3506857181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae4159ba0 0x7f3ae41513e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3adc007e90 tx=0x7f3adc00e4b0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3aea93d640 1 -- 172.21.15.53:0/3506857181 reap_dead start 2023-12-08T21:25:48.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3506857181 shutdown_connections 2023-12-08T21:25:48.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3506857181 >> 172.21.15.53:0/3506857181 conn(0x7f3ae4070c60 msgr2=0x7f3ae40c2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:48.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3506857181 shutdown_connections 2023-12-08T21:25:48.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.127+0000 7f3aec3a0640 1 -- 172.21.15.53:0/3506857181 wait complete. 2023-12-08T21:25:48.149 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-08T21:25:48.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.275+0000 7ff4bc17f640 1 Processor -- start 2023-12-08T21:25:48.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.275+0000 7ff4bc17f640 1 -- start start 2023-12-08T21:25:48.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.275+0000 7ff4bc17f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4b406f110 0x7ff4b406d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.275+0000 7ff4bc17f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b4157e90 con 0x7ff4b406ed30 2023-12-08T21:25:48.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.275+0000 7ff4bc17f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b4158170 con 0x7ff4b4071140 2023-12-08T21:25:48.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.275+0000 7ff4bc17f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b40c6000 con 0x7ff4b406f110 2023-12-08T21:25:48.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.279+0000 7ff4b9f1b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff4b406ed30 0x7ff4b40c58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40836/0 (socket says 172.21.15.53:40836) 2023-12-08T21:25:48.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.279+0000 7ff4b9f1b640 1 -- 172.21.15.53:0/338832207 learned_addr learned my addr 172.21.15.53:0/338832207 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:48.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.279+0000 7ff4b971a640 1 --2- 172.21.15.53:0/338832207 >> v2:172.21.15.53:3300/0 conn(0x7ff4b406f110 0x7ff4b406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:48.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.283+0000 7ff4b8f19640 1 -- 172.21.15.53:0/338832207 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062706509 0 0) 0x7ff4b4157e90 con 0x7ff4b406ed30 2023-12-08T21:25:48.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.283+0000 7ff4b8f19640 1 -- 172.21.15.53:0/338832207 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a0003530 con 0x7ff4b406ed30 2023-12-08T21:25:48.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.283+0000 7ff4b971a640 1 -- 172.21.15.53:0/338832207 >> v1:172.21.15.146:6789/0 conn(0x7ff4b4071140 legacy=0x7ff4b4157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.283+0000 7ff4b971a640 1 -- 172.21.15.53:0/338832207 >> v1:172.21.15.53:6789/0 conn(0x7ff4b406ed30 legacy=0x7ff4b40c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.283+0000 7ff4b971a640 1 -- 172.21.15.53:0/338832207 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b415a920 con 0x7ff4b406f110 2023-12-08T21:25:48.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.291+0000 7ff4b971a640 1 --2- 172.21.15.53:0/338832207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b406f110 0x7ff4b406d810 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40097c0 tx=0x7ff4a401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82290a4a20232872 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:48.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4b8f19640 1 -- 172.21.15.53:0/338832207 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40a8970 con 0x7ff4b406f110 2023-12-08T21:25:48.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4b8f19640 1 -- 172.21.15.53:0/338832207 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a40a8ad0 con 0x7ff4b406f110 2023-12-08T21:25:48.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4b8f19640 1 -- 172.21.15.53:0/338832207 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40a8e60 con 0x7ff4b406f110 2023-12-08T21:25:48.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 -- 172.21.15.53:0/338832207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b406f110 msgr2=0x7ff4b406d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 --2- 172.21.15.53:0/338832207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b406f110 0x7ff4b406d810 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40097c0 tx=0x7ff4a401ec70 comp rx=0 tx=0).stop 2023-12-08T21:25:48.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 -- 172.21.15.53:0/338832207 shutdown_connections 2023-12-08T21:25:48.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 --2- 172.21.15.53:0/338832207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b406f110 0x7ff4b406d810 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 -- 172.21.15.53:0/338832207 >> 172.21.15.53:0/338832207 conn(0x7ff4b40caef0 msgr2=0x7ff4b40cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:48.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 -- 172.21.15.53:0/338832207 shutdown_connections 2023-12-08T21:25:48.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 -- 172.21.15.53:0/338832207 wait complete. 2023-12-08T21:25:48.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 Processor -- start 2023-12-08T21:25:48.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 -- start start 2023-12-08T21:25:48.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b406ed30 0x7ff4b41ef5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b406f110 0x7ff4b41efb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b4071140 0x7ff4b4154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40c1b80 con 0x7ff4b4071140 2023-12-08T21:25:48.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4156e60 con 0x7ff4b406f110 2023-12-08T21:25:48.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.299+0000 7ff4bc17f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4157140 con 0x7ff4b406ed30 2023-12-08T21:25:48.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.303+0000 7ff4ba71c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b4071140 0x7ff4b4154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:48.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.303+0000 7ff4ba71c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b4071140 0x7ff4b4154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60242/0 (socket says 172.21.15.53:60242) 2023-12-08T21:25:48.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.303+0000 7ff4ba71c640 1 -- 172.21.15.53:0/2345863269 learned_addr learned my addr 172.21.15.53:0/2345863269 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:48.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.303+0000 7ff4b9f1b640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b406ed30 0x7ff4b41ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:48.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.303+0000 7ff4b971a640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b406f110 0x7ff4b41efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:48.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.307+0000 7ff4ba71c640 1 -- 172.21.15.53:0/2345863269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b406ed30 msgr2=0x7ff4b41ef5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.307+0000 7ff4ba71c640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b406ed30 0x7ff4b41ef5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.307+0000 7ff4ba71c640 1 -- 172.21.15.53:0/2345863269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b406f110 msgr2=0x7ff4b41efb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.307+0000 7ff4ba71c640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b406f110 0x7ff4b41efb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.307+0000 7ff4ba71c640 1 -- 172.21.15.53:0/2345863269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4009420 con 0x7ff4b4071140 2023-12-08T21:25:48.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.307+0000 7ff4ba71c640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b4071140 0x7ff4b4154490 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c730 tx=0x7ff4ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:48.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.311+0000 7ff4aa7fc640 1 -- 172.21.15.53:0/2345863269 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac003b80 con 0x7ff4b4071140 2023-12-08T21:25:48.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.311+0000 7ff4aa7fc640 1 -- 172.21.15.53:0/2345863269 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac003ce0 con 0x7ff4b4071140 2023-12-08T21:25:48.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.311+0000 7ff4aa7fc640 1 -- 172.21.15.53:0/2345863269 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00aa30 con 0x7ff4b4071140 2023-12-08T21:25:48.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.311+0000 7ff4bc17f640 1 -- 172.21.15.53:0/2345863269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b41ef0a0 con 0x7ff4b4071140 2023-12-08T21:25:48.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.311+0000 7ff4bc17f640 1 -- 172.21.15.53:0/2345863269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b40c1dd0 con 0x7ff4b4071140 2023-12-08T21:25:48.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.315+0000 7ff4bc17f640 1 -- 172.21.15.53:0/2345863269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b40675b0 con 0x7ff4b4071140 2023-12-08T21:25:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.335+0000 7ff4aa7fc640 1 -- 172.21.15.53:0/2345863269 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4ac00ab90 con 0x7ff4b4071140 2023-12-08T21:25:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.335+0000 7ff4aa7fc640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff4980664c0 0x7ff498068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.335+0000 7ff4b9f1b640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff4980664c0 0x7ff498068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:48.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.335+0000 7ff4b9f1b640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff4980664c0 0x7ff498068980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00011f0 tx=0x7ff4b0007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:48.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.339+0000 7ff4aa7fc640 1 -- 172.21.15.53:0/2345863269 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff4ac00ae40 con 0x7ff4b4071140 2023-12-08T21:25:48.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.623+0000 7ff4aa7fc640 1 -- 172.21.15.53:0/2345863269 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4ac051b80 con 0x7ff4b4071140 2023-12-08T21:25:48.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.791+0000 7ff4bc17f640 1 -- 172.21.15.53:0/2345863269 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4b415b1c0 con 0x7ff4980664c0 2023-12-08T21:25:48.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4aa7fc640 1 -- 172.21.15.53:0/2345863269 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff4b0005860 con 0x7ff4980664c0 2023-12-08T21:25:48.793 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 0 to deep-scrub 2023-12-08T21:25:48.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4bc17f640 1 -- 172.21.15.53:0/2345863269 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff4980664c0 msgr2=0x7ff498068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4bc17f640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff4980664c0 0x7ff498068980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00011f0 tx=0x7ff4b0007d40 comp rx=0 tx=0).stop 2023-12-08T21:25:48.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4bc17f640 1 -- 172.21.15.53:0/2345863269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b4071140 msgr2=0x7ff4b4154490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4bc17f640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b4071140 0x7ff4b4154490 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c730 tx=0x7ff4ac00cbf0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4bc17f640 1 -- 172.21.15.53:0/2345863269 shutdown_connections 2023-12-08T21:25:48.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4bc17f640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff4980664c0 0x7ff498068980 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4bc17f640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b4071140 0x7ff4b4154490 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4bc17f640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b406f110 0x7ff4b41efb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4bc17f640 1 --2- 172.21.15.53:0/2345863269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b406ed30 0x7ff4b41ef5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4bc17f640 1 -- 172.21.15.53:0/2345863269 >> 172.21.15.53:0/2345863269 conn(0x7ff4b40caef0 msgr2=0x7ff4b40c3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:48.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4bc17f640 1 -- 172.21.15.53:0/2345863269 shutdown_connections 2023-12-08T21:25:48.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.795+0000 7ff4bc17f640 1 -- 172.21.15.53:0/2345863269 wait complete. 2023-12-08T21:25:48.814 INFO:tasks.ceph:Scrubbing osd.1 2023-12-08T21:25:48.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-08T21:25:48.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.947+0000 7f188b8d3640 1 Processor -- start 2023-12-08T21:25:48.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.947+0000 7f188b8d3640 1 -- start start 2023-12-08T21:25:48.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.947+0000 7f188b8d3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f188413d4b0 0x7f1884157d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.947+0000 7f188b8d3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18840c6180 con 0x7f18840c4f30 2023-12-08T21:25:48.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.947+0000 7f188b8d3640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18840c6460 con 0x7f188406a640 2023-12-08T21:25:48.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.947+0000 7f188b8d3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18840c7070 con 0x7f188413d4b0 2023-12-08T21:25:48.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.947+0000 7f1889e70640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f188413d4b0 0x7f1884157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:48.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.947+0000 7f188966f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f18840c4f30 0x7f188413cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40846/0 (socket says 172.21.15.53:40846) 2023-12-08T21:25:48.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.947+0000 7f188966f640 1 -- 172.21.15.53:0/567879627 learned_addr learned my addr 172.21.15.53:0/567879627 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:48.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.951+0000 7f1889e70640 1 -- 172.21.15.53:0/567879627 >> v1:172.21.15.146:6789/0 conn(0x7f188406a640 legacy=0x7f188406b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:48.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.951+0000 7f1889e70640 1 -- 172.21.15.53:0/567879627 >> v1:172.21.15.53:6789/0 conn(0x7f18840c4f30 legacy=0x7f188413cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.951+0000 7f1889e70640 1 -- 172.21.15.53:0/567879627 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18840c6740 con 0x7f188413d4b0 2023-12-08T21:25:48.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.955+0000 7f1889e70640 1 --2- 172.21.15.53:0/567879627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188413d4b0 0x7f1884157d20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f187c009d90 tx=0x7f187c01f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bb0d942204fda5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:48.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.963+0000 7f187bfff640 1 -- 172.21.15.53:0/567879627 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c0af600 con 0x7f188413d4b0 2023-12-08T21:25:48.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.963+0000 7f187bfff640 1 -- 172.21.15.53:0/567879627 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c0ab050 con 0x7f188413d4b0 2023-12-08T21:25:48.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.963+0000 7f187bfff640 1 -- 172.21.15.53:0/567879627 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c0af980 con 0x7f188413d4b0 2023-12-08T21:25:48.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.963+0000 7f188b8d3640 1 -- 172.21.15.53:0/567879627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188413d4b0 msgr2=0x7f1884157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.963+0000 7f188b8d3640 1 --2- 172.21.15.53:0/567879627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188413d4b0 0x7f1884157d20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f187c009d90 tx=0x7f187c01f100 comp rx=0 tx=0).stop 2023-12-08T21:25:48.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.963+0000 7f188b8d3640 1 -- 172.21.15.53:0/567879627 shutdown_connections 2023-12-08T21:25:48.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.963+0000 7f188b8d3640 1 --2- 172.21.15.53:0/567879627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188413d4b0 0x7f1884157d20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.963+0000 7f188b8d3640 1 -- 172.21.15.53:0/567879627 >> 172.21.15.53:0/567879627 conn(0x7f18840cb5c0 msgr2=0x7f18840cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:48.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.963+0000 7f188b8d3640 1 -- 172.21.15.53:0/567879627 shutdown_connections 2023-12-08T21:25:48.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.963+0000 7f188b8d3640 1 -- 172.21.15.53:0/567879627 wait complete. 2023-12-08T21:25:48.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.963+0000 7f188b8d3640 1 Processor -- start 2023-12-08T21:25:48.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.963+0000 7f188b8d3640 1 -- start start 2023-12-08T21:25:48.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.967+0000 7f188b8d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188406a640 0x7f1884157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.967+0000 7f188b8d3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18840c4f30 0x7f188414dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.967+0000 7f188b8d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f188413d4b0 0x7f18841394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:48.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.967+0000 7f188b8d3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188414b2a0 con 0x7f188406a640 2023-12-08T21:25:48.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.967+0000 7f188b8d3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188414b580 con 0x7f188413d4b0 2023-12-08T21:25:48.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.967+0000 7f188b8d3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1884156b90 con 0x7f18840c4f30 2023-12-08T21:25:48.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.967+0000 7f1888e6e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18840c4f30 0x7f188414dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:48.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.967+0000 7f1889e70640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f188413d4b0 0x7f18841394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:48.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.967+0000 7f1888e6e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18840c4f30 0x7f188414dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:50168/0 (socket says 172.21.15.53:50168) 2023-12-08T21:25:48.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.967+0000 7f1888e6e640 1 -- 172.21.15.53:0/3660302354 learned_addr learned my addr 172.21.15.53:0/3660302354 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:48.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.975+0000 7f1888e6e640 1 -- 172.21.15.53:0/3660302354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f188413d4b0 msgr2=0x7f18841394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.975+0000 7f1888e6e640 1 --2- 172.21.15.53:0/3660302354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f188413d4b0 0x7f18841394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.975+0000 7f1888e6e640 1 -- 172.21.15.53:0/3660302354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188406a640 msgr2=0x7f1884157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:48.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.975+0000 7f1888e6e640 1 --2- 172.21.15.53:0/3660302354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188406a640 0x7f1884157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:48.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.975+0000 7f1888e6e640 1 -- 172.21.15.53:0/3660302354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c009a70 con 0x7f18840c4f30 2023-12-08T21:25:48.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.983+0000 7f1888e6e640 1 --2- 172.21.15.53:0/3660302354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18840c4f30 0x7f188414dea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f187400c490 tx=0x7f1874001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:48.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.995+0000 7f1879ffb640 1 -- 172.21.15.53:0/3660302354 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874003600 con 0x7f18840c4f30 2023-12-08T21:25:48.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.995+0000 7f1879ffb640 1 -- 172.21.15.53:0/3660302354 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1874003780 con 0x7f18840c4f30 2023-12-08T21:25:48.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.995+0000 7f188b8d3640 1 -- 172.21.15.53:0/3660302354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1884156e70 con 0x7f18840c4f30 2023-12-08T21:25:48.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.995+0000 7f1879ffb640 1 -- 172.21.15.53:0/3660302354 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874003b70 con 0x7f18840c4f30 2023-12-08T21:25:48.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.995+0000 7f188b8d3640 1 -- 172.21.15.53:0/3660302354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188414da10 con 0x7f18840c4f30 2023-12-08T21:25:48.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:48.995+0000 7f188b8d3640 1 -- 172.21.15.53:0/3660302354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18840c6d00 con 0x7f18840c4f30 2023-12-08T21:25:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.051+0000 7f1879ffb640 1 -- 172.21.15.53:0/3660302354 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1874003cd0 con 0x7f18840c4f30 2023-12-08T21:25:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.051+0000 7f1879ffb640 1 --2- 172.21.15.53:0/3660302354 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f18680664c0 0x7f1868068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.051+0000 7f188966f640 1 --2- 172.21.15.53:0/3660302354 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f18680664c0 0x7f1868068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.051+0000 7f188966f640 1 --2- 172.21.15.53:0/3660302354 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f18680664c0 0x7f1868068980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1880000f70 tx=0x7f1880007a90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.055+0000 7f1879ffb640 1 -- 172.21.15.53:0/3660302354 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1874054d30 con 0x7f18840c4f30 2023-12-08T21:25:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.055+0000 7f1879ffb640 1 --2- 172.21.15.53:0/3660302354 >> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] conn(0x7f186806fac0 0x7f1868071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.055+0000 7f1879ffb640 1 -- 172.21.15.53:0/3660302354 --> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1868072610 con 0x7f186806fac0 2023-12-08T21:25:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.059+0000 7f1889e70640 1 --2- 172.21.15.53:0/3660302354 >> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] conn(0x7f186806fac0 0x7f1868071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:49.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.059+0000 7f1889e70640 1 --2- 172.21.15.53:0/3660302354 >> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] conn(0x7f186806fac0 0x7f1868071f40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:49.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.059+0000 7f1879ffb640 1 -- 172.21.15.53:0/3660302354 <== osd.1 v2:172.21.15.53:6826/3198496294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1868072610 con 0x7f186806fac0 2023-12-08T21:25:49.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.075+0000 7f188b8d3640 1 -- 172.21.15.53:0/3660302354 --> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1884074190 con 0x7f186806fac0 2023-12-08T21:25:49.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.079+0000 7f1879ffb640 1 -- 172.21.15.53:0/3660302354 <== osd.1 v2:172.21.15.53:6826/3198496294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1884074190 con 0x7f186806fac0 2023-12-08T21:25:49.077 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-12-08T21:25:49.077 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T21:25:49.078 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-12-08T21:25:49.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.079+0000 7f188b8d3640 1 -- 172.21.15.53:0/3660302354 >> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] conn(0x7f186806fac0 msgr2=0x7f1868071f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:49.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.079+0000 7f188b8d3640 1 --2- 172.21.15.53:0/3660302354 >> [v2:172.21.15.53:6826/3198496294,v1:172.21.15.53:6827/3198496294] conn(0x7f186806fac0 0x7f1868071f40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:49.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.079+0000 7f188b8d3640 1 -- 172.21.15.53:0/3660302354 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f18680664c0 msgr2=0x7f1868068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:49.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.079+0000 7f188b8d3640 1 --2- 172.21.15.53:0/3660302354 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f18680664c0 0x7f1868068980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1880000f70 tx=0x7f1880007a90 comp rx=0 tx=0).stop 2023-12-08T21:25:49.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.079+0000 7f188b8d3640 1 -- 172.21.15.53:0/3660302354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18840c4f30 msgr2=0x7f188414dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:49.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.079+0000 7f188b8d3640 1 --2- 172.21.15.53:0/3660302354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18840c4f30 0x7f188414dea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f187400c490 tx=0x7f1874001e80 comp rx=0 tx=0).stop 2023-12-08T21:25:49.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.079+0000 7f1889e70640 1 -- 172.21.15.53:0/3660302354 reap_dead start 2023-12-08T21:25:49.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.079+0000 7f188b8d3640 1 -- 172.21.15.53:0/3660302354 shutdown_connections 2023-12-08T21:25:49.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.079+0000 7f188b8d3640 1 -- 172.21.15.53:0/3660302354 >> 172.21.15.53:0/3660302354 conn(0x7f18840cb5c0 msgr2=0x7f1884150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:49.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.079+0000 7f188b8d3640 1 -- 172.21.15.53:0/3660302354 shutdown_connections 2023-12-08T21:25:49.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.079+0000 7f188b8d3640 1 -- 172.21.15.53:0/3660302354 wait complete. 2023-12-08T21:25:49.101 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-08T21:25:49.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.231+0000 7f0bd1730640 1 Processor -- start 2023-12-08T21:25:49.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.231+0000 7f0bd1730640 1 -- start start 2023-12-08T21:25:49.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.231+0000 7f0bd1730640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0bcc0c7d20 0x7f0bcc151730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:49.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.235+0000 7f0bd1730640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0bcc0cceb0 0x7f0bcc0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:49.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.235+0000 7f0bd1730640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc0b0c50 con 0x7f0bcc151350 2023-12-08T21:25:49.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.235+0000 7f0bd1730640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b0380 con 0x7f0bcc0c7d20 2023-12-08T21:25:49.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.235+0000 7f0bd1730640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0ca830 con 0x7f0bcc0cceb0 2023-12-08T21:25:49.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.235+0000 7f0bcb7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0bcc0cceb0 0x7f0bcc0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:49.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.235+0000 7f0bcb7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0bcc0cceb0 0x7f0bcc0cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:46644/0 (socket says 172.21.15.53:46644) 2023-12-08T21:25:49.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.235+0000 7f0bcb7fe640 1 -- 172.21.15.53:0/338158101 learned_addr learned my addr 172.21.15.53:0/338158101 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:49.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.243+0000 7f0bcb7fe640 1 -- 172.21.15.53:0/338158101 >> v2:172.21.15.53:3300/0 conn(0x7f0bcc0c7d20 msgr2=0x7f0bcc151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:49.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.243+0000 7f0bcb7fe640 1 --2- 172.21.15.53:0/338158101 >> v2:172.21.15.53:3300/0 conn(0x7f0bcc0c7d20 0x7f0bcc151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:49.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.243+0000 7f0bcb7fe640 1 -- 172.21.15.53:0/338158101 >> v1:172.21.15.53:6789/0 conn(0x7f0bcc151350 legacy=0x7f0bcc0c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:49.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.243+0000 7f0bcb7fe640 1 -- 172.21.15.53:0/338158101 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0c26c0 con 0x7f0bcc0cceb0 2023-12-08T21:25:49.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.287+0000 7f0bcb7fe640 1 --2- 172.21.15.53:0/338158101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bcc0cceb0 0x7f0bcc0cd340 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0c4010 tx=0x7f0bc401c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f19ab9200378ad36 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:49.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.391+0000 7f0bc9ffb640 1 -- 172.21.15.53:0/338158101 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40a57e0 con 0x7f0bcc0cceb0 2023-12-08T21:25:49.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.391+0000 7f0bc9ffb640 1 -- 172.21.15.53:0/338158101 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc40a5940 con 0x7f0bcc0cceb0 2023-12-08T21:25:49.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.391+0000 7f0bc9ffb640 1 -- 172.21.15.53:0/338158101 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40a5cd0 con 0x7f0bcc0cceb0 2023-12-08T21:25:49.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.395+0000 7f0bd1730640 1 -- 172.21.15.53:0/338158101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bcc0cceb0 msgr2=0x7f0bcc0cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:49.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.395+0000 7f0bd1730640 1 --2- 172.21.15.53:0/338158101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bcc0cceb0 0x7f0bcc0cd340 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0c4010 tx=0x7f0bc401c900 comp rx=0 tx=0).stop 2023-12-08T21:25:49.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.395+0000 7f0bd1730640 1 -- 172.21.15.53:0/338158101 shutdown_connections 2023-12-08T21:25:49.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.395+0000 7f0bd1730640 1 --2- 172.21.15.53:0/338158101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bcc0cceb0 0x7f0bcc0cd340 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:49.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.395+0000 7f0bd1730640 1 --2- 172.21.15.53:0/338158101 >> v2:172.21.15.53:3300/0 conn(0x7f0bcc0c7d20 0x7f0bcc151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:49.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.395+0000 7f0bd1730640 1 -- 172.21.15.53:0/338158101 >> 172.21.15.53:0/338158101 conn(0x7f0bcc060fd0 msgr2=0x7f0bcc0613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:49.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.395+0000 7f0bd1730640 1 -- 172.21.15.53:0/338158101 shutdown_connections 2023-12-08T21:25:49.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.395+0000 7f0bd1730640 1 -- 172.21.15.53:0/338158101 wait complete. 2023-12-08T21:25:49.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.395+0000 7f0bd1730640 1 Processor -- start 2023-12-08T21:25:49.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.395+0000 7f0bd1730640 1 -- start start 2023-12-08T21:25:49.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.399+0000 7f0bd1730640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bcc0c7d20 0x7f0bcc14dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:49.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.399+0000 7f0bd1730640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bcc0cceb0 0x7f0bcc147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:49.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.399+0000 7f0bd1730640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bcc151350 0x7f0bcc147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:49.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.399+0000 7f0bd1730640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc14e9b0 con 0x7f0bcc0cceb0 2023-12-08T21:25:49.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.399+0000 7f0bd1730640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc14fb10 con 0x7f0bcc0c7d20 2023-12-08T21:25:49.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.399+0000 7f0bd1730640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1f3260 con 0x7f0bcc151350 2023-12-08T21:25:49.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.399+0000 7f0bcb7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bcc151350 0x7f0bcc147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.403+0000 7f0bcb7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bcc151350 0x7f0bcc147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:50178/0 (socket says 172.21.15.53:50178) 2023-12-08T21:25:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.403+0000 7f0bcb7fe640 1 -- 172.21.15.53:0/756647003 learned_addr learned my addr 172.21.15.53:0/756647003 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.403+0000 7f0bcaffd640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bcc0c7d20 0x7f0bcc14dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.411+0000 7f0bcb7fe640 1 -- 172.21.15.53:0/756647003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bcc0c7d20 msgr2=0x7f0bcc14dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.411+0000 7f0bcb7fe640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bcc0c7d20 0x7f0bcc14dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.411+0000 7f0bcb7fe640 1 -- 172.21.15.53:0/756647003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bcc0cceb0 msgr2=0x7f0bcc147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.411+0000 7f0bcb7fe640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bcc0cceb0 0x7f0bcc147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.411+0000 7f0bcb7fe640 1 -- 172.21.15.53:0/756647003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4009b30 con 0x7f0bcc151350 2023-12-08T21:25:49.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.419+0000 7f0bcb7fe640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bcc151350 0x7f0bcc147e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0bc401afb0 tx=0x7f0bc40196a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.431+0000 7f0bc37fe640 1 -- 172.21.15.53:0/756647003 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40b8670 con 0x7f0bcc151350 2023-12-08T21:25:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.431+0000 7f0bc37fe640 1 -- 172.21.15.53:0/756647003 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc40b87d0 con 0x7f0bcc151350 2023-12-08T21:25:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.431+0000 7f0bc37fe640 1 -- 172.21.15.53:0/756647003 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40b8b60 con 0x7f0bcc151350 2023-12-08T21:25:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.431+0000 7f0bd1730640 1 -- 172.21.15.53:0/756647003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc14fd80 con 0x7f0bcc151350 2023-12-08T21:25:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.431+0000 7f0bd1730640 1 -- 172.21.15.53:0/756647003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc150340 con 0x7f0bcc151350 2023-12-08T21:25:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.431+0000 7f0bd1730640 1 -- 172.21.15.53:0/756647003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc0c8b20 con 0x7f0bcc151350 2023-12-08T21:25:49.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.751+0000 7f0bc37fe640 1 -- 172.21.15.53:0/756647003 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0bc40b8cc0 con 0x7f0bcc151350 2023-12-08T21:25:49.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.751+0000 7f0bc37fe640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0bac0664c0 0x7f0bac068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:49.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.751+0000 7f0bcaffd640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0bac0664c0 0x7f0bac068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:49.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.751+0000 7f0bcaffd640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0bac0664c0 0x7f0bac068980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc007fd0 tx=0x7f0bbc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:49.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.759+0000 7f0bc37fe640 1 -- 172.21.15.53:0/756647003 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f0bc40f1530 con 0x7f0bcc151350 2023-12-08T21:25:49.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.783+0000 7f0bc37fe640 1 -- 172.21.15.53:0/756647003 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0bc40ed170 con 0x7f0bcc151350 2023-12-08T21:25:49.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.955+0000 7f0bd1730640 1 -- 172.21.15.53:0/756647003 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bcc0c2350 con 0x7f0bac0664c0 2023-12-08T21:25:49.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bc37fe640 1 -- 172.21.15.53:0/756647003 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0bbc001490 con 0x7f0bac0664c0 2023-12-08T21:25:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 1 to deep-scrub 2023-12-08T21:25:49.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bd1730640 1 -- 172.21.15.53:0/756647003 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0bac0664c0 msgr2=0x7f0bac068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:49.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bd1730640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0bac0664c0 0x7f0bac068980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc007fd0 tx=0x7f0bbc009040 comp rx=0 tx=0).stop 2023-12-08T21:25:49.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bd1730640 1 -- 172.21.15.53:0/756647003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bcc151350 msgr2=0x7f0bcc147e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:49.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bd1730640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bcc151350 0x7f0bcc147e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0bc401afb0 tx=0x7f0bc40196a0 comp rx=0 tx=0).stop 2023-12-08T21:25:49.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bd1730640 1 -- 172.21.15.53:0/756647003 shutdown_connections 2023-12-08T21:25:49.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bd1730640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0bac0664c0 0x7f0bac068980 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:49.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bd1730640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bcc151350 0x7f0bcc147e50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:49.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bd1730640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bcc0cceb0 0x7f0bcc147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:49.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bd1730640 1 --2- 172.21.15.53:0/756647003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bcc0c7d20 0x7f0bcc14dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:49.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bd1730640 1 -- 172.21.15.53:0/756647003 >> 172.21.15.53:0/756647003 conn(0x7f0bcc060fd0 msgr2=0x7f0bcc149800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:49.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bd1730640 1 -- 172.21.15.53:0/756647003 shutdown_connections 2023-12-08T21:25:49.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:49.959+0000 7f0bd1730640 1 -- 172.21.15.53:0/756647003 wait complete. 2023-12-08T21:25:49.978 INFO:tasks.ceph:Scrubbing osd.2 2023-12-08T21:25:49.978 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-08T21:25:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.107+0000 7f83fa0c7640 1 Processor -- start 2023-12-08T21:25:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.107+0000 7f83fa0c7640 1 -- start start 2023-12-08T21:25:50.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.111+0000 7f83fa0c7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83f41537f0 0x7f83f40cc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.111+0000 7f83fa0c7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83f4153bd0 0x7f83f40c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.111+0000 7f83fa0c7640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f415d6e0 con 0x7f83f40cc580 2023-12-08T21:25:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.111+0000 7f83fa0c7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f415d9c0 con 0x7f83f41537f0 2023-12-08T21:25:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.111+0000 7f83fa0c7640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f40cb560 con 0x7f83f4153bd0 2023-12-08T21:25:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.111+0000 7f83f37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83f41537f0 0x7f83f40cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.111+0000 7f83f37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83f41537f0 0x7f83f40cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60302/0 (socket says 172.21.15.53:60302) 2023-12-08T21:25:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.111+0000 7f83f37fe640 1 -- 172.21.15.53:0/4271735955 learned_addr learned my addr 172.21.15.53:0/4271735955 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.111+0000 7f83f3fff640 1 --2- 172.21.15.53:0/4271735955 >> v2:172.21.15.146:3300/0 conn(0x7f83f4153bd0 0x7f83f40c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.115+0000 7f83f37fe640 1 -- 172.21.15.53:0/4271735955 >> v2:172.21.15.146:3300/0 conn(0x7f83f4153bd0 msgr2=0x7f83f40c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.115+0000 7f83f37fe640 1 --2- 172.21.15.53:0/4271735955 >> v2:172.21.15.146:3300/0 conn(0x7f83f4153bd0 0x7f83f40c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.115+0000 7f83f37fe640 1 -- 172.21.15.53:0/4271735955 >> v1:172.21.15.146:6789/0 conn(0x7f83f40cc580 legacy=0x7f83f415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:50.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.115+0000 7f83f37fe640 1 -- 172.21.15.53:0/4271735955 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f40cb840 con 0x7f83f41537f0 2023-12-08T21:25:50.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.119+0000 7f83f37fe640 1 --2- 172.21.15.53:0/4271735955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f41537f0 0x7f83f40cc040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f83f406ba60 tx=0x7f83e401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfd3461f300b04f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:50.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.123+0000 7f83f27fc640 1 -- 172.21.15.53:0/4271735955 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40af400 con 0x7f83f41537f0 2023-12-08T21:25:50.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.123+0000 7f83f27fc640 1 -- 172.21.15.53:0/4271735955 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e40ab050 con 0x7f83f41537f0 2023-12-08T21:25:50.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.123+0000 7f83f27fc640 1 -- 172.21.15.53:0/4271735955 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40af780 con 0x7f83f41537f0 2023-12-08T21:25:50.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.123+0000 7f83fa0c7640 1 -- 172.21.15.53:0/4271735955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f41537f0 msgr2=0x7f83f40cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:50.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.123+0000 7f83fa0c7640 1 --2- 172.21.15.53:0/4271735955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f41537f0 0x7f83f40cc040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f83f406ba60 tx=0x7f83e401f1c0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.123+0000 7f83fa0c7640 1 -- 172.21.15.53:0/4271735955 shutdown_connections 2023-12-08T21:25:50.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.123+0000 7f83fa0c7640 1 --2- 172.21.15.53:0/4271735955 >> v2:172.21.15.146:3300/0 conn(0x7f83f4153bd0 0x7f83f40c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.123+0000 7f83fa0c7640 1 --2- 172.21.15.53:0/4271735955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f41537f0 0x7f83f40cc040 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.123+0000 7f83fa0c7640 1 -- 172.21.15.53:0/4271735955 >> 172.21.15.53:0/4271735955 conn(0x7f83f406bab0 msgr2=0x7f83f406bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:50.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.123+0000 7f83fa0c7640 1 -- 172.21.15.53:0/4271735955 shutdown_connections 2023-12-08T21:25:50.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.123+0000 7f83fa0c7640 1 -- 172.21.15.53:0/4271735955 wait complete. 2023-12-08T21:25:50.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83fa0c7640 1 Processor -- start 2023-12-08T21:25:50.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83fa0c7640 1 -- start start 2023-12-08T21:25:50.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83fa0c7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83f40cc580 0x7f83f415c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83fa0c7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83f41537f0 0x7f83f40b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83fa0c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f4153bd0 0x7f83f4149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83fa0c7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f41e2a80 con 0x7f83f4153bd0 2023-12-08T21:25:50.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83fa0c7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f415c6c0 con 0x7f83f41537f0 2023-12-08T21:25:50.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83fa0c7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f41f0ff0 con 0x7f83f40cc580 2023-12-08T21:25:50.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f4153bd0 0x7f83f4149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:50.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f4153bd0 0x7f83f4149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60308/0 (socket says 172.21.15.53:60308) 2023-12-08T21:25:50.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83f3fff640 1 -- 172.21.15.53:0/3086892890 learned_addr learned my addr 172.21.15.53:0/3086892890 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:50.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83f37fe640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83f40cc580 0x7f83f415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:50.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.127+0000 7f83f2ffd640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83f41537f0 0x7f83f40b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:50.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.131+0000 7f83f3fff640 1 -- 172.21.15.53:0/3086892890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83f40cc580 msgr2=0x7f83f415c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:50.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.131+0000 7f83f3fff640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83f40cc580 0x7f83f415c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.131+0000 7f83f3fff640 1 -- 172.21.15.53:0/3086892890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83f41537f0 msgr2=0x7f83f40b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:50.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.131+0000 7f83f3fff640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83f41537f0 0x7f83f40b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.131+0000 7f83f3fff640 1 -- 172.21.15.53:0/3086892890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e4009b30 con 0x7f83f4153bd0 2023-12-08T21:25:50.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.135+0000 7f83f3fff640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f4153bd0 0x7f83f4149830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00c4f0 tx=0x7f83ec00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:50.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.139+0000 7f83dbfff640 1 -- 172.21.15.53:0/3086892890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec004220 con 0x7f83f4153bd0 2023-12-08T21:25:50.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.139+0000 7f83dbfff640 1 -- 172.21.15.53:0/3086892890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec004380 con 0x7f83f4153bd0 2023-12-08T21:25:50.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.139+0000 7f83fa0c7640 1 -- 172.21.15.53:0/3086892890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f41f12b0 con 0x7f83f4153bd0 2023-12-08T21:25:50.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.139+0000 7f83dbfff640 1 -- 172.21.15.53:0/3086892890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec003860 con 0x7f83f4153bd0 2023-12-08T21:25:50.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.139+0000 7f83fa0c7640 1 -- 172.21.15.53:0/3086892890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f41f1870 con 0x7f83f4153bd0 2023-12-08T21:25:50.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.139+0000 7f83fa0c7640 1 -- 172.21.15.53:0/3086892890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83f415d360 con 0x7f83f4153bd0 2023-12-08T21:25:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.167+0000 7f83dbfff640 1 -- 172.21.15.53:0/3086892890 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83ec0039c0 con 0x7f83f4153bd0 2023-12-08T21:25:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.167+0000 7f83dbfff640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f83e00664f0 0x7f83e00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.167+0000 7f83f37fe640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f83e00664f0 0x7f83e00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.167+0000 7f83f37fe640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f83e00664f0 0x7f83e00689b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83e40b1000 tx=0x7f83e40aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:50.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.171+0000 7f83dbfff640 1 -- 172.21.15.53:0/3086892890 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f83ec055080 con 0x7f83f4153bd0 2023-12-08T21:25:50.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.171+0000 7f83dbfff640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] conn(0x7f83e006fb70 0x7f83e0071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.171+0000 7f83dbfff640 1 -- 172.21.15.53:0/3086892890 --> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83e00726c0 con 0x7f83e006fb70 2023-12-08T21:25:50.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.171+0000 7f83dbfff640 1 -- 172.21.15.53:0/3086892890 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83ec00a2b0 con 0x7f83f4153bd0 2023-12-08T21:25:50.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.171+0000 7f83f2ffd640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] conn(0x7f83e006fb70 0x7f83e0071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:50.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.171+0000 7f83f2ffd640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] conn(0x7f83e006fb70 0x7f83e0071ff0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:50.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.171+0000 7f83dbfff640 1 -- 172.21.15.53:0/3086892890 <== osd.2 v2:172.21.15.53:6802/2948930321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f83e00726c0 con 0x7f83e006fb70 2023-12-08T21:25:50.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83fa0c7640 1 -- 172.21.15.53:0/3086892890 --> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f83f40c4200 con 0x7f83e006fb70 2023-12-08T21:25:50.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83dbfff640 1 -- 172.21.15.53:0/3086892890 <== osd.2 v2:172.21.15.53:6802/2948930321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f83e8001450 con 0x7f83e006fb70 2023-12-08T21:25:50.190 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-12-08T21:25:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T21:25:50.191 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-12-08T21:25:50.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83fa0c7640 1 -- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] conn(0x7f83e006fb70 msgr2=0x7f83e0071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:50.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83fa0c7640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:6802/2948930321,v1:172.21.15.53:6803/2948930321] conn(0x7f83e006fb70 0x7f83e0071ff0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83fa0c7640 1 -- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f83e00664f0 msgr2=0x7f83e00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:50.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83fa0c7640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f83e00664f0 0x7f83e00689b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83e40b1000 tx=0x7f83e40aa000 comp rx=0 tx=0).stop 2023-12-08T21:25:50.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83fa0c7640 1 -- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f4153bd0 msgr2=0x7f83f4149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:50.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83fa0c7640 1 --2- 172.21.15.53:0/3086892890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f4153bd0 0x7f83f4149830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00c4f0 tx=0x7f83ec00c9b0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83f3fff640 1 -- 172.21.15.53:0/3086892890 reap_dead start 2023-12-08T21:25:50.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83fa0c7640 1 -- 172.21.15.53:0/3086892890 shutdown_connections 2023-12-08T21:25:50.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83fa0c7640 1 -- 172.21.15.53:0/3086892890 >> 172.21.15.53:0/3086892890 conn(0x7f83f406bab0 msgr2=0x7f83f4151c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:50.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83fa0c7640 1 -- 172.21.15.53:0/3086892890 shutdown_connections 2023-12-08T21:25:50.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.191+0000 7f83fa0c7640 1 -- 172.21.15.53:0/3086892890 wait complete. 2023-12-08T21:25:50.209 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-08T21:25:50.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.335+0000 7fbc0f91c640 1 Processor -- start 2023-12-08T21:25:50.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.335+0000 7fbc0f91c640 1 -- start start 2023-12-08T21:25:50.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.335+0000 7fbc0f91c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc080613d0 0x7fbc0806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.335+0000 7fbc0f91c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc080c64f0 0x7fbc0806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.335+0000 7fbc0f91c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc08153bc0 con 0x7fbc081537e0 2023-12-08T21:25:50.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.335+0000 7fbc0f91c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc080c6bd0 con 0x7fbc080c64f0 2023-12-08T21:25:50.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.335+0000 7fbc0f91c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc080cc370 con 0x7fbc080613d0 2023-12-08T21:25:50.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.335+0000 7fbc0ceb7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc080613d0 0x7fbc0806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:50.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.339+0000 7fbc0ceb7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc080613d0 0x7fbc0806ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:50202/0 (socket says 172.21.15.53:50202) 2023-12-08T21:25:50.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.339+0000 7fbc0ceb7640 1 -- 172.21.15.53:0/768316909 learned_addr learned my addr 172.21.15.53:0/768316909 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:50.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.343+0000 7fbc0ceb7640 1 -- 172.21.15.53:0/768316909 >> v2:172.21.15.53:3300/0 conn(0x7fbc080c64f0 msgr2=0x7fbc0806f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:50.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.343+0000 7fbc0ceb7640 1 --2- 172.21.15.53:0/768316909 >> v2:172.21.15.53:3300/0 conn(0x7fbc080c64f0 0x7fbc0806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.343+0000 7fbc0ceb7640 1 -- 172.21.15.53:0/768316909 >> v1:172.21.15.53:6789/0 conn(0x7fbc081537e0 legacy=0x7fbc080c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:50.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.343+0000 7fbc0ceb7640 1 -- 172.21.15.53:0/768316909 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc08159f50 con 0x7fbc080613d0 2023-12-08T21:25:50.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.347+0000 7fbc0ceb7640 1 --2- 172.21.15.53:0/768316909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc080613d0 0x7fbc0806ed70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009870 tx=0x7fbc0401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd9c6b3e5a45e03 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:50.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbbfffff640 1 -- 172.21.15.53:0/768316909 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc040ab600 con 0x7fbc080613d0 2023-12-08T21:25:50.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbbfffff640 1 -- 172.21.15.53:0/768316909 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc040ab760 con 0x7fbc080613d0 2023-12-08T21:25:50.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbbfffff640 1 -- 172.21.15.53:0/768316909 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc040abaf0 con 0x7fbc080613d0 2023-12-08T21:25:50.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 -- 172.21.15.53:0/768316909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc080613d0 msgr2=0x7fbc0806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:50.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 --2- 172.21.15.53:0/768316909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc080613d0 0x7fbc0806ed70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009870 tx=0x7fbc0401c440 comp rx=0 tx=0).stop 2023-12-08T21:25:50.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 -- 172.21.15.53:0/768316909 shutdown_connections 2023-12-08T21:25:50.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 --2- 172.21.15.53:0/768316909 >> v2:172.21.15.53:3300/0 conn(0x7fbc080c64f0 0x7fbc0806f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 --2- 172.21.15.53:0/768316909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc080613d0 0x7fbc0806ed70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 -- 172.21.15.53:0/768316909 >> 172.21.15.53:0/768316909 conn(0x7fbc080cb5c0 msgr2=0x7fbc080cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:50.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 -- 172.21.15.53:0/768316909 shutdown_connections 2023-12-08T21:25:50.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 -- 172.21.15.53:0/768316909 wait complete. 2023-12-08T21:25:50.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 Processor -- start 2023-12-08T21:25:50.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 -- start start 2023-12-08T21:25:50.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc080613d0 0x7fbc081570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc080c64f0 0x7fbc08152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc081537e0 0x7fbc080ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc081f64a0 con 0x7fbc080c64f0 2023-12-08T21:25:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08159400 con 0x7fbc080613d0 2023-12-08T21:25:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0f91c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc081f5f20 con 0x7fbc081537e0 2023-12-08T21:25:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.363+0000 7fbc0ceb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc080c64f0 0x7fbc08152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.367+0000 7fbc0ceb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc080c64f0 0x7fbc08152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60316/0 (socket says 172.21.15.53:60316) 2023-12-08T21:25:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.367+0000 7fbc0ceb7640 1 -- 172.21.15.53:0/2146307996 learned_addr learned my addr 172.21.15.53:0/2146307996 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:50.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.371+0000 7fbc0ceb7640 1 -- 172.21.15.53:0/2146307996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc081537e0 msgr2=0x7fbc080ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:50.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.371+0000 7fbc0ceb7640 1 --2- 172.21.15.53:0/2146307996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc081537e0 0x7fbc080ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.371+0000 7fbc0ceb7640 1 -- 172.21.15.53:0/2146307996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc080613d0 msgr2=0x7fbc081570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:50.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.371+0000 7fbc0ceb7640 1 --2- 172.21.15.53:0/2146307996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc080613d0 0x7fbc081570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.371+0000 7fbc0ceb7640 1 -- 172.21.15.53:0/2146307996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc040094d0 con 0x7fbc080c64f0 2023-12-08T21:25:50.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.375+0000 7fbc0ceb7640 1 --2- 172.21.15.53:0/2146307996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc080c64f0 0x7fbc08152890 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbc040ad040 tx=0x7fbc0401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:50.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.379+0000 7fbbfdffb640 1 -- 172.21.15.53:0/2146307996 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc040b4800 con 0x7fbc080c64f0 2023-12-08T21:25:50.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.379+0000 7fbbfdffb640 1 -- 172.21.15.53:0/2146307996 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc040b4980 con 0x7fbc080c64f0 2023-12-08T21:25:50.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.379+0000 7fbbfdffb640 1 -- 172.21.15.53:0/2146307996 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc040b4d30 con 0x7fbc080c64f0 2023-12-08T21:25:50.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.379+0000 7fbc0f91c640 1 -- 172.21.15.53:0/2146307996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc080c2720 con 0x7fbc080c64f0 2023-12-08T21:25:50.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.379+0000 7fbc0f91c640 1 -- 172.21.15.53:0/2146307996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc08158ad0 con 0x7fbc080c64f0 2023-12-08T21:25:50.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.379+0000 7fbc0f91c640 1 -- 172.21.15.53:0/2146307996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc08150de0 con 0x7fbc080c64f0 2023-12-08T21:25:50.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.399+0000 7fbbfdffb640 1 -- 172.21.15.53:0/2146307996 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbc040c8420 con 0x7fbc080c64f0 2023-12-08T21:25:50.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.399+0000 7fbbfdffb640 1 --2- 172.21.15.53:0/2146307996 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbbec0664c0 0x7fbbec068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:50.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.399+0000 7fbc0d6b8640 1 --2- 172.21.15.53:0/2146307996 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbbec0664c0 0x7fbbec068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:50.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.399+0000 7fbc0d6b8640 1 --2- 172.21.15.53:0/2146307996 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbbec0664c0 0x7fbbec068980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8007fd0 tx=0x7fbbf80079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:50.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.735+0000 7fbbfdffb640 1 -- 172.21.15.53:0/2146307996 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fbc040f00d0 con 0x7fbc080c64f0 2023-12-08T21:25:50.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.735+0000 7fbbfdffb640 1 -- 172.21.15.53:0/2146307996 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbc040ebd10 con 0x7fbc080c64f0 2023-12-08T21:25:50.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.895+0000 7fbc0f91c640 1 -- 172.21.15.53:0/2146307996 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc080c73e0 con 0x7fbbec0664c0 2023-12-08T21:25:50.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.895+0000 7fbbfdffb640 1 -- 172.21.15.53:0/2146307996 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbbf80050d0 con 0x7fbbec0664c0 2023-12-08T21:25:50.894 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 2 to deep-scrub 2023-12-08T21:25:50.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.899+0000 7fbc0f91c640 1 -- 172.21.15.53:0/2146307996 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbbec0664c0 msgr2=0x7fbbec068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:50.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.899+0000 7fbc0f91c640 1 --2- 172.21.15.53:0/2146307996 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbbec0664c0 0x7fbbec068980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8007fd0 tx=0x7fbbf80079a0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.899+0000 7fbc0f91c640 1 -- 172.21.15.53:0/2146307996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc080c64f0 msgr2=0x7fbc08152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:50.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.899+0000 7fbc0f91c640 1 --2- 172.21.15.53:0/2146307996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc080c64f0 0x7fbc08152890 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbc040ad040 tx=0x7fbc0401ac80 comp rx=0 tx=0).stop 2023-12-08T21:25:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.899+0000 7fbc0f91c640 1 -- 172.21.15.53:0/2146307996 shutdown_connections 2023-12-08T21:25:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.899+0000 7fbc0f91c640 1 --2- 172.21.15.53:0/2146307996 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fbbec0664c0 0x7fbbec068980 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.899+0000 7fbc0f91c640 1 --2- 172.21.15.53:0/2146307996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc081537e0 0x7fbc080ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.899+0000 7fbc0f91c640 1 --2- 172.21.15.53:0/2146307996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc080c64f0 0x7fbc08152890 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.899+0000 7fbc0f91c640 1 --2- 172.21.15.53:0/2146307996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc080613d0 0x7fbc081570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.899+0000 7fbc0f91c640 1 -- 172.21.15.53:0/2146307996 >> 172.21.15.53:0/2146307996 conn(0x7fbc080cb5c0 msgr2=0x7fbc080c5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.899+0000 7fbc0f91c640 1 -- 172.21.15.53:0/2146307996 shutdown_connections 2023-12-08T21:25:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:50.899+0000 7fbc0f91c640 1 -- 172.21.15.53:0/2146307996 wait complete. 2023-12-08T21:25:50.915 INFO:tasks.ceph:Scrubbing osd.3 2023-12-08T21:25:50.916 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-08T21:25:51.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.043+0000 7f6ac4193640 1 Processor -- start 2023-12-08T21:25:51.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.043+0000 7f6ac4193640 1 -- start start 2023-12-08T21:25:51.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.043+0000 7f6ac4193640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6abc1515d0 0x7f6abc0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.043+0000 7f6ac4193640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6abc070190 0x7f6abc0c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.043+0000 7f6ac4193640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6abc0c7d70 con 0x7f6abc0c86e0 2023-12-08T21:25:51.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.043+0000 7f6ac4193640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6abc0c7290 con 0x7f6abc1515d0 2023-12-08T21:25:51.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.043+0000 7f6ac4193640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6abc0705e0 con 0x7f6abc070190 2023-12-08T21:25:51.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.043+0000 7f6ac1f2f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6abc1515d0 0x7f6abc0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.043+0000 7f6ac1f2f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6abc1515d0 0x7f6abc0c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60320/0 (socket says 172.21.15.53:60320) 2023-12-08T21:25:51.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.043+0000 7f6ac1f2f640 1 -- 172.21.15.53:0/3356010577 learned_addr learned my addr 172.21.15.53:0/3356010577 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:51.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.043+0000 7f6ac172e640 1 --2- 172.21.15.53:0/3356010577 >> v2:172.21.15.146:3300/0 conn(0x7f6abc070190 0x7f6abc0c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.047+0000 7f6ac1f2f640 1 -- 172.21.15.53:0/3356010577 >> v2:172.21.15.146:3300/0 conn(0x7f6abc070190 msgr2=0x7f6abc0c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:51.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.047+0000 7f6ac1f2f640 1 --2- 172.21.15.53:0/3356010577 >> v2:172.21.15.146:3300/0 conn(0x7f6abc070190 0x7f6abc0c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.047+0000 7f6ac1f2f640 1 -- 172.21.15.53:0/3356010577 >> v1:172.21.15.146:6789/0 conn(0x7f6abc0c86e0 legacy=0x7f6abc15a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:51.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.047+0000 7f6ac1f2f640 1 -- 172.21.15.53:0/3356010577 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc0c8010 con 0x7f6abc1515d0 2023-12-08T21:25:51.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.051+0000 7f6ac1f2f640 1 --2- 172.21.15.53:0/3356010577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1515d0 0x7f6abc0c7710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0c43b0 tx=0x7f6ab801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722dd3997488743c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:51.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.055+0000 7f6ac0f2d640 1 -- 172.21.15.53:0/3356010577 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab80aa620 con 0x7f6abc1515d0 2023-12-08T21:25:51.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.055+0000 7f6ac0f2d640 1 -- 172.21.15.53:0/3356010577 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab80aa780 con 0x7f6abc1515d0 2023-12-08T21:25:51.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.055+0000 7f6ac0f2d640 1 -- 172.21.15.53:0/3356010577 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab80aab10 con 0x7f6abc1515d0 2023-12-08T21:25:51.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.055+0000 7f6ac4193640 1 -- 172.21.15.53:0/3356010577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1515d0 msgr2=0x7f6abc0c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.055+0000 7f6ac4193640 1 --2- 172.21.15.53:0/3356010577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1515d0 0x7f6abc0c7710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0c43b0 tx=0x7f6ab801c4c0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.055+0000 7f6ac4193640 1 -- 172.21.15.53:0/3356010577 shutdown_connections 2023-12-08T21:25:51.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.055+0000 7f6ac4193640 1 --2- 172.21.15.53:0/3356010577 >> v2:172.21.15.146:3300/0 conn(0x7f6abc070190 0x7f6abc0c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.055+0000 7f6ac4193640 1 --2- 172.21.15.53:0/3356010577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1515d0 0x7f6abc0c7710 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.055+0000 7f6ac4193640 1 -- 172.21.15.53:0/3356010577 >> 172.21.15.53:0/3356010577 conn(0x7f6abc070c60 msgr2=0x7f6abc071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:51.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.055+0000 7f6ac4193640 1 -- 172.21.15.53:0/3356010577 shutdown_connections 2023-12-08T21:25:51.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.055+0000 7f6ac4193640 1 -- 172.21.15.53:0/3356010577 wait complete. 2023-12-08T21:25:51.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac4193640 1 Processor -- start 2023-12-08T21:25:51.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac4193640 1 -- start start 2023-12-08T21:25:51.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac4193640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6abc070190 0x7f6abc0cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac4193640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6abc0c86e0 0x7f6abc1f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac4193640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1515d0 0x7f6abc1f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac4193640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc1f5890 con 0x7f6abc1515d0 2023-12-08T21:25:51.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac4193640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc15ae30 con 0x7f6abc0c86e0 2023-12-08T21:25:51.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac4193640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc15ab70 con 0x7f6abc070190 2023-12-08T21:25:51.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac2730640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1515d0 0x7f6abc1f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac2730640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1515d0 0x7f6abc1f6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60334/0 (socket says 172.21.15.53:60334) 2023-12-08T21:25:51.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac2730640 1 -- 172.21.15.53:0/1228730259 learned_addr learned my addr 172.21.15.53:0/1228730259 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:51.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac172e640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6abc0c86e0 0x7f6abc1f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.059+0000 7f6ac1f2f640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6abc070190 0x7f6abc0cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.063+0000 7f6ac2730640 1 -- 172.21.15.53:0/1228730259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6abc070190 msgr2=0x7f6abc0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.063+0000 7f6ac2730640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6abc070190 0x7f6abc0cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.063+0000 7f6ac2730640 1 -- 172.21.15.53:0/1228730259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6abc0c86e0 msgr2=0x7f6abc1f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.063+0000 7f6ac2730640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6abc0c86e0 0x7f6abc1f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.063+0000 7f6ac2730640 1 -- 172.21.15.53:0/1228730259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab80094d0 con 0x7f6abc1515d0 2023-12-08T21:25:51.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.067+0000 7f6ac2730640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1515d0 0x7f6abc1f6260 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c7b0 tx=0x7f6ab400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:51.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.071+0000 7f6ab27fc640 1 -- 172.21.15.53:0/1228730259 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4004b70 con 0x7f6abc1515d0 2023-12-08T21:25:51.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.071+0000 7f6ab27fc640 1 -- 172.21.15.53:0/1228730259 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab4004cd0 con 0x7f6abc1515d0 2023-12-08T21:25:51.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.071+0000 7f6ac4193640 1 -- 172.21.15.53:0/1228730259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc1615e0 con 0x7f6abc1515d0 2023-12-08T21:25:51.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.071+0000 7f6ab27fc640 1 -- 172.21.15.53:0/1228730259 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab400aa90 con 0x7f6abc1515d0 2023-12-08T21:25:51.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.071+0000 7f6ac4193640 1 -- 172.21.15.53:0/1228730259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc161ba0 con 0x7f6abc1515d0 2023-12-08T21:25:51.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.071+0000 7f6ac4193640 1 -- 172.21.15.53:0/1228730259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6abc06fe30 con 0x7f6abc1515d0 2023-12-08T21:25:51.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.095+0000 7f6ab27fc640 1 -- 172.21.15.53:0/1228730259 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ab400abf0 con 0x7f6abc1515d0 2023-12-08T21:25:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.095+0000 7f6ab27fc640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6aa0066470 0x7f6aa0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.095+0000 7f6ac1f2f640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6aa0066470 0x7f6aa0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.095+0000 7f6ac1f2f640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6aa0066470 0x7f6aa0068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80ae000 tx=0x7f6ab80b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.099+0000 7f6ab27fc640 1 -- 172.21.15.53:0/1228730259 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f6ab40557e0 con 0x7f6abc1515d0 2023-12-08T21:25:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.099+0000 7f6ab27fc640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] conn(0x7f6aa006fa70 0x7f6aa0071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.099+0000 7f6ab27fc640 1 -- 172.21.15.53:0/1228730259 --> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6aa00725c0 con 0x7f6aa006fa70 2023-12-08T21:25:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.099+0000 7f6ab27fc640 1 -- 172.21.15.53:0/1228730259 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ab400aea0 con 0x7f6abc1515d0 2023-12-08T21:25:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.099+0000 7f6ac172e640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] conn(0x7f6aa006fa70 0x7f6aa0071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.099+0000 7f6ac172e640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] conn(0x7f6aa006fa70 0x7f6aa0071ef0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:51.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.099+0000 7f6ab27fc640 1 -- 172.21.15.53:0/1228730259 <== osd.3 v2:172.21.15.53:6810/3377657133 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6aa00725c0 con 0x7f6aa006fa70 2023-12-08T21:25:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ac4193640 1 -- 172.21.15.53:0/1228730259 --> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6abc157c90 con 0x7f6aa006fa70 2023-12-08T21:25:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ab27fc640 1 -- 172.21.15.53:0/1228730259 <== osd.3 v2:172.21.15.53:6810/3377657133 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6aac0076b0 con 0x7f6aa006fa70 2023-12-08T21:25:51.114 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-12-08T21:25:51.114 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T21:25:51.115 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-12-08T21:25:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ac4193640 1 -- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] conn(0x7f6aa006fa70 msgr2=0x7f6aa0071ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ac4193640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:6810/3377657133,v1:172.21.15.53:6812/3377657133] conn(0x7f6aa006fa70 0x7f6aa0071ef0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ac4193640 1 -- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6aa0066470 msgr2=0x7f6aa0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ac4193640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f6aa0066470 0x7f6aa0068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80ae000 tx=0x7f6ab80b5040 comp rx=0 tx=0).stop 2023-12-08T21:25:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ac4193640 1 -- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1515d0 msgr2=0x7f6abc1f6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ac4193640 1 --2- 172.21.15.53:0/1228730259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1515d0 0x7f6abc1f6260 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c7b0 tx=0x7f6ab400cc70 comp rx=0 tx=0).stop 2023-12-08T21:25:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ac2730640 1 -- 172.21.15.53:0/1228730259 reap_dead start 2023-12-08T21:25:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ac4193640 1 -- 172.21.15.53:0/1228730259 shutdown_connections 2023-12-08T21:25:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ac4193640 1 -- 172.21.15.53:0/1228730259 >> 172.21.15.53:0/1228730259 conn(0x7f6abc070c60 msgr2=0x7f6abc150700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ac4193640 1 -- 172.21.15.53:0/1228730259 shutdown_connections 2023-12-08T21:25:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.115+0000 7f6ac4193640 1 -- 172.21.15.53:0/1228730259 wait complete. 2023-12-08T21:25:51.132 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-08T21:25:51.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.251+0000 7f4fc4a8f640 1 Processor -- start 2023-12-08T21:25:51.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.251+0000 7f4fc4a8f640 1 -- start start 2023-12-08T21:25:51.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.251+0000 7f4fc4a8f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4fc00c3960 0x7f4fc00c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.251+0000 7f4fc4a8f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fc006b7e0 0x7f4fc006be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.251+0000 7f4fc4a8f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc006d3e0 con 0x7f4fc0153800 2023-12-08T21:25:51.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.251+0000 7f4fc4a8f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc01596a0 con 0x7f4fc00c3960 2023-12-08T21:25:51.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.251+0000 7f4fc4a8f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc015a4c0 con 0x7f4fc006b7e0 2023-12-08T21:25:51.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.251+0000 7f4fbdd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4fc00c3960 0x7f4fc00c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.251+0000 7f4fbe59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4fc0153800 0x7f4fc00cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40862/0 (socket says 172.21.15.53:40862) 2023-12-08T21:25:51.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.251+0000 7f4fbe59c640 1 -- 172.21.15.53:0/211679727 learned_addr learned my addr 172.21.15.53:0/211679727 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:51.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.255+0000 7f4fbed9d640 1 --2- 172.21.15.53:0/211679727 >> v2:172.21.15.146:3300/0 conn(0x7f4fc006b7e0 0x7f4fc006be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.259+0000 7f4fbdd9b640 1 -- 172.21.15.53:0/211679727 >> v2:172.21.15.146:3300/0 conn(0x7f4fc006b7e0 msgr2=0x7f4fc006be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:51.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.259+0000 7f4fbdd9b640 1 --2- 172.21.15.53:0/211679727 >> v2:172.21.15.146:3300/0 conn(0x7f4fc006b7e0 0x7f4fc006be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.259+0000 7f4fbdd9b640 1 -- 172.21.15.53:0/211679727 >> v1:172.21.15.53:6789/0 conn(0x7f4fc0153800 legacy=0x7f4fc00cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.259+0000 7f4fbdd9b640 1 -- 172.21.15.53:0/211679727 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc01598b0 con 0x7f4fc00c3960 2023-12-08T21:25:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.263+0000 7f4fbdd9b640 1 --2- 172.21.15.53:0/211679727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fc00c3960 0x7f4fc00c7d20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00afe60 tx=0x7f4fa801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a6699f5229f23a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fbd59a640 1 -- 172.21.15.53:0/211679727 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80ab600 con 0x7f4fc00c3960 2023-12-08T21:25:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fbd59a640 1 -- 172.21.15.53:0/211679727 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa80a7050 con 0x7f4fc00c3960 2023-12-08T21:25:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fbd59a640 1 -- 172.21.15.53:0/211679727 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80ab980 con 0x7f4fc00c3960 2023-12-08T21:25:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/211679727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fc00c3960 msgr2=0x7f4fc00c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 --2- 172.21.15.53:0/211679727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fc00c3960 0x7f4fc00c7d20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00afe60 tx=0x7f4fa801c460 comp rx=0 tx=0).stop 2023-12-08T21:25:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/211679727 shutdown_connections 2023-12-08T21:25:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 --2- 172.21.15.53:0/211679727 >> v2:172.21.15.146:3300/0 conn(0x7f4fc006b7e0 0x7f4fc006be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 --2- 172.21.15.53:0/211679727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fc00c3960 0x7f4fc00c7d20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/211679727 >> 172.21.15.53:0/211679727 conn(0x7f4fc0060fd0 msgr2=0x7f4fc00613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/211679727 shutdown_connections 2023-12-08T21:25:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/211679727 wait complete. 2023-12-08T21:25:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 Processor -- start 2023-12-08T21:25:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 -- start start 2023-12-08T21:25:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc006b7e0 0x7f4fc014f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fc00c3960 0x7f4fc015aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fc0153800 0x7f4fc015af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc015cde0 con 0x7f4fc00c3960 2023-12-08T21:25:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0149340 con 0x7f4fc006b7e0 2023-12-08T21:25:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.271+0000 7f4fc4a8f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc01f56b0 con 0x7f4fc0153800 2023-12-08T21:25:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.275+0000 7f4fbdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fc00c3960 0x7f4fc015aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.275+0000 7f4fbdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fc00c3960 0x7f4fc015aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59268/0 (socket says 172.21.15.53:59268) 2023-12-08T21:25:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.275+0000 7f4fbdd9b640 1 -- 172.21.15.53:0/2238278813 learned_addr learned my addr 172.21.15.53:0/2238278813 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.275+0000 7f4fbe59c640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc006b7e0 0x7f4fc014f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.275+0000 7f4fbed9d640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fc0153800 0x7f4fc015af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.279+0000 7f4fbdd9b640 1 -- 172.21.15.53:0/2238278813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fc0153800 msgr2=0x7f4fc015af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.279+0000 7f4fbdd9b640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fc0153800 0x7f4fc015af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.279+0000 7f4fbdd9b640 1 -- 172.21.15.53:0/2238278813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc006b7e0 msgr2=0x7f4fc014f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.279+0000 7f4fbdd9b640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc006b7e0 0x7f4fc014f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.279+0000 7f4fbdd9b640 1 -- 172.21.15.53:0/2238278813 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa8009420 con 0x7f4fc00c3960 2023-12-08T21:25:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.279+0000 7f4fbdd9b640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fc00c3960 0x7f4fc015aa40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8019070 tx=0x7f4fa8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:51.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.283+0000 7f4fb6ffd640 1 -- 172.21.15.53:0/2238278813 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80b4430 con 0x7f4fc00c3960 2023-12-08T21:25:51.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.283+0000 7f4fb6ffd640 1 -- 172.21.15.53:0/2238278813 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa80b4590 con 0x7f4fc00c3960 2023-12-08T21:25:51.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.283+0000 7f4fb6ffd640 1 -- 172.21.15.53:0/2238278813 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80b4920 con 0x7f4fc00c3960 2023-12-08T21:25:51.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.283+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/2238278813 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc01f6510 con 0x7f4fc00c3960 2023-12-08T21:25:51.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.283+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/2238278813 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc01f5be0 con 0x7f4fc00c3960 2023-12-08T21:25:51.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.287+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/2238278813 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc0074190 con 0x7f4fc00c3960 2023-12-08T21:25:51.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.583+0000 7f4fb6ffd640 1 -- 172.21.15.53:0/2238278813 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4fa80b2040 con 0x7f4fc00c3960 2023-12-08T21:25:51.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.583+0000 7f4fb6ffd640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4fa00664f0 0x7f4fa00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.583+0000 7f4fbe59c640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4fa00664f0 0x7f4fa00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.583+0000 7f4fbe59c640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4fa00664f0 0x7f4fa00689b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8005c10 tx=0x7f4fb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:51.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.619+0000 7f4fb6ffd640 1 -- 172.21.15.53:0/2238278813 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4fa80effc0 con 0x7f4fc00c3960 2023-12-08T21:25:51.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.619+0000 7f4fb6ffd640 1 -- 172.21.15.53:0/2238278813 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fa80ebc00 con 0x7f4fc00c3960 2023-12-08T21:25:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.791+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/2238278813 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fc015a840 con 0x7f4fa00664f0 2023-12-08T21:25:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.791+0000 7f4fb6ffd640 1 -- 172.21.15.53:0/2238278813 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4fc015a840 con 0x7f4fa00664f0 2023-12-08T21:25:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 3 to deep-scrub 2023-12-08T21:25:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.795+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/2238278813 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4fa00664f0 msgr2=0x7f4fa00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.795+0000 7f4fc4a8f640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4fa00664f0 0x7f4fa00689b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8005c10 tx=0x7f4fb8009040 comp rx=0 tx=0).stop 2023-12-08T21:25:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.795+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/2238278813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fc00c3960 msgr2=0x7f4fc015aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.795+0000 7f4fc4a8f640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fc00c3960 0x7f4fc015aa40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8019070 tx=0x7f4fa8019200 comp rx=0 tx=0).stop 2023-12-08T21:25:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.795+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/2238278813 shutdown_connections 2023-12-08T21:25:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.795+0000 7f4fc4a8f640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4fa00664f0 0x7f4fa00689b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.795+0000 7f4fc4a8f640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fc0153800 0x7f4fc015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.795+0000 7f4fc4a8f640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fc00c3960 0x7f4fc015aa40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.795+0000 7f4fc4a8f640 1 --2- 172.21.15.53:0/2238278813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc006b7e0 0x7f4fc014f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.795+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/2238278813 >> 172.21.15.53:0/2238278813 conn(0x7f4fc0060fd0 msgr2=0x7f4fc00cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.795+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/2238278813 shutdown_connections 2023-12-08T21:25:51.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.795+0000 7f4fc4a8f640 1 -- 172.21.15.53:0/2238278813 wait complete. 2023-12-08T21:25:51.814 INFO:tasks.ceph:Scrubbing osd.4 2023-12-08T21:25:51.814 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-08T21:25:51.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.951+0000 7ff2a7d9e640 1 Processor -- start 2023-12-08T21:25:51.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.951+0000 7ff2a7d9e640 1 -- start start 2023-12-08T21:25:51.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.951+0000 7ff2a7d9e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a0160fb0 0x7ff2a00b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.951+0000 7ff2a7d9e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2a0161390 0x7ff2a006b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.951+0000 7ff2a7d9e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a006f4c0 con 0x7ff2a006ed00 2023-12-08T21:25:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.951+0000 7ff2a7d9e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a0161cc0 con 0x7ff2a0161390 2023-12-08T21:25:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.951+0000 7ff2a7d9e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a006fa40 con 0x7ff2a0160fb0 2023-12-08T21:25:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.951+0000 7ff2a5339640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff2a006ed00 0x7ff2a0157570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40866/0 (socket says 172.21.15.53:40866) 2023-12-08T21:25:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.951+0000 7ff2a5339640 1 -- 172.21.15.53:0/1573612630 learned_addr learned my addr 172.21.15.53:0/1573612630 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:51.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.951+0000 7ff2a633b640 1 --2- 172.21.15.53:0/1573612630 >> v2:172.21.15.146:3300/0 conn(0x7ff2a0161390 0x7ff2a006b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.955+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558696866 0 0) 0x7ff2a006f4c0 con 0x7ff2a006ed00 2023-12-08T21:25:51.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.955+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff28c003530 con 0x7ff2a006ed00 2023-12-08T21:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3430512818 0 0) 0x7ff28c003530 con 0x7ff2a006ed00 2023-12-08T21:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a0160fb0 msgr2=0x7ff2a00b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 --2- 172.21.15.53:0/1573612630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a0160fb0 0x7ff2a00b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 >> v2:172.21.15.146:3300/0 conn(0x7ff2a0161390 msgr2=0x7ff2a006b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 --2- 172.21.15.53:0/1573612630 >> v2:172.21.15.146:3300/0 conn(0x7ff2a0161390 0x7ff2a006b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a00c7d50 con 0x7ff2a006ed00 2023-12-08T21:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a633b640 1 --2- 172.21.15.53:0/1573612630 >> v2:172.21.15.146:3300/0 conn(0x7ff2a0161390 0x7ff2a006b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T21:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 149952835 0 0) 0x7ff290001680 con 0x7ff2a006ed00 2023-12-08T21:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 >> v1:172.21.15.53:6789/0 conn(0x7ff2a006ed00 legacy=0x7ff2a0157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 --2- 172.21.15.53:0/1573612630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff28c0039b0 0x7ff28c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 --2- 172.21.15.53:0/1573612630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff28c0047d0 0x7ff28c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 --2- 172.21.15.53:0/1573612630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a0160fb0 0x7ff28c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a006fa40 con 0x7ff28c0039b0 2023-12-08T21:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c00bb00 con 0x7ff28c0047d0 2023-12-08T21:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.959+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c00bcc0 con 0x7ff2a0160fb0 2023-12-08T21:25:51.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.963+0000 7ff2a5b3a640 1 --2- 172.21.15.53:0/1573612630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff28c0039b0 0x7ff28c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.963+0000 7ff2a5339640 1 --2- 172.21.15.53:0/1573612630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff28c0047d0 0x7ff28c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.967+0000 7ff2a5b3a640 1 -- 172.21.15.53:0/1573612630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a0160fb0 msgr2=0x7ff28c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:51.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.967+0000 7ff2a5b3a640 1 --2- 172.21.15.53:0/1573612630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a0160fb0 0x7ff28c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.967+0000 7ff2a5b3a640 1 -- 172.21.15.53:0/1573612630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff28c0047d0 msgr2=0x7ff28c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:51.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.967+0000 7ff2a5b3a640 1 --2- 172.21.15.53:0/1573612630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff28c0047d0 0x7ff28c004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.967+0000 7ff2a5b3a640 1 -- 172.21.15.53:0/1573612630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c003530 con 0x7ff28c0039b0 2023-12-08T21:25:51.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.967+0000 7ff2a5b3a640 1 --2- 172.21.15.53:0/1573612630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff28c0039b0 0x7ff28c003dd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff298009c70 tx=0x7ff29801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670b28ecff2ccd73 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:51.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.975+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980a5c20 con 0x7ff28c0039b0 2023-12-08T21:25:51.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.975+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2980a5da0 con 0x7ff28c0039b0 2023-12-08T21:25:51.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.975+0000 7ff2a4b38640 1 -- 172.21.15.53:0/1573612630 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980ad680 con 0x7ff28c0039b0 2023-12-08T21:25:51.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.975+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/1573612630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff28c0039b0 msgr2=0x7ff28c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.975+0000 7ff2a7d9e640 1 --2- 172.21.15.53:0/1573612630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff28c0039b0 0x7ff28c003dd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff298009c70 tx=0x7ff29801cc10 comp rx=0 tx=0).stop 2023-12-08T21:25:51.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.975+0000 7ff2a633b640 1 -- 172.21.15.53:0/1573612630 reap_dead start 2023-12-08T21:25:51.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.975+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/1573612630 shutdown_connections 2023-12-08T21:25:51.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.975+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/1573612630 >> 172.21.15.53:0/1573612630 conn(0x7ff2a0070b10 msgr2=0x7ff2a0070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:51.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.975+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/1573612630 shutdown_connections 2023-12-08T21:25:51.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.975+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/1573612630 wait complete. 2023-12-08T21:25:51.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.975+0000 7ff2a7d9e640 1 Processor -- start 2023-12-08T21:25:51.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.975+0000 7ff2a7d9e640 1 -- start start 2023-12-08T21:25:51.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.979+0000 7ff2a7d9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff28c0039b0 0x7ff2a00c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.979+0000 7ff2a7d9e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a01f6b30 0x7ff2a01f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.979+0000 7ff2a7d9e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a0156160 0x7ff2a015e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:51.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.979+0000 7ff2a7d9e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a015acd0 con 0x7ff28c0039b0 2023-12-08T21:25:51.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.979+0000 7ff2a7d9e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0156730 con 0x7ff2a01f6b30 2023-12-08T21:25:51.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.979+0000 7ff2a7d9e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a015a050 con 0x7ff2a0156160 2023-12-08T21:25:51.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.979+0000 7ff2a5b3a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff28c0039b0 0x7ff2a00c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.979+0000 7ff2a5b3a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff28c0039b0 0x7ff2a00c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59290/0 (socket says 172.21.15.53:59290) 2023-12-08T21:25:51.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.979+0000 7ff2a5b3a640 1 -- 172.21.15.53:0/2221588256 learned_addr learned my addr 172.21.15.53:0/2221588256 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:51.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.979+0000 7ff2a5339640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a01f6b30 0x7ff2a01f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:51.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.983+0000 7ff2a5b3a640 1 -- 172.21.15.53:0/2221588256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a0156160 msgr2=0x7ff2a015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.983+0000 7ff2a5b3a640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a0156160 0x7ff2a015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.983+0000 7ff2a5b3a640 1 -- 172.21.15.53:0/2221588256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a01f6b30 msgr2=0x7ff2a01f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:51.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.983+0000 7ff2a5b3a640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a01f6b30 0x7ff2a01f6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:51.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.983+0000 7ff2a5b3a640 1 -- 172.21.15.53:0/2221588256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a015a330 con 0x7ff28c0039b0 2023-12-08T21:25:51.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.983+0000 7ff2a5b3a640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff28c0039b0 0x7ff2a00c3d70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff29801d4b0 tx=0x7ff28c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:51.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.987+0000 7ff2967fc640 1 -- 172.21.15.53:0/2221588256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980a5c30 con 0x7ff28c0039b0 2023-12-08T21:25:51.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.987+0000 7ff2967fc640 1 -- 172.21.15.53:0/2221588256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff298004040 con 0x7ff28c0039b0 2023-12-08T21:25:51.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.987+0000 7ff2967fc640 1 -- 172.21.15.53:0/2221588256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980043d0 con 0x7ff28c0039b0 2023-12-08T21:25:51.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.987+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/2221588256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a015a610 con 0x7ff28c0039b0 2023-12-08T21:25:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.987+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/2221588256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a01f67d0 con 0x7ff28c0039b0 2023-12-08T21:25:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:51.987+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/2221588256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2a015aac0 con 0x7ff28c0039b0 2023-12-08T21:25:52.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.011+0000 7ff2967fc640 1 -- 172.21.15.53:0/2221588256 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff298004530 con 0x7ff28c0039b0 2023-12-08T21:25:52.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.011+0000 7ff2967fc640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff2840664f0 0x7ff2840689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.011+0000 7ff2a5339640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff2840664f0 0x7ff2840689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.015+0000 7ff2a5339640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff2840664f0 0x7ff2840689b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00ca280 tx=0x7ff290009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:52.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.015+0000 7ff2967fc640 1 -- 172.21.15.53:0/2221588256 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff2980f0600 con 0x7ff28c0039b0 2023-12-08T21:25:52.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.015+0000 7ff2967fc640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] conn(0x7ff28406f980 0x7ff284071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.015+0000 7ff2967fc640 1 -- 172.21.15.53:0/2221588256 --> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2840724d0 con 0x7ff28406f980 2023-12-08T21:25:52.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.015+0000 7ff2967fc640 1 -- 172.21.15.53:0/2221588256 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2980ec940 con 0x7ff28c0039b0 2023-12-08T21:25:52.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.019+0000 7ff2a633b640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] conn(0x7ff28406f980 0x7ff284071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.019+0000 7ff2a633b640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] conn(0x7ff28406f980 0x7ff284071e00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:52.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.019+0000 7ff2967fc640 1 -- 172.21.15.53:0/2221588256 <== osd.4 v2:172.21.15.146:6800/2537824411 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff2840724d0 con 0x7ff28406f980 2023-12-08T21:25:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.043+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/2221588256 --> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff2a006f180 con 0x7ff28406f980 2023-12-08T21:25:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.047+0000 7ff2967fc640 1 -- 172.21.15.53:0/2221588256 <== osd.4 v2:172.21.15.146:6800/2537824411 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff29c006be0 con 0x7ff28406f980 2023-12-08T21:25:52.046 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-12-08T21:25:52.046 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T21:25:52.046 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-12-08T21:25:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.047+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/2221588256 >> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] conn(0x7ff28406f980 msgr2=0x7ff284071e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.047+0000 7ff2a7d9e640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.146:6800/2537824411,v1:172.21.15.146:6801/2537824411] conn(0x7ff28406f980 0x7ff284071e00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.047+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/2221588256 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff2840664f0 msgr2=0x7ff2840689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.047+0000 7ff2a7d9e640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff2840664f0 0x7ff2840689b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00ca280 tx=0x7ff290009040 comp rx=0 tx=0).stop 2023-12-08T21:25:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.047+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/2221588256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff28c0039b0 msgr2=0x7ff2a00c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.047+0000 7ff2a7d9e640 1 --2- 172.21.15.53:0/2221588256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff28c0039b0 0x7ff2a00c3d70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff29801d4b0 tx=0x7ff28c005800 comp rx=0 tx=0).stop 2023-12-08T21:25:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.047+0000 7ff2a633b640 1 -- 172.21.15.53:0/2221588256 reap_dead start 2023-12-08T21:25:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.047+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/2221588256 shutdown_connections 2023-12-08T21:25:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.047+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/2221588256 >> 172.21.15.53:0/2221588256 conn(0x7ff2a0070b10 msgr2=0x7ff2a00c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.047+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/2221588256 shutdown_connections 2023-12-08T21:25:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.047+0000 7ff2a7d9e640 1 -- 172.21.15.53:0/2221588256 wait complete. 2023-12-08T21:25:52.065 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-08T21:25:52.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.183+0000 7f8f711ce640 1 Processor -- start 2023-12-08T21:25:52.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.183+0000 7f8f711ce640 1 -- start start 2023-12-08T21:25:52.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.183+0000 7f8f711ce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f6c06abf0 0x7f8f6c1512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.183+0000 7f8f711ce640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c06bb30 0x7f8f6c1517e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.183+0000 7f8f711ce640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c0c7d60 con 0x7f8f6c06a810 2023-12-08T21:25:52.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.183+0000 7f8f711ce640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c157490 con 0x7f8f6c06abf0 2023-12-08T21:25:52.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.183+0000 7f8f711ce640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0616e0 con 0x7f8f6c06bb30 2023-12-08T21:25:52.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.183+0000 7f8f6a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f6c06abf0 0x7f8f6c1512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.183+0000 7f8f6a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f6c06abf0 0x7f8f6c1512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59298/0 (socket says 172.21.15.53:59298) 2023-12-08T21:25:52.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.183+0000 7f8f6a59c640 1 -- 172.21.15.53:0/1663220613 learned_addr learned my addr 172.21.15.53:0/1663220613 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:52.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.187+0000 7f8f6a59c640 1 -- 172.21.15.53:0/1663220613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c06bb30 msgr2=0x7f8f6c1517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:52.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.187+0000 7f8f6a59c640 1 --2- 172.21.15.53:0/1663220613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c06bb30 0x7f8f6c1517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.187+0000 7f8f6a59c640 1 -- 172.21.15.53:0/1663220613 >> v1:172.21.15.146:6789/0 conn(0x7f8f6c06a810 legacy=0x7f8f6c060fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:52.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.187+0000 7f8f6a59c640 1 -- 172.21.15.53:0/1663220613 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c157680 con 0x7f8f6c06abf0 2023-12-08T21:25:52.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.191+0000 7f8f6a59c640 1 --2- 172.21.15.53:0/1663220613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6c06abf0 0x7f8f6c1512a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009870 tx=0x7f8f6001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ad4934588ecbbb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:52.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.199+0000 7f8f69d9b640 1 -- 172.21.15.53:0/1663220613 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600aa5f0 con 0x7f8f6c06abf0 2023-12-08T21:25:52.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.199+0000 7f8f69d9b640 1 -- 172.21.15.53:0/1663220613 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f600aa750 con 0x7f8f6c06abf0 2023-12-08T21:25:52.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.199+0000 7f8f69d9b640 1 -- 172.21.15.53:0/1663220613 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600aaae0 con 0x7f8f6c06abf0 2023-12-08T21:25:52.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.199+0000 7f8f711ce640 1 -- 172.21.15.53:0/1663220613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6c06abf0 msgr2=0x7f8f6c1512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.199+0000 7f8f711ce640 1 --2- 172.21.15.53:0/1663220613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6c06abf0 0x7f8f6c1512a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009870 tx=0x7f8f6001c4d0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.199+0000 7f8f711ce640 1 -- 172.21.15.53:0/1663220613 shutdown_connections 2023-12-08T21:25:52.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.199+0000 7f8f711ce640 1 --2- 172.21.15.53:0/1663220613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c06bb30 0x7f8f6c1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.199+0000 7f8f711ce640 1 --2- 172.21.15.53:0/1663220613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6c06abf0 0x7f8f6c1512a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.199+0000 7f8f711ce640 1 -- 172.21.15.53:0/1663220613 >> 172.21.15.53:0/1663220613 conn(0x7f8f6c0c7f70 msgr2=0x7f8f6c0c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:52.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.199+0000 7f8f711ce640 1 -- 172.21.15.53:0/1663220613 shutdown_connections 2023-12-08T21:25:52.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.199+0000 7f8f711ce640 1 -- 172.21.15.53:0/1663220613 wait complete. 2023-12-08T21:25:52.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.203+0000 7f8f711ce640 1 Processor -- start 2023-12-08T21:25:52.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.203+0000 7f8f711ce640 1 -- start start 2023-12-08T21:25:52.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.203+0000 7f8f711ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6c06a810 0x7f8f6c1434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.203+0000 7f8f711ce640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c06abf0 0x7f8f6c1512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.203+0000 7f8f711ce640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f6c06bb30 0x7f8f6c133ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.203+0000 7f8f711ce640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c152d00 con 0x7f8f6c06a810 2023-12-08T21:25:52.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.203+0000 7f8f711ce640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c152fc0 con 0x7f8f6c06bb30 2023-12-08T21:25:52.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.203+0000 7f8f711ce640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0c4630 con 0x7f8f6c06abf0 2023-12-08T21:25:52.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.203+0000 7f8f6a59c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c06abf0 0x7f8f6c1512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.207+0000 7f8f6a59c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c06abf0 0x7f8f6c1512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:58410/0 (socket says 172.21.15.53:58410) 2023-12-08T21:25:52.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.207+0000 7f8f6a59c640 1 -- 172.21.15.53:0/3728554099 learned_addr learned my addr 172.21.15.53:0/3728554099 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:52.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.207+0000 7f8f6b59e640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f6c06bb30 0x7f8f6c133ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.207+0000 7f8f6ad9d640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6c06a810 0x7f8f6c1434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.211+0000 7f8f6ad9d640 1 -- 172.21.15.53:0/3728554099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c06abf0 msgr2=0x7f8f6c1512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.211+0000 7f8f6ad9d640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c06abf0 0x7f8f6c1512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.211+0000 7f8f6ad9d640 1 -- 172.21.15.53:0/3728554099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f6c06bb30 msgr2=0x7f8f6c133ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.211+0000 7f8f6ad9d640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f6c06bb30 0x7f8f6c133ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.211+0000 7f8f6ad9d640 1 -- 172.21.15.53:0/3728554099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f600094d0 con 0x7f8f6c06a810 2023-12-08T21:25:52.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.215+0000 7f8f6ad9d640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6c06a810 0x7f8f6c1434a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00b440 tx=0x7f8f5c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.219+0000 7f8f537fe640 1 -- 172.21.15.53:0/3728554099 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c011830 con 0x7f8f6c06a810 2023-12-08T21:25:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.219+0000 7f8f537fe640 1 -- 172.21.15.53:0/3728554099 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0119b0 con 0x7f8f6c06a810 2023-12-08T21:25:52.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.219+0000 7f8f537fe640 1 -- 172.21.15.53:0/3728554099 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c011d60 con 0x7f8f6c06a810 2023-12-08T21:25:52.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.219+0000 7f8f711ce640 1 -- 172.21.15.53:0/3728554099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c153230 con 0x7f8f6c06a810 2023-12-08T21:25:52.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.219+0000 7f8f711ce640 1 -- 172.21.15.53:0/3728554099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c1537f0 con 0x7f8f6c06a810 2023-12-08T21:25:52.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.219+0000 7f8f711ce640 1 -- 172.21.15.53:0/3728554099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c074190 con 0x7f8f6c06a810 2023-12-08T21:25:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.243+0000 7f8f537fe640 1 -- 172.21.15.53:0/3728554099 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f5c01a400 con 0x7f8f6c06a810 2023-12-08T21:25:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.243+0000 7f8f537fe640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8f580664c0 0x7f8f58068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.243+0000 7f8f6a59c640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8f580664c0 0x7f8f58068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.243+0000 7f8f6a59c640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8f580664c0 0x7f8f58068980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8f6001c510 tx=0x7f8f600b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:52.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.531+0000 7f8f537fe640 1 -- 172.21.15.53:0/3728554099 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f8f5c0555f0 con 0x7f8f6c06a810 2023-12-08T21:25:52.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.531+0000 7f8f537fe640 1 -- 172.21.15.53:0/3728554099 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f5c051930 con 0x7f8f6c06a810 2023-12-08T21:25:52.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.707+0000 7f8f711ce640 1 -- 172.21.15.53:0/3728554099 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f6c158200 con 0x7f8f580664c0 2023-12-08T21:25:52.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.707+0000 7f8f537fe640 1 -- 172.21.15.53:0/3728554099 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8f600aa9c0 con 0x7f8f580664c0 2023-12-08T21:25:52.706 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 4 to deep-scrub 2023-12-08T21:25:52.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.707+0000 7f8f711ce640 1 -- 172.21.15.53:0/3728554099 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8f580664c0 msgr2=0x7f8f58068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.707+0000 7f8f711ce640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8f580664c0 0x7f8f58068980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8f6001c510 tx=0x7f8f600b5040 comp rx=0 tx=0).stop 2023-12-08T21:25:52.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.707+0000 7f8f711ce640 1 -- 172.21.15.53:0/3728554099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6c06a810 msgr2=0x7f8f6c1434a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.707+0000 7f8f711ce640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6c06a810 0x7f8f6c1434a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00b440 tx=0x7f8f5c00b900 comp rx=0 tx=0).stop 2023-12-08T21:25:52.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.707+0000 7f8f711ce640 1 -- 172.21.15.53:0/3728554099 shutdown_connections 2023-12-08T21:25:52.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.707+0000 7f8f711ce640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8f580664c0 0x7f8f58068980 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.707+0000 7f8f711ce640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f6c06bb30 0x7f8f6c133ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.707+0000 7f8f711ce640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f6c06abf0 0x7f8f6c1512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.707+0000 7f8f711ce640 1 --2- 172.21.15.53:0/3728554099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6c06a810 0x7f8f6c1434a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.707+0000 7f8f711ce640 1 -- 172.21.15.53:0/3728554099 >> 172.21.15.53:0/3728554099 conn(0x7f8f6c0c7f70 msgr2=0x7f8f6c0c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:52.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.711+0000 7f8f711ce640 1 -- 172.21.15.53:0/3728554099 shutdown_connections 2023-12-08T21:25:52.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.711+0000 7f8f711ce640 1 -- 172.21.15.53:0/3728554099 wait complete. 2023-12-08T21:25:52.727 INFO:tasks.ceph:Scrubbing osd.5 2023-12-08T21:25:52.727 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-08T21:25:52.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.859+0000 7f0296260640 1 Processor -- start 2023-12-08T21:25:52.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.859+0000 7f0296260640 1 -- start start 2023-12-08T21:25:52.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.859+0000 7f0296260640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0290150520 0x7f02900c5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.859+0000 7f0296260640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f02900c1c20 0x7f029006cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.859+0000 7f0296260640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02900c5ef0 con 0x7f0290150900 2023-12-08T21:25:52.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.859+0000 7f0296260640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02900c0790 con 0x7f0290150520 2023-12-08T21:25:52.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.859+0000 7f0296260640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02900c7810 con 0x7f02900c1c20 2023-12-08T21:25:52.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.859+0000 7f028effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0290150900 0x7f0290159920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40874/0 (socket says 172.21.15.53:40874) 2023-12-08T21:25:52.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.859+0000 7f028effd640 1 -- 172.21.15.53:0/4156399395 learned_addr learned my addr 172.21.15.53:0/4156399395 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:52.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.863+0000 7f028f7fe640 1 --2- 172.21.15.53:0/4156399395 >> v2:172.21.15.53:3300/0 conn(0x7f0290150520 0x7f02900c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.863+0000 7f028ffff640 1 --2- 172.21.15.53:0/4156399395 >> v2:172.21.15.146:3300/0 conn(0x7f02900c1c20 0x7f029006cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.863+0000 7f028f7fe640 1 -- 172.21.15.53:0/4156399395 >> v2:172.21.15.146:3300/0 conn(0x7f02900c1c20 msgr2=0x7f029006cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:52.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.863+0000 7f028f7fe640 1 --2- 172.21.15.53:0/4156399395 >> v2:172.21.15.146:3300/0 conn(0x7f02900c1c20 0x7f029006cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.863+0000 7f028f7fe640 1 -- 172.21.15.53:0/4156399395 >> v1:172.21.15.53:6789/0 conn(0x7f0290150900 legacy=0x7f0290159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.863+0000 7f028f7fe640 1 -- 172.21.15.53:0/4156399395 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02900bffb0 con 0x7f0290150520 2023-12-08T21:25:52.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.871+0000 7f028f7fe640 1 --2- 172.21.15.53:0/4156399395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0290150520 0x7f02900c5880 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f02900cbd60 tx=0x7f027801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717d5f1b75ea4d1b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:52.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.875+0000 7f028e7fc640 1 -- 172.21.15.53:0/4156399395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02780a8950 con 0x7f0290150520 2023-12-08T21:25:52.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.875+0000 7f028e7fc640 1 -- 172.21.15.53:0/4156399395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02780a8ab0 con 0x7f0290150520 2023-12-08T21:25:52.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.875+0000 7f028e7fc640 1 -- 172.21.15.53:0/4156399395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02780a8e40 con 0x7f0290150520 2023-12-08T21:25:52.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 -- 172.21.15.53:0/4156399395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0290150520 msgr2=0x7f02900c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 --2- 172.21.15.53:0/4156399395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0290150520 0x7f02900c5880 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f02900cbd60 tx=0x7f027801ec50 comp rx=0 tx=0).stop 2023-12-08T21:25:52.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 -- 172.21.15.53:0/4156399395 shutdown_connections 2023-12-08T21:25:52.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 --2- 172.21.15.53:0/4156399395 >> v2:172.21.15.146:3300/0 conn(0x7f02900c1c20 0x7f029006cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 --2- 172.21.15.53:0/4156399395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0290150520 0x7f02900c5880 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 -- 172.21.15.53:0/4156399395 >> 172.21.15.53:0/4156399395 conn(0x7f029006ab80 msgr2=0x7f02900cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:52.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 -- 172.21.15.53:0/4156399395 shutdown_connections 2023-12-08T21:25:52.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 -- 172.21.15.53:0/4156399395 wait complete. 2023-12-08T21:25:52.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 Processor -- start 2023-12-08T21:25:52.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 -- start start 2023-12-08T21:25:52.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02900c1c20 0x7f02900c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0290150520 0x7f02901efd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0290150900 0x7f0290070de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02901563d0 con 0x7f02900c1c20 2023-12-08T21:25:52.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02901ef8e0 con 0x7f0290150900 2023-12-08T21:25:52.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.879+0000 7f0296260640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02901515e0 con 0x7f0290150520 2023-12-08T21:25:52.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.883+0000 7f028effd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0290150520 0x7f02901efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.883+0000 7f028f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02900c1c20 0x7f02900c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.883+0000 7f028f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02900c1c20 0x7f02900c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59334/0 (socket says 172.21.15.53:59334) 2023-12-08T21:25:52.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.883+0000 7f028f7fe640 1 -- 172.21.15.53:0/2116073702 learned_addr learned my addr 172.21.15.53:0/2116073702 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:52.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.883+0000 7f028ffff640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0290150900 0x7f0290070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.887+0000 7f028f7fe640 1 -- 172.21.15.53:0/2116073702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0290150520 msgr2=0x7f02901efd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.887+0000 7f028f7fe640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0290150520 0x7f02901efd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.887+0000 7f028f7fe640 1 -- 172.21.15.53:0/2116073702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0290150900 msgr2=0x7f0290070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.887+0000 7f028f7fe640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0290150900 0x7f0290070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.887+0000 7f028f7fe640 1 -- 172.21.15.53:0/2116073702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0278009420 con 0x7f02900c1c20 2023-12-08T21:25:52.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.887+0000 7f028f7fe640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02900c1c20 0x7f02900c24e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f027801c880 tx=0x7f027801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:52.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.895+0000 7f0287fff640 1 -- 172.21.15.53:0/2116073702 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02780b0dd0 con 0x7f02900c1c20 2023-12-08T21:25:52.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.895+0000 7f0287fff640 1 -- 172.21.15.53:0/2116073702 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02780b9430 con 0x7f02900c1c20 2023-12-08T21:25:52.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.895+0000 7f0287fff640 1 -- 172.21.15.53:0/2116073702 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02780b97e0 con 0x7f02900c1c20 2023-12-08T21:25:52.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.895+0000 7f0296260640 1 -- 172.21.15.53:0/2116073702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02901ef590 con 0x7f02900c1c20 2023-12-08T21:25:52.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.895+0000 7f0296260640 1 -- 172.21.15.53:0/2116073702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0290156620 con 0x7f02900c1c20 2023-12-08T21:25:52.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.895+0000 7f0296260640 1 -- 172.21.15.53:0/2116073702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f029006df30 con 0x7f02900c1c20 2023-12-08T21:25:52.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.915+0000 7f0287fff640 1 -- 172.21.15.53:0/2116073702 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f02780b7040 con 0x7f02900c1c20 2023-12-08T21:25:52.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.919+0000 7f0287fff640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0270066470 0x7f0270068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.919+0000 7f028effd640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0270066470 0x7f0270068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.919+0000 7f028effd640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0270066470 0x7f0270068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f029006e5c0 tx=0x7f0280009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:52.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.923+0000 7f0287fff640 1 -- 172.21.15.53:0/2116073702 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f02780f3e50 con 0x7f02900c1c20 2023-12-08T21:25:52.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.923+0000 7f0287fff640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] conn(0x7f027006f9f0 0x7f0270071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:52.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.923+0000 7f0287fff640 1 -- 172.21.15.53:0/2116073702 --> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0270072540 con 0x7f027006f9f0 2023-12-08T21:25:52.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.923+0000 7f0287fff640 1 -- 172.21.15.53:0/2116073702 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02780efa90 con 0x7f02900c1c20 2023-12-08T21:25:52.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.923+0000 7f028ffff640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] conn(0x7f027006f9f0 0x7f0270071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:52.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.923+0000 7f028ffff640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] conn(0x7f027006f9f0 0x7f0270071e70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:52.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.927+0000 7f0287fff640 1 -- 172.21.15.53:0/2116073702 <== osd.5 v2:172.21.15.146:6808/2662713833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0270072540 con 0x7f027006f9f0 2023-12-08T21:25:52.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f0296260640 1 -- 172.21.15.53:0/2116073702 --> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f02900c04f0 con 0x7f027006f9f0 2023-12-08T21:25:52.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f0287fff640 1 -- 172.21.15.53:0/2116073702 <== osd.5 v2:172.21.15.146:6808/2662713833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f02880039a0 con 0x7f027006f9f0 2023-12-08T21:25:52.940 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-12-08T21:25:52.940 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T21:25:52.940 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-12-08T21:25:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f0296260640 1 -- 172.21.15.53:0/2116073702 >> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] conn(0x7f027006f9f0 msgr2=0x7f0270071e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f0296260640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.146:6808/2662713833,v1:172.21.15.146:6809/2662713833] conn(0x7f027006f9f0 0x7f0270071e70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f0296260640 1 -- 172.21.15.53:0/2116073702 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0270066470 msgr2=0x7f0270068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f0296260640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f0270066470 0x7f0270068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f029006e5c0 tx=0x7f0280009040 comp rx=0 tx=0).stop 2023-12-08T21:25:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f0296260640 1 -- 172.21.15.53:0/2116073702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02900c1c20 msgr2=0x7f02900c24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f0296260640 1 --2- 172.21.15.53:0/2116073702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02900c1c20 0x7f02900c24e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f027801c880 tx=0x7f027801b9f0 comp rx=0 tx=0).stop 2023-12-08T21:25:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f028ffff640 1 -- 172.21.15.53:0/2116073702 reap_dead start 2023-12-08T21:25:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f0296260640 1 -- 172.21.15.53:0/2116073702 shutdown_connections 2023-12-08T21:25:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f0296260640 1 -- 172.21.15.53:0/2116073702 >> 172.21.15.53:0/2116073702 conn(0x7f029006ab80 msgr2=0x7f029014f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f0296260640 1 -- 172.21.15.53:0/2116073702 shutdown_connections 2023-12-08T21:25:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:52.939+0000 7f0296260640 1 -- 172.21.15.53:0/2116073702 wait complete. 2023-12-08T21:25:52.958 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-08T21:25:53.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.079+0000 7f133a2e0640 1 Processor -- start 2023-12-08T21:25:53.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.079+0000 7f133a2e0640 1 -- start start 2023-12-08T21:25:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.079+0000 7f133a2e0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1334153960 0x7f133406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.079+0000 7f133a2e0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1334159610 con 0x7f13340c2de0 2023-12-08T21:25:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.079+0000 7f133a2e0640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1334153d40 con 0x7f133406edd0 2023-12-08T21:25:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.079+0000 7f133a2e0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13341598d0 con 0x7f1334153960 2023-12-08T21:25:53.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.083+0000 7f1333fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1334153960 0x7f133406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:53.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.083+0000 7f1333fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1334153960 0x7f133406a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:52394/0 (socket says 172.21.15.53:52394) 2023-12-08T21:25:53.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.083+0000 7f1333fff640 1 -- 172.21.15.53:0/306984891 learned_addr learned my addr 172.21.15.53:0/306984891 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.095+0000 7f1333fff640 1 -- 172.21.15.53:0/306984891 >> v1:172.21.15.146:6789/0 conn(0x7f133406edd0 legacy=0x7f133415cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.095+0000 7f1333fff640 1 -- 172.21.15.53:0/306984891 >> v1:172.21.15.53:6789/0 conn(0x7f13340c2de0 legacy=0x7f1334163f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.095+0000 7f1333fff640 1 -- 172.21.15.53:0/306984891 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1334159bb0 con 0x7f1334153960 2023-12-08T21:25:53.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.103+0000 7f1333fff640 1 --2- 172.21.15.53:0/306984891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1334153960 0x7f133406a5b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f131c009870 tx=0x7f131c01ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f065e7e9a325d21 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:53.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.115+0000 7f13337fe640 1 -- 172.21.15.53:0/306984891 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c0a89f0 con 0x7f1334153960 2023-12-08T21:25:53.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.115+0000 7f13337fe640 1 -- 172.21.15.53:0/306984891 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c0a8b50 con 0x7f1334153960 2023-12-08T21:25:53.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.115+0000 7f13337fe640 1 -- 172.21.15.53:0/306984891 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c0b0440 con 0x7f1334153960 2023-12-08T21:25:53.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.115+0000 7f133a2e0640 1 -- 172.21.15.53:0/306984891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1334153960 msgr2=0x7f133406a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:53.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.115+0000 7f133a2e0640 1 --2- 172.21.15.53:0/306984891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1334153960 0x7f133406a5b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f131c009870 tx=0x7f131c01ecf0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.115+0000 7f133a2e0640 1 -- 172.21.15.53:0/306984891 shutdown_connections 2023-12-08T21:25:53.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.115+0000 7f133a2e0640 1 --2- 172.21.15.53:0/306984891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1334153960 0x7f133406a5b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.115+0000 7f133a2e0640 1 -- 172.21.15.53:0/306984891 >> 172.21.15.53:0/306984891 conn(0x7f13340c8a00 msgr2=0x7f13340c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:53.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.115+0000 7f133a2e0640 1 -- 172.21.15.53:0/306984891 shutdown_connections 2023-12-08T21:25:53.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.115+0000 7f133a2e0640 1 -- 172.21.15.53:0/306984891 wait complete. 2023-12-08T21:25:53.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.115+0000 7f133a2e0640 1 Processor -- start 2023-12-08T21:25:53.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.115+0000 7f133a2e0640 1 -- start start 2023-12-08T21:25:53.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.119+0000 7f133a2e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f133406edd0 0x7f1334154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:53.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.119+0000 7f133a2e0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13340c2de0 0x7f13341552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:53.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.119+0000 7f133a2e0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1334153960 0x7f1334149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:53.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.119+0000 7f133a2e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133406bd40 con 0x7f133406edd0 2023-12-08T21:25:53.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.119+0000 7f133a2e0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1334154020 con 0x7f13340c2de0 2023-12-08T21:25:53.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.119+0000 7f133a2e0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13341efe70 con 0x7f1334153960 2023-12-08T21:25:53.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.119+0000 7f133887d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1334153960 0x7f1334149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:53.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.119+0000 7f133887d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1334153960 0x7f1334149680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:58418/0 (socket says 172.21.15.53:58418) 2023-12-08T21:25:53.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.119+0000 7f133887d640 1 -- 172.21.15.53:0/1492577481 learned_addr learned my addr 172.21.15.53:0/1492577481 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:53.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.119+0000 7f132bfff640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13340c2de0 0x7f13341552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.135+0000 7f133887d640 1 -- 172.21.15.53:0/1492577481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13340c2de0 msgr2=0x7f13341552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.135+0000 7f133887d640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13340c2de0 0x7f13341552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.135+0000 7f133887d640 1 -- 172.21.15.53:0/1492577481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f133406edd0 msgr2=0x7f1334154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.135+0000 7f133887d640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f133406edd0 0x7f1334154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.135+0000 7f133887d640 1 -- 172.21.15.53:0/1492577481 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c0094d0 con 0x7f1334153960 2023-12-08T21:25:53.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.143+0000 7f133887d640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1334153960 0x7f1334149680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f132c00c780 tx=0x7f132c00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:53.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.151+0000 7f13317fa640 1 -- 172.21.15.53:0/1492577481 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c003d90 con 0x7f1334153960 2023-12-08T21:25:53.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.151+0000 7f13317fa640 1 -- 172.21.15.53:0/1492577481 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c00ce30 con 0x7f1334153960 2023-12-08T21:25:53.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.151+0000 7f13317fa640 1 -- 172.21.15.53:0/1492577481 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c005290 con 0x7f1334153960 2023-12-08T21:25:53.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.151+0000 7f133a2e0640 1 -- 172.21.15.53:0/1492577481 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13341542c0 con 0x7f1334153960 2023-12-08T21:25:53.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.151+0000 7f133a2e0640 1 -- 172.21.15.53:0/1492577481 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1334154880 con 0x7f1334153960 2023-12-08T21:25:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.155+0000 7f133a2e0640 1 -- 172.21.15.53:0/1492577481 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1334154aa0 con 0x7f1334153960 2023-12-08T21:25:53.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.495+0000 7f13317fa640 1 -- 172.21.15.53:0/1492577481 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f132c0053f0 con 0x7f1334153960 2023-12-08T21:25:53.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.495+0000 7f13317fa640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f13140664c0 0x7f1314068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:53.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.495+0000 7f1333fff640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f13140664c0 0x7f1314068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.495+0000 7f1333fff640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f13140664c0 0x7f1314068980 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f131c0b2000 tx=0x7f131c004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:53.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.583+0000 7f13317fa640 1 -- 172.21.15.53:0/1492577481 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f132c054d00 con 0x7f1334153960 2023-12-08T21:25:53.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.615+0000 7f13317fa640 1 -- 172.21.15.53:0/1492577481 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f132c051040 con 0x7f1334153960 2023-12-08T21:25:53.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.787+0000 7f133a2e0640 1 -- 172.21.15.53:0/1492577481 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f133415a170 con 0x7f13140664c0 2023-12-08T21:25:53.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f13317fa640 1 -- 172.21.15.53:0/1492577481 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f131c0a8910 con 0x7f13140664c0 2023-12-08T21:25:53.789 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 5 to deep-scrub 2023-12-08T21:25:53.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f133a2e0640 1 -- 172.21.15.53:0/1492577481 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f13140664c0 msgr2=0x7f1314068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:53.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f133a2e0640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f13140664c0 0x7f1314068980 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f131c0b2000 tx=0x7f131c004740 comp rx=0 tx=0).stop 2023-12-08T21:25:53.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f133a2e0640 1 -- 172.21.15.53:0/1492577481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1334153960 msgr2=0x7f1334149680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:53.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f133a2e0640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1334153960 0x7f1334149680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f132c00c780 tx=0x7f132c00cc40 comp rx=0 tx=0).stop 2023-12-08T21:25:53.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f133a2e0640 1 -- 172.21.15.53:0/1492577481 shutdown_connections 2023-12-08T21:25:53.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f133a2e0640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f13140664c0 0x7f1314068980 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f133a2e0640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1334153960 0x7f1334149680 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f133a2e0640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13340c2de0 0x7f13341552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f133a2e0640 1 --2- 172.21.15.53:0/1492577481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f133406edd0 0x7f1334154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f133a2e0640 1 -- 172.21.15.53:0/1492577481 >> 172.21.15.53:0/1492577481 conn(0x7f13340c8a00 msgr2=0x7f1334157480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:53.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f133a2e0640 1 -- 172.21.15.53:0/1492577481 shutdown_connections 2023-12-08T21:25:53.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.791+0000 7f133a2e0640 1 -- 172.21.15.53:0/1492577481 wait complete. 2023-12-08T21:25:53.809 INFO:tasks.ceph:Scrubbing osd.6 2023-12-08T21:25:53.810 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-08T21:25:53.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.943+0000 7efcc7e4b640 1 Processor -- start 2023-12-08T21:25:53.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.943+0000 7efcc7e4b640 1 -- start start 2023-12-08T21:25:53.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.947+0000 7efcc7e4b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc0151910 0x7efcc015aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:53.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.947+0000 7efcc7e4b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efcc00c6c70 0x7efcc0070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:53.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.947+0000 7efcc7e4b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc006e6d0 con 0x7efcc00c4de0 2023-12-08T21:25:53.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.947+0000 7efcc7e4b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc006e990 con 0x7efcc00c6c70 2023-12-08T21:25:53.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.947+0000 7efcc7e4b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc006ec70 con 0x7efcc0151910 2023-12-08T21:25:53.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.947+0000 7efcc63e8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efcc00c4de0 0x7efcc00722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40898/0 (socket says 172.21.15.53:40898) 2023-12-08T21:25:53.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.947+0000 7efcc63e8640 1 -- 172.21.15.53:0/3897868284 learned_addr learned my addr 172.21.15.53:0/3897868284 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:53.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.947+0000 7efcc53e6640 1 --2- 172.21.15.53:0/3897868284 >> v2:172.21.15.53:3300/0 conn(0x7efcc00c6c70 0x7efcc0070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:53.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.947+0000 7efcc5be7640 1 --2- 172.21.15.53:0/3897868284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc0151910 0x7efcc015aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:53.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.951+0000 7efcc4be5640 1 -- 172.21.15.53:0/3897868284 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440087376 0 0) 0x7efcc006e6d0 con 0x7efcc00c4de0 2023-12-08T21:25:53.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.951+0000 7efcc4be5640 1 -- 172.21.15.53:0/3897868284 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcac003530 con 0x7efcc00c4de0 2023-12-08T21:25:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.951+0000 7efcc53e6640 1 -- 172.21.15.53:0/3897868284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc0151910 msgr2=0x7efcc015aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.951+0000 7efcc53e6640 1 --2- 172.21.15.53:0/3897868284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc0151910 0x7efcc015aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.951+0000 7efcc53e6640 1 -- 172.21.15.53:0/3897868284 >> v1:172.21.15.53:6789/0 conn(0x7efcc00c4de0 legacy=0x7efcc00722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.951+0000 7efcc53e6640 1 -- 172.21.15.53:0/3897868284 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc006ef50 con 0x7efcc00c6c70 2023-12-08T21:25:53.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.963+0000 7efcc53e6640 1 --2- 172.21.15.53:0/3897868284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00c6c70 0x7efcc0070de0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efcb00097c0 tx=0x7efcb001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cf596820b15a2a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:53.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc4be5640 1 -- 172.21.15.53:0/3897868284 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00a8970 con 0x7efcc00c6c70 2023-12-08T21:25:53.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc4be5640 1 -- 172.21.15.53:0/3897868284 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb00a8ad0 con 0x7efcc00c6c70 2023-12-08T21:25:53.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc4be5640 1 -- 172.21.15.53:0/3897868284 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00a8e60 con 0x7efcc00c6c70 2023-12-08T21:25:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc7e4b640 1 -- 172.21.15.53:0/3897868284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00c6c70 msgr2=0x7efcc0070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc7e4b640 1 --2- 172.21.15.53:0/3897868284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00c6c70 0x7efcc0070de0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efcb00097c0 tx=0x7efcb001ec70 comp rx=0 tx=0).stop 2023-12-08T21:25:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc7e4b640 1 -- 172.21.15.53:0/3897868284 shutdown_connections 2023-12-08T21:25:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc7e4b640 1 --2- 172.21.15.53:0/3897868284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00c6c70 0x7efcc0070de0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc7e4b640 1 --2- 172.21.15.53:0/3897868284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc0151910 0x7efcc015aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc7e4b640 1 -- 172.21.15.53:0/3897868284 >> 172.21.15.53:0/3897868284 conn(0x7efcc006ab80 msgr2=0x7efcc00cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc7e4b640 1 -- 172.21.15.53:0/3897868284 shutdown_connections 2023-12-08T21:25:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc7e4b640 1 -- 172.21.15.53:0/3897868284 wait complete. 2023-12-08T21:25:53.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc7e4b640 1 Processor -- start 2023-12-08T21:25:53.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.967+0000 7efcc7e4b640 1 -- start start 2023-12-08T21:25:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.971+0000 7efcc7e4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00c4de0 0x7efcc01e0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.971+0000 7efcc7e4b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc00c6c70 0x7efcc01ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.971+0000 7efcc7e4b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc0151910 0x7efcc0152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.971+0000 7efcc7e4b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc01531f0 con 0x7efcc00c4de0 2023-12-08T21:25:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.971+0000 7efcc7e4b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc01ecc60 con 0x7efcc0151910 2023-12-08T21:25:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.971+0000 7efcc7e4b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc01ed1e0 con 0x7efcc00c6c70 2023-12-08T21:25:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.971+0000 7efcc5be7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00c4de0 0x7efcc01e0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:53.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.971+0000 7efcc5be7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00c4de0 0x7efcc01e0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59344/0 (socket says 172.21.15.53:59344) 2023-12-08T21:25:53.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.971+0000 7efcc5be7640 1 -- 172.21.15.53:0/2302079592 learned_addr learned my addr 172.21.15.53:0/2302079592 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:53.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.971+0000 7efcc53e6640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc00c6c70 0x7efcc01ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:53.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.971+0000 7efcc63e8640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc0151910 0x7efcc0152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:53.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.975+0000 7efcc5be7640 1 -- 172.21.15.53:0/2302079592 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc00c6c70 msgr2=0x7efcc01ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:53.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.975+0000 7efcc5be7640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc00c6c70 0x7efcc01ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.975+0000 7efcc5be7640 1 -- 172.21.15.53:0/2302079592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc0151910 msgr2=0x7efcc0152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:53.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.975+0000 7efcc5be7640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc0151910 0x7efcc0152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:53.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.975+0000 7efcc5be7640 1 -- 172.21.15.53:0/2302079592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0009420 con 0x7efcc00c4de0 2023-12-08T21:25:53.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.975+0000 7efcc5be7640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00c4de0 0x7efcc01e0150 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00efc0 tx=0x7efcbc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:53.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.979+0000 7efcb67fc640 1 -- 172.21.15.53:0/2302079592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc009b80 con 0x7efcc00c4de0 2023-12-08T21:25:53.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.979+0000 7efcb67fc640 1 -- 172.21.15.53:0/2302079592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc00f040 con 0x7efcc00c4de0 2023-12-08T21:25:53.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.979+0000 7efcb67fc640 1 -- 172.21.15.53:0/2302079592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc0146a0 con 0x7efcc00c4de0 2023-12-08T21:25:53.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.979+0000 7efcc7e4b640 1 -- 172.21.15.53:0/2302079592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc00c86e0 con 0x7efcc00c4de0 2023-12-08T21:25:53.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.979+0000 7efcc7e4b640 1 -- 172.21.15.53:0/2302079592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc01edbb0 con 0x7efcc00c4de0 2023-12-08T21:25:53.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:53.983+0000 7efcc7e4b640 1 -- 172.21.15.53:0/2302079592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efcc00c6750 con 0x7efcc00c4de0 2023-12-08T21:25:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.007+0000 7efcb67fc640 1 -- 172.21.15.53:0/2302079592 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efcbc014800 con 0x7efcc00c4de0 2023-12-08T21:25:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.007+0000 7efcb67fc640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efca40664f0 0x7efca40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.007+0000 7efcc53e6640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efca40664f0 0x7efca40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.007+0000 7efcc53e6640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efca40664f0 0x7efca40689b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efcb00b2000 tx=0x7efcb00aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:54.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.011+0000 7efcb67fc640 1 -- 172.21.15.53:0/2302079592 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7efcbc0561a0 con 0x7efcc00c4de0 2023-12-08T21:25:54.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.011+0000 7efcb67fc640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] conn(0x7efca406fb70 0x7efca4071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.011+0000 7efcb67fc640 1 -- 172.21.15.53:0/2302079592 --> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efca40726c0 con 0x7efca406fb70 2023-12-08T21:25:54.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.011+0000 7efcb67fc640 1 -- 172.21.15.53:0/2302079592 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcbc0524e0 con 0x7efcc00c4de0 2023-12-08T21:25:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.011+0000 7efcc63e8640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] conn(0x7efca406fb70 0x7efca4071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.015+0000 7efcc63e8640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] conn(0x7efca406fb70 0x7efca4071ff0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:54.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.015+0000 7efcb67fc640 1 -- 172.21.15.53:0/2302079592 <== osd.6 v2:172.21.15.146:6824/3215046611 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efca40726c0 con 0x7efca406fb70 2023-12-08T21:25:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcc7e4b640 1 -- 172.21.15.53:0/2302079592 --> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efcc00c6470 con 0x7efca406fb70 2023-12-08T21:25:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcb67fc640 1 -- 172.21.15.53:0/2302079592 <== osd.6 v2:172.21.15.146:6824/3215046611 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efcb8006af0 con 0x7efca406fb70 2023-12-08T21:25:54.030 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-12-08T21:25:54.031 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T21:25:54.031 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-12-08T21:25:54.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcc7e4b640 1 -- 172.21.15.53:0/2302079592 >> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] conn(0x7efca406fb70 msgr2=0x7efca4071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcc7e4b640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.146:6824/3215046611,v1:172.21.15.146:6825/3215046611] conn(0x7efca406fb70 0x7efca4071ff0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcc7e4b640 1 -- 172.21.15.53:0/2302079592 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efca40664f0 msgr2=0x7efca40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcc7e4b640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efca40664f0 0x7efca40689b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efcb00b2000 tx=0x7efcb00aa070 comp rx=0 tx=0).stop 2023-12-08T21:25:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcc7e4b640 1 -- 172.21.15.53:0/2302079592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00c4de0 msgr2=0x7efcc01e0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcc7e4b640 1 --2- 172.21.15.53:0/2302079592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00c4de0 0x7efcc01e0150 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00efc0 tx=0x7efcbc00c490 comp rx=0 tx=0).stop 2023-12-08T21:25:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcc63e8640 1 -- 172.21.15.53:0/2302079592 reap_dead start 2023-12-08T21:25:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcc7e4b640 1 -- 172.21.15.53:0/2302079592 shutdown_connections 2023-12-08T21:25:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcc7e4b640 1 -- 172.21.15.53:0/2302079592 >> 172.21.15.53:0/2302079592 conn(0x7efcc006ab80 msgr2=0x7efcc0158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcc7e4b640 1 -- 172.21.15.53:0/2302079592 shutdown_connections 2023-12-08T21:25:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.031+0000 7efcc7e4b640 1 -- 172.21.15.53:0/2302079592 wait complete. 2023-12-08T21:25:54.051 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-08T21:25:54.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.183+0000 7f3bb9762640 1 Processor -- start 2023-12-08T21:25:54.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.183+0000 7f3bb9762640 1 -- start start 2023-12-08T21:25:54.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.183+0000 7f3bb9762640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3bb40c6ff0 0x7f3bb41558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.183+0000 7f3bb9762640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3bb40c0e50 0x7f3bb40c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.183+0000 7f3bb9762640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb40c62c0 con 0x7f3bb414fd00 2023-12-08T21:25:54.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.183+0000 7f3bb9762640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb41500e0 con 0x7f3bb40c6ff0 2023-12-08T21:25:54.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.183+0000 7f3bb9762640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb40c6b60 con 0x7f3bb40c0e50 2023-12-08T21:25:54.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.183+0000 7f3bb27fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3bb40c6ff0 0x7f3bb41558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:54.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.183+0000 7f3bb27fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3bb40c6ff0 0x7f3bb41558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59360/0 (socket says 172.21.15.53:59360) 2023-12-08T21:25:54.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.183+0000 7f3bb27fc640 1 -- 172.21.15.53:0/16956526 learned_addr learned my addr 172.21.15.53:0/16956526 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:54.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.183+0000 7f3bb37fe640 1 --2- 172.21.15.53:0/16956526 >> v2:172.21.15.146:3300/0 conn(0x7f3bb40c0e50 0x7f3bb40c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:54.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.187+0000 7f3bb27fc640 1 -- 172.21.15.53:0/16956526 >> v2:172.21.15.146:3300/0 conn(0x7f3bb40c0e50 msgr2=0x7f3bb40c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:54.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.187+0000 7f3bb27fc640 1 --2- 172.21.15.53:0/16956526 >> v2:172.21.15.146:3300/0 conn(0x7f3bb40c0e50 0x7f3bb40c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.187+0000 7f3bb27fc640 1 -- 172.21.15.53:0/16956526 >> v1:172.21.15.146:6789/0 conn(0x7f3bb414fd00 legacy=0x7f3bb4071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:54.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.187+0000 7f3bb27fc640 1 -- 172.21.15.53:0/16956526 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40c1970 con 0x7f3bb40c6ff0 2023-12-08T21:25:54.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.191+0000 7f3bb27fc640 1 --2- 172.21.15.53:0/16956526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bb40c6ff0 0x7f3bb41558c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3bb406b4c0 tx=0x7f3ba801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56664a03d172d061 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:54.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb1ffb640 1 -- 172.21.15.53:0/16956526 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba80ab610 con 0x7f3bb40c6ff0 2023-12-08T21:25:54.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb1ffb640 1 -- 172.21.15.53:0/16956526 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba80ab770 con 0x7f3bb40c6ff0 2023-12-08T21:25:54.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb1ffb640 1 -- 172.21.15.53:0/16956526 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba80abb00 con 0x7f3bb40c6ff0 2023-12-08T21:25:54.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb9762640 1 -- 172.21.15.53:0/16956526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bb40c6ff0 msgr2=0x7f3bb41558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb9762640 1 --2- 172.21.15.53:0/16956526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bb40c6ff0 0x7f3bb41558c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3bb406b4c0 tx=0x7f3ba801c490 comp rx=0 tx=0).stop 2023-12-08T21:25:54.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb9762640 1 -- 172.21.15.53:0/16956526 shutdown_connections 2023-12-08T21:25:54.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb9762640 1 --2- 172.21.15.53:0/16956526 >> v2:172.21.15.146:3300/0 conn(0x7f3bb40c0e50 0x7f3bb40c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb9762640 1 --2- 172.21.15.53:0/16956526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bb40c6ff0 0x7f3bb41558c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb9762640 1 -- 172.21.15.53:0/16956526 >> 172.21.15.53:0/16956526 conn(0x7f3bb40caef0 msgr2=0x7f3bb40cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:54.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb9762640 1 -- 172.21.15.53:0/16956526 shutdown_connections 2023-12-08T21:25:54.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb9762640 1 -- 172.21.15.53:0/16956526 wait complete. 2023-12-08T21:25:54.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb9762640 1 Processor -- start 2023-12-08T21:25:54.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.195+0000 7f3bb9762640 1 -- start start 2023-12-08T21:25:54.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.199+0000 7f3bb9762640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bb40c0e50 0x7f3bb41f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.199+0000 7f3bb9762640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bb40c6ff0 0x7f3bb41f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.199+0000 7f3bb9762640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bb414fd00 0x7f3bb40c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.199+0000 7f3bb9762640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb41f4d50 con 0x7f3bb414fd00 2023-12-08T21:25:54.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.199+0000 7f3bb9762640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb414b980 con 0x7f3bb40c0e50 2023-12-08T21:25:54.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.199+0000 7f3bb9762640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb41f4f60 con 0x7f3bb40c6ff0 2023-12-08T21:25:54.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.199+0000 7f3bb37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bb414fd00 0x7f3bb40c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:54.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.199+0000 7f3bb37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bb414fd00 0x7f3bb40c2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59364/0 (socket says 172.21.15.53:59364) 2023-12-08T21:25:54.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.199+0000 7f3bb37fe640 1 -- 172.21.15.53:0/3153943242 learned_addr learned my addr 172.21.15.53:0/3153943242 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:54.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.199+0000 7f3bb27fc640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bb40c6ff0 0x7f3bb41f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:54.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.203+0000 7f3bb37fe640 1 -- 172.21.15.53:0/3153943242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bb40c6ff0 msgr2=0x7f3bb41f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.203+0000 7f3bb37fe640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bb40c6ff0 0x7f3bb41f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.203+0000 7f3bb37fe640 1 -- 172.21.15.53:0/3153943242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bb40c0e50 msgr2=0x7f3bb41f17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.203+0000 7f3bb37fe640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bb40c0e50 0x7f3bb41f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.203+0000 7f3bb37fe640 1 -- 172.21.15.53:0/3153943242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba80094d0 con 0x7f3bb414fd00 2023-12-08T21:25:54.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.207+0000 7f3bb37fe640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bb414fd00 0x7f3bb40c2220 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3bac007d80 tx=0x7f3bac00d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:54.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.215+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/3153943242 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00f040 con 0x7f3bb414fd00 2023-12-08T21:25:54.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.215+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/3153943242 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00dda0 con 0x7f3bb414fd00 2023-12-08T21:25:54.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.215+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/3153943242 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac003be0 con 0x7f3bb414fd00 2023-12-08T21:25:54.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.215+0000 7f3bb9762640 1 -- 172.21.15.53:0/3153943242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb41f5240 con 0x7f3bb414fd00 2023-12-08T21:25:54.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.215+0000 7f3bb9762640 1 -- 172.21.15.53:0/3153943242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb41f5800 con 0x7f3bb414fd00 2023-12-08T21:25:54.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.215+0000 7f3bb9762640 1 -- 172.21.15.53:0/3153943242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb41f59f0 con 0x7f3bb414fd00 2023-12-08T21:25:54.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.507+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/3153943242 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3bac003d40 con 0x7f3bb414fd00 2023-12-08T21:25:54.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.511+0000 7f3b9b7fe640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ba00664f0 0x7f3ba00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.511+0000 7f3bb2ffd640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ba00664f0 0x7f3ba00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:54.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.511+0000 7f3bb2ffd640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ba00664f0 0x7f3ba00689b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009670 tx=0x7f3ba4006bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:54.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.551+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/3153943242 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f3bac055620 con 0x7f3bb414fd00 2023-12-08T21:25:54.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.559+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/3153943242 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3bac051960 con 0x7f3bb414fd00 2023-12-08T21:25:54.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.735+0000 7f3bb9762640 1 -- 172.21.15.53:0/3153943242 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bb40675b0 con 0x7f3ba00664f0 2023-12-08T21:25:54.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.735+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/3153943242 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3bb40675b0 con 0x7f3ba00664f0 2023-12-08T21:25:54.737 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 6 to deep-scrub 2023-12-08T21:25:54.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.739+0000 7f3bb9762640 1 -- 172.21.15.53:0/3153943242 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ba00664f0 msgr2=0x7f3ba00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.739+0000 7f3bb9762640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ba00664f0 0x7f3ba00689b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009670 tx=0x7f3ba4006bd0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.739+0000 7f3bb9762640 1 -- 172.21.15.53:0/3153943242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bb414fd00 msgr2=0x7f3bb40c2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.739+0000 7f3bb9762640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bb414fd00 0x7f3bb40c2220 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3bac007d80 tx=0x7f3bac00d490 comp rx=0 tx=0).stop 2023-12-08T21:25:54.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.739+0000 7f3bb9762640 1 -- 172.21.15.53:0/3153943242 shutdown_connections 2023-12-08T21:25:54.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.739+0000 7f3bb9762640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3ba00664f0 0x7f3ba00689b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.739+0000 7f3bb9762640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bb414fd00 0x7f3bb40c2220 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.739+0000 7f3bb9762640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bb40c6ff0 0x7f3bb41f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.739+0000 7f3bb9762640 1 --2- 172.21.15.53:0/3153943242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bb40c0e50 0x7f3bb41f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.739+0000 7f3bb9762640 1 -- 172.21.15.53:0/3153943242 >> 172.21.15.53:0/3153943242 conn(0x7f3bb40caef0 msgr2=0x7f3bb40c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:54.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.739+0000 7f3bb9762640 1 -- 172.21.15.53:0/3153943242 shutdown_connections 2023-12-08T21:25:54.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.739+0000 7f3bb9762640 1 -- 172.21.15.53:0/3153943242 wait complete. 2023-12-08T21:25:54.759 INFO:tasks.ceph:Scrubbing osd.7 2023-12-08T21:25:54.759 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-08T21:25:54.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.895+0000 7ff9e7689640 1 Processor -- start 2023-12-08T21:25:54.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.895+0000 7ff9e7689640 1 -- start start 2023-12-08T21:25:54.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.895+0000 7ff9e7689640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff9e006a640 0x7ff9e0157d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.895+0000 7ff9e7689640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9e013d4b0 0x7ff9e006b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.895+0000 7ff9e7689640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e00c6180 con 0x7ff9e00c4f30 2023-12-08T21:25:54.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.895+0000 7ff9e7689640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e00c7070 con 0x7ff9e006a640 2023-12-08T21:25:54.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.895+0000 7ff9e7689640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00c6460 con 0x7ff9e013d4b0 2023-12-08T21:25:54.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.895+0000 7ff9e4c24640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff9e006a640 0x7ff9e0157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:54.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.895+0000 7ff9e4c24640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff9e006a640 0x7ff9e0157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59378/0 (socket says 172.21.15.53:59378) 2023-12-08T21:25:54.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.895+0000 7ff9e4c24640 1 -- 172.21.15.53:0/2404146973 learned_addr learned my addr 172.21.15.53:0/2404146973 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:54.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.899+0000 7ff9e4c24640 1 -- 172.21.15.53:0/2404146973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9e013d4b0 msgr2=0x7ff9e006b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:54.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.899+0000 7ff9e4c24640 1 --2- 172.21.15.53:0/2404146973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9e013d4b0 0x7ff9e006b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.899+0000 7ff9e4c24640 1 -- 172.21.15.53:0/2404146973 >> v1:172.21.15.146:6789/0 conn(0x7ff9e00c4f30 legacy=0x7ff9e013cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:54.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.899+0000 7ff9e4c24640 1 -- 172.21.15.53:0/2404146973 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e00c6740 con 0x7ff9e006a640 2023-12-08T21:25:54.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.903+0000 7ff9e4c24640 1 --2- 172.21.15.53:0/2404146973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e006a640 0x7ff9e0157d20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0140b00 tx=0x7ff9d001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9f67c24e2e4cc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:54.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9d7fff640 1 -- 172.21.15.53:0/2404146973 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00a8990 con 0x7ff9e006a640 2023-12-08T21:25:54.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9d7fff640 1 -- 172.21.15.53:0/2404146973 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d00a8af0 con 0x7ff9e006a640 2023-12-08T21:25:54.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9d7fff640 1 -- 172.21.15.53:0/2404146973 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00a8e80 con 0x7ff9e006a640 2023-12-08T21:25:54.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9e7689640 1 -- 172.21.15.53:0/2404146973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e006a640 msgr2=0x7ff9e0157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9e7689640 1 --2- 172.21.15.53:0/2404146973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e006a640 0x7ff9e0157d20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0140b00 tx=0x7ff9d001ecd0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9e7689640 1 -- 172.21.15.53:0/2404146973 shutdown_connections 2023-12-08T21:25:54.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9e7689640 1 --2- 172.21.15.53:0/2404146973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9e013d4b0 0x7ff9e006b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9e7689640 1 --2- 172.21.15.53:0/2404146973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e006a640 0x7ff9e0157d20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9e7689640 1 -- 172.21.15.53:0/2404146973 >> 172.21.15.53:0/2404146973 conn(0x7ff9e00cb5c0 msgr2=0x7ff9e00cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:54.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9e7689640 1 -- 172.21.15.53:0/2404146973 shutdown_connections 2023-12-08T21:25:54.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9e7689640 1 -- 172.21.15.53:0/2404146973 wait complete. 2023-12-08T21:25:54.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9e7689640 1 Processor -- start 2023-12-08T21:25:54.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.907+0000 7ff9e7689640 1 -- start start 2023-12-08T21:25:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.911+0000 7ff9e7689640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9e006a640 0x7ff9e0134d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.911+0000 7ff9e7689640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9e00c4f30 0x7ff9e015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.911+0000 7ff9e7689640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e013d4b0 0x7ff9e01376c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.911+0000 7ff9e7689640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e01510f0 con 0x7ff9e013d4b0 2023-12-08T21:25:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.911+0000 7ff9e7689640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e01eeaa0 con 0x7ff9e00c4f30 2023-12-08T21:25:54.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.911+0000 7ff9e7689640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e015a710 con 0x7ff9e006a640 2023-12-08T21:25:54.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.911+0000 7ff9e5c26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e013d4b0 0x7ff9e01376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:54.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.911+0000 7ff9e5c26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e013d4b0 0x7ff9e01376c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59392/0 (socket says 172.21.15.53:59392) 2023-12-08T21:25:54.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.911+0000 7ff9e5c26640 1 -- 172.21.15.53:0/3445094023 learned_addr learned my addr 172.21.15.53:0/3445094023 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:54.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.915+0000 7ff9e5c26640 1 -- 172.21.15.53:0/3445094023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9e006a640 msgr2=0x7ff9e0134d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.915+0000 7ff9e5c26640 1 --2- 172.21.15.53:0/3445094023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9e006a640 0x7ff9e0134d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.915+0000 7ff9e5c26640 1 -- 172.21.15.53:0/3445094023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9e00c4f30 msgr2=0x7ff9e015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.915+0000 7ff9e5c26640 1 --2- 172.21.15.53:0/3445094023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9e00c4f30 0x7ff9e015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.915+0000 7ff9e5c26640 1 -- 172.21.15.53:0/3445094023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00094d0 con 0x7ff9e013d4b0 2023-12-08T21:25:54.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.919+0000 7ff9e5c26640 1 --2- 172.21.15.53:0/3445094023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e013d4b0 0x7ff9e01376c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800b440 tx=0x7ff9d800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.919+0000 7ff9d5ffb640 1 -- 172.21.15.53:0/3445094023 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8011890 con 0x7ff9e013d4b0 2023-12-08T21:25:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.919+0000 7ff9d5ffb640 1 -- 172.21.15.53:0/3445094023 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d80119f0 con 0x7ff9e013d4b0 2023-12-08T21:25:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.919+0000 7ff9e7689640 1 -- 172.21.15.53:0/3445094023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e01eec90 con 0x7ff9e013d4b0 2023-12-08T21:25:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.919+0000 7ff9d5ffb640 1 -- 172.21.15.53:0/3445094023 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8011da0 con 0x7ff9e013d4b0 2023-12-08T21:25:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.919+0000 7ff9e7689640 1 -- 172.21.15.53:0/3445094023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e0135700 con 0x7ff9e013d4b0 2023-12-08T21:25:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.923+0000 7ff9e7689640 1 -- 172.21.15.53:0/3445094023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff9e00c6d00 con 0x7ff9e013d4b0 2023-12-08T21:25:54.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.943+0000 7ff9d5ffb640 1 -- 172.21.15.53:0/3445094023 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9d801a400 con 0x7ff9e013d4b0 2023-12-08T21:25:54.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.947+0000 7ff9d5ffb640 1 --2- 172.21.15.53:0/3445094023 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff9c40664f0 0x7ff9c40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.947+0000 7ff9e5425640 1 --2- 172.21.15.53:0/3445094023 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff9c40664f0 0x7ff9c40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.947+0000 7ff9e5425640 1 --2- 172.21.15.53:0/3445094023 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff9c40664f0 0x7ff9c40689b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc001c90 tx=0x7ff9dc007d20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:54.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.951+0000 7ff9d5ffb640 1 -- 172.21.15.53:0/3445094023 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff9d80560b0 con 0x7ff9e013d4b0 2023-12-08T21:25:54.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.951+0000 7ff9d5ffb640 1 --2- 172.21.15.53:0/3445094023 >> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] conn(0x7ff9c406fb70 0x7ff9c4071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:54.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.951+0000 7ff9d5ffb640 1 -- 172.21.15.53:0/3445094023 --> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9c40726c0 con 0x7ff9c406fb70 2023-12-08T21:25:54.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.951+0000 7ff9d5ffb640 1 -- 172.21.15.53:0/3445094023 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9d8009230 con 0x7ff9e013d4b0 2023-12-08T21:25:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.951+0000 7ff9e4c24640 1 --2- 172.21.15.53:0/3445094023 >> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] conn(0x7ff9c406fb70 0x7ff9c4071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.951+0000 7ff9e4c24640 1 --2- 172.21.15.53:0/3445094023 >> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] conn(0x7ff9c406fb70 0x7ff9c4071ff0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.955+0000 7ff9d5ffb640 1 -- 172.21.15.53:0/3445094023 <== osd.7 v2:172.21.15.146:6816/924786666 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff9c40726c0 con 0x7ff9c406fb70 2023-12-08T21:25:54.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9e7689640 1 -- 172.21.15.53:0/3445094023 --> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff9e0074190 con 0x7ff9c406fb70 2023-12-08T21:25:54.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9d5ffb640 1 -- 172.21.15.53:0/3445094023 <== osd.7 v2:172.21.15.146:6816/924786666 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff9e0074190 con 0x7ff9c406fb70 2023-12-08T21:25:54.972 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-12-08T21:25:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T21:25:54.972 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-12-08T21:25:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9e7689640 1 -- 172.21.15.53:0/3445094023 >> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] conn(0x7ff9c406fb70 msgr2=0x7ff9c4071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9e7689640 1 --2- 172.21.15.53:0/3445094023 >> [v2:172.21.15.146:6816/924786666,v1:172.21.15.146:6817/924786666] conn(0x7ff9c406fb70 0x7ff9c4071ff0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9e7689640 1 -- 172.21.15.53:0/3445094023 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff9c40664f0 msgr2=0x7ff9c40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9e7689640 1 --2- 172.21.15.53:0/3445094023 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7ff9c40664f0 0x7ff9c40689b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc001c90 tx=0x7ff9dc007d20 comp rx=0 tx=0).stop 2023-12-08T21:25:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9e7689640 1 -- 172.21.15.53:0/3445094023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e013d4b0 msgr2=0x7ff9e01376c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9e7689640 1 --2- 172.21.15.53:0/3445094023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e013d4b0 0x7ff9e01376c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800b440 tx=0x7ff9d800b900 comp rx=0 tx=0).stop 2023-12-08T21:25:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9e5c26640 1 -- 172.21.15.53:0/3445094023 reap_dead start 2023-12-08T21:25:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9e7689640 1 -- 172.21.15.53:0/3445094023 shutdown_connections 2023-12-08T21:25:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9e7689640 1 -- 172.21.15.53:0/3445094023 >> 172.21.15.53:0/3445094023 conn(0x7ff9e00cb5c0 msgr2=0x7ff9e00c9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9e7689640 1 -- 172.21.15.53:0/3445094023 shutdown_connections 2023-12-08T21:25:54.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:54.971+0000 7ff9e7689640 1 -- 172.21.15.53:0/3445094023 wait complete. 2023-12-08T21:25:54.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-08T21:25:55.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.115+0000 7f7c4c1d4640 1 Processor -- start 2023-12-08T21:25:55.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.115+0000 7f7c4c1d4640 1 -- start start 2023-12-08T21:25:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.115+0000 7f7c4c1d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7c4406f110 0x7f7c4406d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.115+0000 7f7c4c1d4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c44157e90 con 0x7f7c44071140 2023-12-08T21:25:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.115+0000 7f7c4c1d4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c44158170 con 0x7f7c4406ed30 2023-12-08T21:25:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.115+0000 7f7c4c1d4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c440c6000 con 0x7f7c4406f110 2023-12-08T21:25:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.115+0000 7f7c4a771640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7c44071140 0x7f7c44157290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40912/0 (socket says 172.21.15.53:40912) 2023-12-08T21:25:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.115+0000 7f7c4a771640 1 -- 172.21.15.53:0/1562361588 learned_addr learned my addr 172.21.15.53:0/1562361588 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.119+0000 7f7c4976f640 1 --2- 172.21.15.53:0/1562361588 >> v2:172.21.15.53:3300/0 conn(0x7f7c4406f110 0x7f7c4406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:55.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.123+0000 7f7c4976f640 1 -- 172.21.15.53:0/1562361588 >> v1:172.21.15.146:6789/0 conn(0x7f7c4406ed30 legacy=0x7f7c440c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:25:55.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.123+0000 7f7c4976f640 1 -- 172.21.15.53:0/1562361588 >> v1:172.21.15.53:6789/0 conn(0x7f7c44071140 legacy=0x7f7c44157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:55.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.123+0000 7f7c4976f640 1 -- 172.21.15.53:0/1562361588 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4415a920 con 0x7f7c4406f110 2023-12-08T21:25:55.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.127+0000 7f7c4976f640 1 --2- 172.21.15.53:0/1562361588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4406f110 0x7f7c4406d810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7c340097c0 tx=0x7f7c3401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d67f085902233ae server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:55.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c48f6e640 1 -- 172.21.15.53:0/1562361588 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c340a8930 con 0x7f7c4406f110 2023-12-08T21:25:55.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c48f6e640 1 -- 172.21.15.53:0/1562361588 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c340a8a90 con 0x7f7c4406f110 2023-12-08T21:25:55.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c48f6e640 1 -- 172.21.15.53:0/1562361588 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c340a8e20 con 0x7f7c4406f110 2023-12-08T21:25:55.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/1562361588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4406f110 msgr2=0x7f7c4406d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:55.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 --2- 172.21.15.53:0/1562361588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4406f110 0x7f7c4406d810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7c340097c0 tx=0x7f7c3401ec30 comp rx=0 tx=0).stop 2023-12-08T21:25:55.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/1562361588 shutdown_connections 2023-12-08T21:25:55.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 --2- 172.21.15.53:0/1562361588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4406f110 0x7f7c4406d810 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:55.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/1562361588 >> 172.21.15.53:0/1562361588 conn(0x7f7c440caef0 msgr2=0x7f7c440cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:55.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/1562361588 shutdown_connections 2023-12-08T21:25:55.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/1562361588 wait complete. 2023-12-08T21:25:55.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 Processor -- start 2023-12-08T21:25:55.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 -- start start 2023-12-08T21:25:55.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4406ed30 0x7f7c44156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:55.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4406f110 0x7f7c441f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:55.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c44071140 0x7f7c441395a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:55.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c441534c0 con 0x7f7c4406f110 2023-12-08T21:25:55.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c441f2710 con 0x7f7c44071140 2023-12-08T21:25:55.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4c1d4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440c1100 con 0x7f7c4406ed30 2023-12-08T21:25:55.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.135+0000 7f7c4976f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4406f110 0x7f7c441f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:55.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.139+0000 7f7c4976f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4406f110 0x7f7c441f2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59400/0 (socket says 172.21.15.53:59400) 2023-12-08T21:25:55.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.139+0000 7f7c4976f640 1 -- 172.21.15.53:0/3237136725 learned_addr learned my addr 172.21.15.53:0/3237136725 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:55.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.143+0000 7f7c4976f640 1 -- 172.21.15.53:0/3237136725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4406ed30 msgr2=0x7f7c44156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:55.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.143+0000 7f7c4976f640 1 --2- 172.21.15.53:0/3237136725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4406ed30 0x7f7c44156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:55.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.143+0000 7f7c4976f640 1 -- 172.21.15.53:0/3237136725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c44071140 msgr2=0x7f7c441395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:55.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.143+0000 7f7c4976f640 1 --2- 172.21.15.53:0/3237136725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c44071140 0x7f7c441395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:55.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.143+0000 7f7c4976f640 1 -- 172.21.15.53:0/3237136725 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c34009420 con 0x7f7c4406f110 2023-12-08T21:25:55.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.143+0000 7f7c4976f640 1 --2- 172.21.15.53:0/3237136725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4406f110 0x7f7c441f2e40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7c3401b840 tx=0x7f7c3401b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.147+0000 7f7c3a7fc640 1 -- 172.21.15.53:0/3237136725 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c340a8930 con 0x7f7c4406f110 2023-12-08T21:25:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.147+0000 7f7c3a7fc640 1 -- 172.21.15.53:0/3237136725 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c340b9410 con 0x7f7c4406f110 2023-12-08T21:25:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.147+0000 7f7c3a7fc640 1 -- 172.21.15.53:0/3237136725 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c340b97a0 con 0x7f7c4406f110 2023-12-08T21:25:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.147+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/3237136725 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c441f29b0 con 0x7f7c4406f110 2023-12-08T21:25:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.147+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/3237136725 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c440c07c0 con 0x7f7c4406f110 2023-12-08T21:25:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.151+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/3237136725 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c440675b0 con 0x7f7c4406f110 2023-12-08T21:25:55.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.467+0000 7f7c3a7fc640 1 -- 172.21.15.53:0/3237136725 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7c340b7040 con 0x7f7c4406f110 2023-12-08T21:25:55.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.467+0000 7f7c3a7fc640 1 --2- 172.21.15.53:0/3237136725 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7c28066470 0x7f7c28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:55.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.467+0000 7f7c49f70640 1 --2- 172.21.15.53:0/3237136725 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7c28066470 0x7f7c28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:55.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.467+0000 7f7c49f70640 1 --2- 172.21.15.53:0/3237136725 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7c28066470 0x7f7c28068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c40007fd0 tx=0x7f7c400079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.507+0000 7f7c3a7fc640 1 -- 172.21.15.53:0/3237136725 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7c340f39e0 con 0x7f7c4406f110 2023-12-08T21:25:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.511+0000 7f7c3a7fc640 1 -- 172.21.15.53:0/3237136725 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c340efd20 con 0x7f7c4406f110 2023-12-08T21:25:55.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.679+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/3237136725 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c4415b1c0 con 0x7f7c28066470 2023-12-08T21:25:55.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c3a7fc640 1 -- 172.21.15.53:0/3237136725 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7c400050d0 con 0x7f7c28066470 2023-12-08T21:25:55.682 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 7 to deep-scrub 2023-12-08T21:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/3237136725 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7c28066470 msgr2=0x7f7c28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c4c1d4640 1 --2- 172.21.15.53:0/3237136725 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7c28066470 0x7f7c28068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c40007fd0 tx=0x7f7c400079a0 comp rx=0 tx=0).stop 2023-12-08T21:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/3237136725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4406f110 msgr2=0x7f7c441f2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c4c1d4640 1 --2- 172.21.15.53:0/3237136725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4406f110 0x7f7c441f2e40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7c3401b840 tx=0x7f7c3401b9d0 comp rx=0 tx=0).stop 2023-12-08T21:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/3237136725 shutdown_connections 2023-12-08T21:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c4c1d4640 1 --2- 172.21.15.53:0/3237136725 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7c28066470 0x7f7c28068930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c4c1d4640 1 --2- 172.21.15.53:0/3237136725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c44071140 0x7f7c441395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c4c1d4640 1 --2- 172.21.15.53:0/3237136725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4406f110 0x7f7c441f2e40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c4c1d4640 1 --2- 172.21.15.53:0/3237136725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4406ed30 0x7f7c44156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/3237136725 >> 172.21.15.53:0/3237136725 conn(0x7f7c440caef0 msgr2=0x7f7c4413b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/3237136725 shutdown_connections 2023-12-08T21:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.683+0000 7f7c4c1d4640 1 -- 172.21.15.53:0/3237136725 wait complete. 2023-12-08T21:25:55.702 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T21:25:55.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.827+0000 7f876b86e640 1 Processor -- start 2023-12-08T21:25:55.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.827+0000 7f876b86e640 1 -- start start 2023-12-08T21:25:55.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.827+0000 7f876b86e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8764071140 0x7f8764157290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:55.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.827+0000 7f876b86e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8764157e90 con 0x7f876406ed30 2023-12-08T21:25:55.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.827+0000 7f876b86e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8764158170 con 0x7f876406f110 2023-12-08T21:25:55.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.827+0000 7f876b86e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87640c6000 con 0x7f8764071140 2023-12-08T21:25:55.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.827+0000 7f876960a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f876406ed30 0x7f87640c58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40924/0 (socket says 172.21.15.53:40924) 2023-12-08T21:25:55.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.827+0000 7f876960a640 1 -- 172.21.15.53:0/2722701679 learned_addr learned my addr 172.21.15.53:0/2722701679 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:25:55.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.827+0000 7f8769e0b640 1 --2- 172.21.15.53:0/2722701679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8764071140 0x7f8764157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.835+0000 7f8769e0b640 1 -- 172.21.15.53:0/2722701679 >> v1:172.21.15.146:6789/0 conn(0x7f876406f110 legacy=0x7f876406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.835+0000 7f8769e0b640 1 -- 172.21.15.53:0/2722701679 >> v1:172.21.15.53:6789/0 conn(0x7f876406ed30 legacy=0x7f87640c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.835+0000 7f8769e0b640 1 -- 172.21.15.53:0/2722701679 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876415a920 con 0x7f8764071140 2023-12-08T21:25:55.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.843+0000 7f8769e0b640 1 --2- 172.21.15.53:0/2722701679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8764071140 0x7f8764157290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f875c009dc0 tx=0x7f875c01f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=972eb29918e651d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:55.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.851+0000 7f875bfff640 1 -- 172.21.15.53:0/2722701679 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0af600 con 0x7f8764071140 2023-12-08T21:25:55.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.851+0000 7f875bfff640 1 -- 172.21.15.53:0/2722701679 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c0ab050 con 0x7f8764071140 2023-12-08T21:25:55.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.851+0000 7f875bfff640 1 -- 172.21.15.53:0/2722701679 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0af980 con 0x7f8764071140 2023-12-08T21:25:55.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.851+0000 7f876b86e640 1 -- 172.21.15.53:0/2722701679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8764071140 msgr2=0x7f8764157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:55.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.851+0000 7f876b86e640 1 --2- 172.21.15.53:0/2722701679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8764071140 0x7f8764157290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f875c009dc0 tx=0x7f875c01f150 comp rx=0 tx=0).stop 2023-12-08T21:25:55.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.851+0000 7f876b86e640 1 -- 172.21.15.53:0/2722701679 shutdown_connections 2023-12-08T21:25:55.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.851+0000 7f876b86e640 1 --2- 172.21.15.53:0/2722701679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8764071140 0x7f8764157290 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:55.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.851+0000 7f876b86e640 1 -- 172.21.15.53:0/2722701679 >> 172.21.15.53:0/2722701679 conn(0x7f87640caef0 msgr2=0x7f87640cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:55.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.851+0000 7f876b86e640 1 -- 172.21.15.53:0/2722701679 shutdown_connections 2023-12-08T21:25:55.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.851+0000 7f876b86e640 1 -- 172.21.15.53:0/2722701679 wait complete. 2023-12-08T21:25:55.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.855+0000 7f876b86e640 1 Processor -- start 2023-12-08T21:25:55.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.855+0000 7f876b86e640 1 -- start start 2023-12-08T21:25:55.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.855+0000 7f876b86e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f876406ed30 0x7f876406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:55.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.855+0000 7f876b86e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876406f110 0x7f87640c1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:55.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.855+0000 7f876b86e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8764071140 0x7f87641f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:55.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.855+0000 7f876b86e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87641e2560 con 0x7f8764071140 2023-12-08T21:25:55.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.855+0000 7f876b86e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8764157000 con 0x7f876406f110 2023-12-08T21:25:55.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.855+0000 7f876b86e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87641e2790 con 0x7f876406ed30 2023-12-08T21:25:55.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.855+0000 7f8769e0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8764071140 0x7f87641f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:55.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.855+0000 7f8769e0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8764071140 0x7f87641f2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59408/0 (socket says 172.21.15.53:59408) 2023-12-08T21:25:55.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.855+0000 7f8769e0b640 1 -- 172.21.15.53:0/289774935 learned_addr learned my addr 172.21.15.53:0/289774935 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:25:55.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.855+0000 7f8768e09640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876406f110 0x7f87640c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:55.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.859+0000 7f876960a640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f876406ed30 0x7f876406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:55.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.859+0000 7f8769e0b640 1 -- 172.21.15.53:0/289774935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f876406ed30 msgr2=0x7f876406d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:55.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.859+0000 7f8769e0b640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f876406ed30 0x7f876406d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:55.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.859+0000 7f8769e0b640 1 -- 172.21.15.53:0/289774935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876406f110 msgr2=0x7f87640c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:55.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.859+0000 7f8769e0b640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876406f110 0x7f87640c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:55.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.859+0000 7f8769e0b640 1 -- 172.21.15.53:0/289774935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c009a70 con 0x7f8764071140 2023-12-08T21:25:55.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.863+0000 7f8769e0b640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8764071140 0x7f87641f2a30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f875c01cd80 tx=0x7f875c01bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:55.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.867+0000 7f8759ffb640 1 -- 172.21.15.53:0/289774935 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0afe50 con 0x7f8764071140 2023-12-08T21:25:55.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.867+0000 7f8759ffb640 1 -- 172.21.15.53:0/289774935 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c0ba420 con 0x7f8764071140 2023-12-08T21:25:55.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.867+0000 7f8759ffb640 1 -- 172.21.15.53:0/289774935 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0ba7d0 con 0x7f8764071140 2023-12-08T21:25:55.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.867+0000 7f876b86e640 1 -- 172.21.15.53:0/289774935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87641e2a70 con 0x7f8764071140 2023-12-08T21:25:55.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.867+0000 7f876b86e640 1 -- 172.21.15.53:0/289774935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87641e3030 con 0x7f8764071140 2023-12-08T21:25:55.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:55.867+0000 7f876b86e640 1 -- 172.21.15.53:0/289774935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87641e31c0 con 0x7f8764071140 2023-12-08T21:25:56.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.147+0000 7f8759ffb640 1 -- 172.21.15.53:0/289774935 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f875c0ba930 con 0x7f8764071140 2023-12-08T21:25:56.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.147+0000 7f8759ffb640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f87480664c0 0x7f8748068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:25:56.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.147+0000 7f876960a640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f87480664c0 0x7f8748068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:25:56.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.147+0000 7f876960a640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f87480664c0 0x7f8748068980 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8760005890 tx=0x7f8760009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:25:56.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.167+0000 7f8759ffb640 1 -- 172.21.15.53:0/289774935 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f875c0f3f20 con 0x7f8764071140 2023-12-08T21:25:56.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.171+0000 7f8759ffb640 1 -- 172.21.15.53:0/289774935 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f875c0f0260 con 0x7f8764071140 2023-12-08T21:25:56.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.339+0000 7f876b86e640 1 -- 172.21.15.53:0/289774935 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8764068040 con 0x7f87480664c0 2023-12-08T21:25:56.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.367+0000 7f8759ffb640 1 -- 172.21.15.53:0/289774935 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+366317 (secure 0 0 0) 0x7f8764068040 con 0x7f87480664c0 2023-12-08T21:25:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:25:56.375 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-12-08T21:25:56.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.375+0000 7f876b86e640 1 -- 172.21.15.53:0/289774935 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f87480664c0 msgr2=0x7f8748068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:56.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.375+0000 7f876b86e640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f87480664c0 0x7f8748068980 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8760005890 tx=0x7f8760009040 comp rx=0 tx=0).stop 2023-12-08T21:25:56.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.375+0000 7f876b86e640 1 -- 172.21.15.53:0/289774935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8764071140 msgr2=0x7f87641f2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:25:56.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.375+0000 7f876b86e640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8764071140 0x7f87641f2a30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f875c01cd80 tx=0x7f875c01bef0 comp rx=0 tx=0).stop 2023-12-08T21:25:56.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.375+0000 7f876b86e640 1 -- 172.21.15.53:0/289774935 shutdown_connections 2023-12-08T21:25:56.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.375+0000 7f876b86e640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f87480664c0 0x7f8748068980 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:56.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.375+0000 7f876b86e640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8764071140 0x7f87641f2a30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:56.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.375+0000 7f876b86e640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876406f110 0x7f87640c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:56.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.375+0000 7f876b86e640 1 --2- 172.21.15.53:0/289774935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f876406ed30 0x7f876406d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:25:56.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.375+0000 7f876b86e640 1 -- 172.21.15.53:0/289774935 >> 172.21.15.53:0/289774935 conn(0x7f87640caef0 msgr2=0x7f87640c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:25:56.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.375+0000 7f876b86e640 1 -- 172.21.15.53:0/289774935 shutdown_connections 2023-12-08T21:25:56.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:25:56.375+0000 7f876b86e640 1 -- 172.21.15.53:0/289774935 wait complete. 2023-12-08T21:25:56.396 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":979,"stamp":"2023-12-08T21:25:56.050524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24448816,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":690,"num_read_kb":695,"num_write":8182,"num_write_kb":281588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9408,"ondisk_log_size":9408,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332312,"kb_used_data":34328,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754642408,"statfs":{"total":773094113280,"available":772753825792,"internally_reserved":0,"allocated":35151872,"data_stored":49947816,"data_compressed":4799006,"data_compressed_allocated":7397376,"data_compressed_original":23764992,"omap_allocated":12752,"internal_metadata":305057328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004084"},"pg_stats":[{"pgid":"2.1f","version":"30'720","reported_seq":755,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:07.393324+0000","last_change":"2023-12-08T20:54:54.983255+0000","last_active":"2023-12-08T21:24:07.393324+0000","last_peered":"2023-12-08T21:24:07.393324+0000","last_clean":"2023-12-08T21:24:07.393324+0000","last_became_active":"2023-12-08T20:54:54.982479+0000","last_became_peered":"2023-12-08T20:54:54.982479+0000","last_unstale":"2023-12-08T21:24:07.393324+0000","last_undegraded":"2023-12-08T21:24:07.393324+0000","last_fullsized":"2023-12-08T21:24:07.393324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:17:36.784429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":4491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546695+0000","last_change":"2023-12-08T20:54:56.407614+0000","last_active":"2023-12-08T21:25:37.546695+0000","last_peered":"2023-12-08T21:25:37.546695+0000","last_clean":"2023-12-08T21:25:37.546695+0000","last_became_active":"2023-12-08T20:54:56.406245+0000","last_became_peered":"2023-12-08T20:54:56.406245+0000","last_unstale":"2023-12-08T21:25:37.546695+0000","last_undegraded":"2023-12-08T21:25:37.546695+0000","last_fullsized":"2023-12-08T21:25:37.546695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'66","reported_seq":93,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:29.730895+0000","last_change":"2023-12-08T20:55:04.459400+0000","last_active":"2023-12-08T21:24:29.730895+0000","last_peered":"2023-12-08T21:24:29.730895+0000","last_clean":"2023-12-08T21:24:29.730895+0000","last_became_active":"2023-12-08T20:55:04.458087+0000","last_became_peered":"2023-12-08T20:55:04.458087+0000","last_unstale":"2023-12-08T21:24:29.730895+0000","last_undegraded":"2023-12-08T21:24:29.730895+0000","last_fullsized":"2023-12-08T21:24:29.730895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:23.378911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'290","reported_seq":327,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.842252+0000","last_change":"2023-12-08T20:54:54.929925+0000","last_active":"2023-12-08T21:25:37.842252+0000","last_peered":"2023-12-08T21:25:37.842252+0000","last_clean":"2023-12-08T21:25:37.842252+0000","last_became_active":"2023-12-08T20:54:54.929391+0000","last_became_peered":"2023-12-08T20:54:54.929391+0000","last_unstale":"2023-12-08T21:25:37.842252+0000","last_undegraded":"2023-12-08T21:25:37.842252+0000","last_fullsized":"2023-12-08T21:25:37.842252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759983,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":2843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.565686+0000","last_change":"2023-12-08T20:54:56.409201+0000","last_active":"2023-12-08T21:25:37.565686+0000","last_peered":"2023-12-08T21:25:37.565686+0000","last_clean":"2023-12-08T21:25:37.565686+0000","last_became_active":"2023-12-08T20:54:56.408361+0000","last_became_peered":"2023-12-08T20:54:56.408361+0000","last_unstale":"2023-12-08T21:25:37.565686+0000","last_undegraded":"2023-12-08T21:25:37.565686+0000","last_fullsized":"2023-12-08T21:25:37.565686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'74","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:29.773661+0000","last_change":"2023-12-08T20:55:04.529086+0000","last_active":"2023-12-08T21:24:29.773661+0000","last_peered":"2023-12-08T21:24:29.773661+0000","last_clean":"2023-12-08T21:24:29.773661+0000","last_became_active":"2023-12-08T20:55:04.528732+0000","last_became_peered":"2023-12-08T20:55:04.528732+0000","last_unstale":"2023-12-08T21:24:29.773661+0000","last_undegraded":"2023-12-08T21:24:29.773661+0000","last_fullsized":"2023-12-08T21:24:29.773661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'9","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:28.696935+0000","last_change":"2023-12-08T20:54:54.935973+0000","last_active":"2023-12-08T21:25:28.696935+0000","last_peered":"2023-12-08T21:25:28.696935+0000","last_clean":"2023-12-08T21:25:28.696935+0000","last_became_active":"2023-12-08T20:54:54.935620+0000","last_became_peered":"2023-12-08T20:54:54.935620+0000","last_unstale":"2023-12-08T21:25:28.696935+0000","last_undegraded":"2023-12-08T21:25:28.696935+0000","last_fullsized":"2023-12-08T21:25:28.696935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572660+0000","last_change":"2023-12-08T20:54:56.382016+0000","last_active":"2023-12-08T21:25:37.572660+0000","last_peered":"2023-12-08T21:25:37.572660+0000","last_clean":"2023-12-08T21:25:37.572660+0000","last_became_active":"2023-12-08T20:54:56.380927+0000","last_became_peered":"2023-12-08T20:54:56.380927+0000","last_unstale":"2023-12-08T21:25:37.572660+0000","last_undegraded":"2023-12-08T21:25:37.572660+0000","last_fullsized":"2023-12-08T21:25:37.572660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'75","reported_seq":103,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.075186+0000","last_change":"2023-12-08T20:55:04.527024+0000","last_active":"2023-12-08T21:25:04.075186+0000","last_peered":"2023-12-08T21:25:04.075186+0000","last_clean":"2023-12-08T21:25:04.075186+0000","last_became_active":"2023-12-08T20:55:04.526605+0000","last_became_peered":"2023-12-08T20:55:04.526605+0000","last_unstale":"2023-12-08T21:25:04.075186+0000","last_undegraded":"2023-12-08T21:25:04.075186+0000","last_fullsized":"2023-12-08T21:25:04.075186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'3","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:26.746600+0000","last_change":"2023-12-08T20:54:54.929388+0000","last_active":"2023-12-08T21:25:26.746600+0000","last_peered":"2023-12-08T21:25:26.746600+0000","last_clean":"2023-12-08T21:25:26.746600+0000","last_became_active":"2023-12-08T20:54:54.926132+0000","last_became_peered":"2023-12-08T20:54:54.926132+0000","last_unstale":"2023-12-08T21:25:26.746600+0000","last_undegraded":"2023-12-08T21:25:26.746600+0000","last_fullsized":"2023-12-08T21:25:26.746600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.270295+0000","last_change":"2023-12-08T21:25:53.270348+0000","last_active":"2023-12-08T21:25:53.270295+0000","last_peered":"2023-12-08T21:25:53.270295+0000","last_clean":"2023-12-08T21:25:53.270295+0000","last_became_active":"2023-12-08T20:54:56.387528+0000","last_became_peered":"2023-12-08T20:54:56.387528+0000","last_unstale":"2023-12-08T21:25:53.270295+0000","last_undegraded":"2023-12-08T21:25:53.270295+0000","last_fullsized":"2023-12-08T21:25:53.270295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-12-08T21:25:53.270101+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-12-08T21:25:53.270101+0000","last_clean_scrub_stamp":"2023-12-08T21:25:53.270101+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:05:32.821478+0000","scrub_duration":0.0031071860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'65","reported_seq":93,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.075060+0000","last_change":"2023-12-08T20:55:04.523251+0000","last_active":"2023-12-08T21:25:04.075060+0000","last_peered":"2023-12-08T21:25:04.075060+0000","last_clean":"2023-12-08T21:25:04.075060+0000","last_became_active":"2023-12-08T20:55:04.522777+0000","last_became_peered":"2023-12-08T20:55:04.522777+0000","last_unstale":"2023-12-08T21:25:04.075060+0000","last_undegraded":"2023-12-08T21:25:04.075060+0000","last_fullsized":"2023-12-08T21:25:04.075060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'17","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.527705+0000","last_change":"2023-12-08T20:54:56.319638+0000","last_active":"2023-12-08T21:25:37.527705+0000","last_peered":"2023-12-08T21:25:37.527705+0000","last_clean":"2023-12-08T21:25:37.527705+0000","last_became_active":"2023-12-08T20:54:56.318855+0000","last_became_peered":"2023-12-08T20:54:56.318855+0000","last_unstale":"2023-12-08T21:25:37.527705+0000","last_undegraded":"2023-12-08T21:25:37.527705+0000","last_fullsized":"2023-12-08T21:25:37.527705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'722","reported_seq":757,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:15.971162+0000","last_change":"2023-12-08T20:54:54.929584+0000","last_active":"2023-12-08T21:25:15.971162+0000","last_peered":"2023-12-08T21:25:15.971162+0000","last_clean":"2023-12-08T21:25:15.971162+0000","last_became_active":"2023-12-08T20:54:54.928702+0000","last_became_peered":"2023-12-08T20:54:54.928702+0000","last_unstale":"2023-12-08T21:25:15.971162+0000","last_undegraded":"2023-12-08T21:25:15.971162+0000","last_fullsized":"2023-12-08T21:25:15.971162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'78","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.281055+0000","last_change":"2023-12-08T20:55:04.535786+0000","last_active":"2023-12-08T21:24:33.281055+0000","last_peered":"2023-12-08T21:24:33.281055+0000","last_clean":"2023-12-08T21:24:33.281055+0000","last_became_active":"2023-12-08T20:55:04.535119+0000","last_became_peered":"2023-12-08T20:55:04.535119+0000","last_unstale":"2023-12-08T21:24:33.281055+0000","last_undegraded":"2023-12-08T21:24:33.281055+0000","last_fullsized":"2023-12-08T21:24:33.281055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":12383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.475615+0000","last_change":"2023-12-08T20:54:56.370877+0000","last_active":"2023-12-08T21:25:37.475615+0000","last_peered":"2023-12-08T21:25:37.475615+0000","last_clean":"2023-12-08T21:25:37.475615+0000","last_became_active":"2023-12-08T20:54:56.370044+0000","last_became_peered":"2023-12-08T20:54:56.370044+0000","last_unstale":"2023-12-08T21:25:37.475615+0000","last_undegraded":"2023-12-08T21:25:37.475615+0000","last_fullsized":"2023-12-08T21:25:37.475615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:01:39.423250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:26.733660+0000","last_change":"2023-12-08T20:54:54.923604+0000","last_active":"2023-12-08T21:25:26.733660+0000","last_peered":"2023-12-08T21:25:26.733660+0000","last_clean":"2023-12-08T21:25:26.733660+0000","last_became_active":"2023-12-08T20:54:54.922960+0000","last_became_peered":"2023-12-08T20:54:54.922960+0000","last_unstale":"2023-12-08T21:25:26.733660+0000","last_undegraded":"2023-12-08T21:25:26.733660+0000","last_fullsized":"2023-12-08T21:25:26.733660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:41:46.444603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'95","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:32.087861+0000","last_change":"2023-12-08T20:55:04.522655+0000","last_active":"2023-12-08T21:24:32.087861+0000","last_peered":"2023-12-08T21:24:32.087861+0000","last_clean":"2023-12-08T21:24:32.087861+0000","last_became_active":"2023-12-08T20:55:04.522172+0000","last_became_peered":"2023-12-08T20:55:04.522172+0000","last_unstale":"2023-12-08T21:24:32.087861+0000","last_undegraded":"2023-12-08T21:24:32.087861+0000","last_fullsized":"2023-12-08T21:24:32.087861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.700497+0000","last_change":"2023-12-08T20:54:56.366227+0000","last_active":"2023-12-08T21:25:37.700497+0000","last_peered":"2023-12-08T21:25:37.700497+0000","last_clean":"2023-12-08T21:25:37.700497+0000","last_became_active":"2023-12-08T20:54:56.365552+0000","last_became_peered":"2023-12-08T20:54:56.365552+0000","last_unstale":"2023-12-08T21:25:37.700497+0000","last_undegraded":"2023-12-08T21:25:37.700497+0000","last_fullsized":"2023-12-08T21:25:37.700497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:00.821031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.043833+0000","last_change":"2023-12-08T20:54:54.980466+0000","last_active":"2023-12-08T21:25:17.043833+0000","last_peered":"2023-12-08T21:25:17.043833+0000","last_clean":"2023-12-08T21:25:17.043833+0000","last_became_active":"2023-12-08T20:54:54.979668+0000","last_became_peered":"2023-12-08T20:54:54.979668+0000","last_unstale":"2023-12-08T21:25:17.043833+0000","last_undegraded":"2023-12-08T21:25:17.043833+0000","last_fullsized":"2023-12-08T21:25:17.043833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:32:53.529738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'67","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.342620+0000","last_change":"2023-12-08T20:55:04.513186+0000","last_active":"2023-12-08T21:24:30.342620+0000","last_peered":"2023-12-08T21:24:30.342620+0000","last_clean":"2023-12-08T21:24:30.342620+0000","last_became_active":"2023-12-08T20:55:04.512549+0000","last_became_peered":"2023-12-08T20:55:04.512549+0000","last_unstale":"2023-12-08T21:24:30.342620+0000","last_undegraded":"2023-12-08T21:24:30.342620+0000","last_fullsized":"2023-12-08T21:24:30.342620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:49:31.307794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'21","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.524983+0000","last_change":"2023-12-08T20:54:56.261452+0000","last_active":"2023-12-08T21:25:37.524983+0000","last_peered":"2023-12-08T21:25:37.524983+0000","last_clean":"2023-12-08T21:25:37.524983+0000","last_became_active":"2023-12-08T20:54:56.260355+0000","last_became_peered":"2023-12-08T20:54:56.260355+0000","last_unstale":"2023-12-08T21:25:37.524983+0000","last_undegraded":"2023-12-08T21:25:37.524983+0000","last_fullsized":"2023-12-08T21:25:37.524983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'6","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:22.335036+0000","last_change":"2023-12-08T20:54:54.926546+0000","last_active":"2023-12-08T21:25:22.335036+0000","last_peered":"2023-12-08T21:25:22.335036+0000","last_clean":"2023-12-08T21:25:22.335036+0000","last_became_active":"2023-12-08T20:54:54.925888+0000","last_became_peered":"2023-12-08T20:54:54.925888+0000","last_unstale":"2023-12-08T21:25:22.335036+0000","last_undegraded":"2023-12-08T21:25:22.335036+0000","last_fullsized":"2023-12-08T21:25:22.335036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'77","reported_seq":106,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:29.774010+0000","last_change":"2023-12-08T20:55:04.529041+0000","last_active":"2023-12-08T21:24:29.774010+0000","last_peered":"2023-12-08T21:24:29.774010+0000","last_clean":"2023-12-08T21:24:29.774010+0000","last_became_active":"2023-12-08T20:55:04.528640+0000","last_became_peered":"2023-12-08T20:55:04.528640+0000","last_unstale":"2023-12-08T21:24:29.774010+0000","last_undegraded":"2023-12-08T21:24:29.774010+0000","last_fullsized":"2023-12-08T21:24:29.774010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.700875+0000","last_change":"2023-12-08T20:54:56.365339+0000","last_active":"2023-12-08T21:25:37.700875+0000","last_peered":"2023-12-08T21:25:37.700875+0000","last_clean":"2023-12-08T21:25:37.700875+0000","last_became_active":"2023-12-08T20:54:56.364597+0000","last_became_peered":"2023-12-08T20:54:56.364597+0000","last_unstale":"2023-12-08T21:25:37.700875+0000","last_undegraded":"2023-12-08T21:25:37.700875+0000","last_fullsized":"2023-12-08T21:25:37.700875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:17:58.931401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'5","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.406141+0000","last_change":"2023-12-08T20:54:54.928399+0000","last_active":"2023-12-08T21:25:17.406141+0000","last_peered":"2023-12-08T21:25:17.406141+0000","last_clean":"2023-12-08T21:25:17.406141+0000","last_became_active":"2023-12-08T20:54:54.927814+0000","last_became_peered":"2023-12-08T20:54:54.927814+0000","last_unstale":"2023-12-08T21:25:17.406141+0000","last_undegraded":"2023-12-08T21:25:17.406141+0000","last_fullsized":"2023-12-08T21:25:17.406141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'64","reported_seq":94,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.296494+0000","last_change":"2023-12-08T20:55:04.523561+0000","last_active":"2023-12-08T21:24:33.296494+0000","last_peered":"2023-12-08T21:24:33.296494+0000","last_clean":"2023-12-08T21:24:33.296494+0000","last_became_active":"2023-12-08T20:55:04.522714+0000","last_became_peered":"2023-12-08T20:55:04.522714+0000","last_unstale":"2023-12-08T21:24:33.296494+0000","last_undegraded":"2023-12-08T21:24:33.296494+0000","last_fullsized":"2023-12-08T21:24:33.296494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":9451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.698634+0000","last_change":"2023-12-08T20:54:56.331268+0000","last_active":"2023-12-08T21:25:37.698634+0000","last_peered":"2023-12-08T21:25:37.698634+0000","last_clean":"2023-12-08T21:25:37.698634+0000","last_became_active":"2023-12-08T20:54:56.330508+0000","last_became_peered":"2023-12-08T20:54:56.330508+0000","last_unstale":"2023-12-08T21:25:37.698634+0000","last_undegraded":"2023-12-08T21:25:37.698634+0000","last_fullsized":"2023-12-08T21:25:37.698634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:12:52.392589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'333","reported_seq":368,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:32.174048+0000","last_change":"2023-12-08T20:54:54.982136+0000","last_active":"2023-12-08T21:25:32.174048+0000","last_peered":"2023-12-08T21:25:32.174048+0000","last_clean":"2023-12-08T21:25:32.174048+0000","last_became_active":"2023-12-08T20:54:54.981168+0000","last_became_peered":"2023-12-08T20:54:54.981168+0000","last_unstale":"2023-12-08T21:25:32.174048+0000","last_undegraded":"2023-12-08T21:25:32.174048+0000","last_fullsized":"2023-12-08T21:25:32.174048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:22:13.841870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'104","reported_seq":134,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.293300+0000","last_change":"2023-12-08T20:55:04.513360+0000","last_active":"2023-12-08T21:24:33.293300+0000","last_peered":"2023-12-08T21:24:33.293300+0000","last_clean":"2023-12-08T21:24:33.293300+0000","last_became_active":"2023-12-08T20:55:04.511032+0000","last_became_peered":"2023-12-08T20:55:04.511032+0000","last_unstale":"2023-12-08T21:24:33.293300+0000","last_undegraded":"2023-12-08T21:24:33.293300+0000","last_fullsized":"2023-12-08T21:24:33.293300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:38:04.841172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":14212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.469315+0000","last_change":"2023-12-08T20:54:56.409829+0000","last_active":"2023-12-08T21:25:37.469315+0000","last_peered":"2023-12-08T21:25:37.469315+0000","last_clean":"2023-12-08T21:25:37.469315+0000","last_became_active":"2023-12-08T20:54:56.409291+0000","last_became_peered":"2023-12-08T20:54:56.409291+0000","last_unstale":"2023-12-08T21:25:37.469315+0000","last_undegraded":"2023-12-08T21:25:37.469315+0000","last_fullsized":"2023-12-08T21:25:37.469315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:06:37.234510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'5","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:26.710053+0000","last_change":"2023-12-08T20:54:54.978750+0000","last_active":"2023-12-08T21:25:26.710053+0000","last_peered":"2023-12-08T21:25:26.710053+0000","last_clean":"2023-12-08T21:25:26.710053+0000","last_became_active":"2023-12-08T20:54:54.978416+0000","last_became_peered":"2023-12-08T20:54:54.978416+0000","last_unstale":"2023-12-08T21:25:26.710053+0000","last_undegraded":"2023-12-08T21:25:26.710053+0000","last_fullsized":"2023-12-08T21:25:26.710053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'75","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.504300+0000","last_change":"2023-12-08T20:55:04.507859+0000","last_active":"2023-12-08T21:24:30.504300+0000","last_peered":"2023-12-08T21:24:30.504300+0000","last_clean":"2023-12-08T21:24:30.504300+0000","last_became_active":"2023-12-08T20:55:04.507454+0000","last_became_peered":"2023-12-08T20:55:04.507454+0000","last_unstale":"2023-12-08T21:24:30.504300+0000","last_undegraded":"2023-12-08T21:24:30.504300+0000","last_fullsized":"2023-12-08T21:24:30.504300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:56:57.279368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'17","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.668200+0000","last_change":"2023-12-08T20:54:56.372983+0000","last_active":"2023-12-08T21:25:37.668200+0000","last_peered":"2023-12-08T21:25:37.668200+0000","last_clean":"2023-12-08T21:25:37.668200+0000","last_became_active":"2023-12-08T20:54:56.369974+0000","last_became_peered":"2023-12-08T20:54:56.369974+0000","last_unstale":"2023-12-08T21:25:37.668200+0000","last_undegraded":"2023-12-08T21:25:37.668200+0000","last_fullsized":"2023-12-08T21:25:37.668200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'3","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:21.399944+0000","last_change":"2023-12-08T20:54:54.925560+0000","last_active":"2023-12-08T21:25:21.399944+0000","last_peered":"2023-12-08T21:25:21.399944+0000","last_clean":"2023-12-08T21:25:21.399944+0000","last_became_active":"2023-12-08T20:54:54.925022+0000","last_became_peered":"2023-12-08T20:54:54.925022+0000","last_unstale":"2023-12-08T21:25:21.399944+0000","last_undegraded":"2023-12-08T21:25:21.399944+0000","last_fullsized":"2023-12-08T21:25:21.399944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'85","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:26.213718+0000","last_change":"2023-12-08T20:55:04.531931+0000","last_active":"2023-12-08T21:24:26.213718+0000","last_peered":"2023-12-08T21:24:26.213718+0000","last_clean":"2023-12-08T21:24:26.213718+0000","last_became_active":"2023-12-08T20:55:04.530774+0000","last_became_peered":"2023-12-08T20:55:04.530774+0000","last_unstale":"2023-12-08T21:24:26.213718+0000","last_undegraded":"2023-12-08T21:24:26.213718+0000","last_fullsized":"2023-12-08T21:24:26.213718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:39:26.927665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:48.955595+0000","last_change":"2023-12-08T21:25:48.955617+0000","last_active":"2023-12-08T21:25:48.955595+0000","last_peered":"2023-12-08T21:25:48.955595+0000","last_clean":"2023-12-08T21:25:48.955595+0000","last_became_active":"2023-12-08T20:54:56.385090+0000","last_became_peered":"2023-12-08T20:54:56.385090+0000","last_unstale":"2023-12-08T21:25:48.955595+0000","last_undegraded":"2023-12-08T21:25:48.955595+0000","last_fullsized":"2023-12-08T21:25:48.955595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:25:48.955488+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:25:48.955488+0000","last_clean_scrub_stamp":"2023-12-08T21:25:48.955488+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:12:34.372718+0000","scrub_duration":0.001815419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'6","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:27.778201+0000","last_change":"2023-12-08T20:54:54.932503+0000","last_active":"2023-12-08T21:25:27.778201+0000","last_peered":"2023-12-08T21:25:27.778201+0000","last_clean":"2023-12-08T21:25:27.778201+0000","last_became_active":"2023-12-08T20:54:54.932121+0000","last_became_peered":"2023-12-08T20:54:54.932121+0000","last_unstale":"2023-12-08T21:25:27.778201+0000","last_undegraded":"2023-12-08T21:25:27.778201+0000","last_fullsized":"2023-12-08T21:25:27.778201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'55","reported_seq":84,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:17.818790+0000","last_change":"2023-12-08T20:55:04.529911+0000","last_active":"2023-12-08T21:24:17.818790+0000","last_peered":"2023-12-08T21:24:17.818790+0000","last_clean":"2023-12-08T21:24:17.818790+0000","last_became_active":"2023-12-08T20:55:04.528698+0000","last_became_peered":"2023-12-08T20:55:04.528698+0000","last_unstale":"2023-12-08T21:24:17.818790+0000","last_undegraded":"2023-12-08T21:24:17.818790+0000","last_fullsized":"2023-12-08T21:24:17.818790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:33:11.874876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'24","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548809+0000","last_change":"2023-12-08T20:54:56.413886+0000","last_active":"2023-12-08T21:25:37.548809+0000","last_peered":"2023-12-08T21:25:37.548809+0000","last_clean":"2023-12-08T21:25:37.548809+0000","last_became_active":"2023-12-08T20:54:56.412786+0000","last_became_peered":"2023-12-08T20:54:56.412786+0000","last_unstale":"2023-12-08T21:25:37.548809+0000","last_undegraded":"2023-12-08T21:25:37.548809+0000","last_fullsized":"2023-12-08T21:25:37.548809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'576","reported_seq":1185,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:34.738873+0000","last_change":"2023-12-08T20:54:54.922605+0000","last_active":"2023-12-08T21:25:34.738873+0000","last_peered":"2023-12-08T21:25:34.738873+0000","last_clean":"2023-12-08T21:25:34.738873+0000","last_became_active":"2023-12-08T20:54:54.922014+0000","last_became_peered":"2023-12-08T20:54:54.922014+0000","last_unstale":"2023-12-08T21:25:34.738873+0000","last_undegraded":"2023-12-08T21:25:34.738873+0000","last_fullsized":"2023-12-08T21:25:34.738873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:08:48.601596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125475,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":574,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'71","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.296642+0000","last_change":"2023-12-08T20:55:04.509438+0000","last_active":"2023-12-08T21:24:33.296642+0000","last_peered":"2023-12-08T21:24:33.296642+0000","last_clean":"2023-12-08T21:24:33.296642+0000","last_became_active":"2023-12-08T20:55:04.508219+0000","last_became_peered":"2023-12-08T20:55:04.508219+0000","last_unstale":"2023-12-08T21:24:33.296642+0000","last_undegraded":"2023-12-08T21:24:33.296642+0000","last_fullsized":"2023-12-08T21:24:33.296642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:16:31.758437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'15","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.472707+0000","last_change":"2023-12-08T20:54:56.370599+0000","last_active":"2023-12-08T21:25:37.472707+0000","last_peered":"2023-12-08T21:25:37.472707+0000","last_clean":"2023-12-08T21:25:37.472707+0000","last_became_active":"2023-12-08T20:54:56.370121+0000","last_became_peered":"2023-12-08T20:54:56.370121+0000","last_unstale":"2023-12-08T21:25:37.472707+0000","last_undegraded":"2023-12-08T21:25:37.472707+0000","last_fullsized":"2023-12-08T21:25:37.472707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:58:13.927241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'5","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:15.000762+0000","last_change":"2023-12-08T20:54:54.927599+0000","last_active":"2023-12-08T21:25:15.000762+0000","last_peered":"2023-12-08T21:25:15.000762+0000","last_clean":"2023-12-08T21:25:15.000762+0000","last_became_active":"2023-12-08T20:54:54.927120+0000","last_became_peered":"2023-12-08T20:54:54.927120+0000","last_unstale":"2023-12-08T21:25:15.000762+0000","last_undegraded":"2023-12-08T21:25:15.000762+0000","last_fullsized":"2023-12-08T21:25:15.000762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'100","reported_seq":130,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.118553+0000","last_change":"2023-12-08T20:55:04.546945+0000","last_active":"2023-12-08T21:25:24.118553+0000","last_peered":"2023-12-08T21:25:24.118553+0000","last_clean":"2023-12-08T21:25:24.118553+0000","last_became_active":"2023-12-08T20:55:04.546439+0000","last_became_peered":"2023-12-08T20:55:04.546439+0000","last_unstale":"2023-12-08T21:25:24.118553+0000","last_undegraded":"2023-12-08T21:25:24.118553+0000","last_fullsized":"2023-12-08T21:25:24.118553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.698344+0000","last_change":"2023-12-08T20:54:56.372770+0000","last_active":"2023-12-08T21:25:37.698344+0000","last_peered":"2023-12-08T21:25:37.698344+0000","last_clean":"2023-12-08T21:25:37.698344+0000","last_became_active":"2023-12-08T20:54:56.372205+0000","last_became_peered":"2023-12-08T20:54:56.372205+0000","last_unstale":"2023-12-08T21:25:37.698344+0000","last_undegraded":"2023-12-08T21:25:37.698344+0000","last_fullsized":"2023-12-08T21:25:37.698344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:06.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'2","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:09.782649+0000","last_change":"2023-12-08T20:54:54.929937+0000","last_active":"2023-12-08T21:25:09.782649+0000","last_peered":"2023-12-08T21:25:09.782649+0000","last_clean":"2023-12-08T21:25:09.782649+0000","last_became_active":"2023-12-08T20:54:54.929177+0000","last_became_peered":"2023-12-08T20:54:54.929177+0000","last_unstale":"2023-12-08T21:25:09.782649+0000","last_undegraded":"2023-12-08T21:25:09.782649+0000","last_fullsized":"2023-12-08T21:25:09.782649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:50.676527+0000","last_change":"2023-12-08T21:25:50.676647+0000","last_active":"2023-12-08T21:25:50.676527+0000","last_peered":"2023-12-08T21:25:50.676527+0000","last_clean":"2023-12-08T21:25:50.676527+0000","last_became_active":"2023-12-08T20:54:16.147507+0000","last_became_peered":"2023-12-08T20:54:16.147507+0000","last_unstale":"2023-12-08T21:25:50.676527+0000","last_undegraded":"2023-12-08T21:25:50.676527+0000","last_fullsized":"2023-12-08T21:25:50.676527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-12-08T21:25:50.676240+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-12-08T21:25:50.676240+0000","last_clean_scrub_stamp":"2023-12-08T21:25:50.676240+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:06:52.271476+0000","scrub_duration":0.014230578000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'75","reported_seq":105,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:29.765402+0000","last_change":"2023-12-08T20:55:04.515531+0000","last_active":"2023-12-08T21:24:29.765402+0000","last_peered":"2023-12-08T21:24:29.765402+0000","last_clean":"2023-12-08T21:24:29.765402+0000","last_became_active":"2023-12-08T20:55:04.515200+0000","last_became_peered":"2023-12-08T20:55:04.515200+0000","last_unstale":"2023-12-08T21:24:29.765402+0000","last_undegraded":"2023-12-08T21:24:29.765402+0000","last_fullsized":"2023-12-08T21:24:29.765402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.528239+0000","last_change":"2023-12-08T20:54:56.318724+0000","last_active":"2023-12-08T21:25:37.528239+0000","last_peered":"2023-12-08T21:25:37.528239+0000","last_clean":"2023-12-08T21:25:37.528239+0000","last_became_active":"2023-12-08T20:54:56.318408+0000","last_became_peered":"2023-12-08T20:54:56.318408+0000","last_unstale":"2023-12-08T21:25:37.528239+0000","last_undegraded":"2023-12-08T21:25:37.528239+0000","last_fullsized":"2023-12-08T21:25:37.528239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:09.731159+0000","last_change":"2023-12-08T20:54:54.926031+0000","last_active":"2023-12-08T21:25:09.731159+0000","last_peered":"2023-12-08T21:25:09.731159+0000","last_clean":"2023-12-08T21:25:09.731159+0000","last_became_active":"2023-12-08T20:54:54.925610+0000","last_became_peered":"2023-12-08T20:54:54.925610+0000","last_unstale":"2023-12-08T21:25:09.731159+0000","last_undegraded":"2023-12-08T21:25:09.731159+0000","last_fullsized":"2023-12-08T21:25:09.731159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:05:08.857673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'78","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:34.080954+0000","last_change":"2023-12-08T20:55:04.523264+0000","last_active":"2023-12-08T21:25:34.080954+0000","last_peered":"2023-12-08T21:25:34.080954+0000","last_clean":"2023-12-08T21:25:34.080954+0000","last_became_active":"2023-12-08T20:55:04.522245+0000","last_became_peered":"2023-12-08T20:55:04.522245+0000","last_unstale":"2023-12-08T21:25:34.080954+0000","last_undegraded":"2023-12-08T21:25:34.080954+0000","last_fullsized":"2023-12-08T21:25:34.080954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572105+0000","last_change":"2023-12-08T20:54:56.378291+0000","last_active":"2023-12-08T21:25:37.572105+0000","last_peered":"2023-12-08T21:25:37.572105+0000","last_clean":"2023-12-08T21:25:37.572105+0000","last_became_active":"2023-12-08T20:54:56.377762+0000","last_became_peered":"2023-12-08T20:54:56.377762+0000","last_unstale":"2023-12-08T21:25:37.572105+0000","last_undegraded":"2023-12-08T21:25:37.572105+0000","last_fullsized":"2023-12-08T21:25:37.572105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:05.574370+0000","last_change":"2023-12-08T20:54:54.936008+0000","last_active":"2023-12-08T21:25:05.574370+0000","last_peered":"2023-12-08T21:25:05.574370+0000","last_clean":"2023-12-08T21:25:05.574370+0000","last_became_active":"2023-12-08T20:54:54.935472+0000","last_became_peered":"2023-12-08T20:54:54.935472+0000","last_unstale":"2023-12-08T21:25:05.574370+0000","last_undegraded":"2023-12-08T21:25:05.574370+0000","last_fullsized":"2023-12-08T21:25:05.574370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'94","reported_seq":123,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.296332+0000","last_change":"2023-12-08T20:55:04.534674+0000","last_active":"2023-12-08T21:24:33.296332+0000","last_peered":"2023-12-08T21:24:33.296332+0000","last_clean":"2023-12-08T21:24:33.296332+0000","last_became_active":"2023-12-08T20:55:04.533305+0000","last_became_peered":"2023-12-08T20:55:04.533305+0000","last_unstale":"2023-12-08T21:24:33.296332+0000","last_undegraded":"2023-12-08T21:24:33.296332+0000","last_fullsized":"2023-12-08T21:24:33.296332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":6556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:52.008661+0000","last_change":"2023-12-08T21:25:52.008697+0000","last_active":"2023-12-08T21:25:52.008661+0000","last_peered":"2023-12-08T21:25:52.008661+0000","last_clean":"2023-12-08T21:25:52.008661+0000","last_became_active":"2023-12-08T20:54:56.379933+0000","last_became_peered":"2023-12-08T20:54:56.379933+0000","last_unstale":"2023-12-08T21:25:52.008661+0000","last_undegraded":"2023-12-08T21:25:52.008661+0000","last_fullsized":"2023-12-08T21:25:52.008661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:25:52.008566+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:25:52.008566+0000","last_clean_scrub_stamp":"2023-12-08T21:25:52.008566+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:27:19.773108+0000","scrub_duration":0.001762434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:39.712705+0000","last_change":"2023-12-08T20:54:54.983221+0000","last_active":"2023-12-08T21:24:39.712705+0000","last_peered":"2023-12-08T21:24:39.712705+0000","last_clean":"2023-12-08T21:24:39.712705+0000","last_became_active":"2023-12-08T20:54:54.982414+0000","last_became_peered":"2023-12-08T20:54:54.982414+0000","last_unstale":"2023-12-08T21:24:39.712705+0000","last_undegraded":"2023-12-08T21:24:39.712705+0000","last_fullsized":"2023-12-08T21:24:39.712705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:36:42.874558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'68","reported_seq":98,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.088327+0000","last_change":"2023-12-08T20:55:04.515310+0000","last_active":"2023-12-08T21:25:24.088327+0000","last_peered":"2023-12-08T21:25:24.088327+0000","last_clean":"2023-12-08T21:25:24.088327+0000","last_became_active":"2023-12-08T20:55:04.514907+0000","last_became_peered":"2023-12-08T20:55:04.514907+0000","last_unstale":"2023-12-08T21:25:24.088327+0000","last_undegraded":"2023-12-08T21:25:24.088327+0000","last_fullsized":"2023-12-08T21:25:24.088327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'19","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.997357+0000","last_change":"2023-12-08T21:25:53.997391+0000","last_active":"2023-12-08T21:25:53.997357+0000","last_peered":"2023-12-08T21:25:53.997357+0000","last_clean":"2023-12-08T21:25:53.997357+0000","last_became_active":"2023-12-08T20:54:56.377430+0000","last_became_peered":"2023-12-08T20:54:56.377430+0000","last_unstale":"2023-12-08T21:25:53.997357+0000","last_undegraded":"2023-12-08T21:25:53.997357+0000","last_fullsized":"2023-12-08T21:25:53.997357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2023-12-08T21:25:53.997259+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2023-12-08T21:25:53.997259+0000","last_clean_scrub_stamp":"2023-12-08T21:25:53.997259+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:43:24.527309+0000","scrub_duration":0.0013451629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:54.149866+0000","last_change":"2023-12-08T20:54:54.926769+0000","last_active":"2023-12-08T21:24:54.149866+0000","last_peered":"2023-12-08T21:24:54.149866+0000","last_clean":"2023-12-08T21:24:54.149866+0000","last_became_active":"2023-12-08T20:54:54.926386+0000","last_became_peered":"2023-12-08T20:54:54.926386+0000","last_unstale":"2023-12-08T21:24:54.149866+0000","last_undegraded":"2023-12-08T21:24:54.149866+0000","last_fullsized":"2023-12-08T21:24:54.149866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'113","reported_seq":143,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.171922+0000","last_change":"2023-12-08T20:55:04.523709+0000","last_active":"2023-12-08T21:25:24.171922+0000","last_peered":"2023-12-08T21:25:24.171922+0000","last_clean":"2023-12-08T21:25:24.171922+0000","last_became_active":"2023-12-08T20:55:04.523074+0000","last_became_peered":"2023-12-08T20:55:04.523074+0000","last_unstale":"2023-12-08T21:25:24.171922+0000","last_undegraded":"2023-12-08T21:25:24.171922+0000","last_fullsized":"2023-12-08T21:25:24.171922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":11577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526568+0000","last_change":"2023-12-08T20:54:56.373188+0000","last_active":"2023-12-08T21:25:37.526568+0000","last_peered":"2023-12-08T21:25:37.526568+0000","last_clean":"2023-12-08T21:25:37.526568+0000","last_became_active":"2023-12-08T20:54:56.371132+0000","last_became_peered":"2023-12-08T20:54:56.371132+0000","last_unstale":"2023-12-08T21:25:37.526568+0000","last_undegraded":"2023-12-08T21:25:37.526568+0000","last_fullsized":"2023-12-08T21:25:37.526568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'14","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:28.682828+0000","last_change":"2023-12-08T20:54:54.985432+0000","last_active":"2023-12-08T21:25:28.682828+0000","last_peered":"2023-12-08T21:25:28.682828+0000","last_clean":"2023-12-08T21:25:28.682828+0000","last_became_active":"2023-12-08T20:54:54.984661+0000","last_became_peered":"2023-12-08T20:54:54.984661+0000","last_unstale":"2023-12-08T21:25:28.682828+0000","last_undegraded":"2023-12-08T21:25:28.682828+0000","last_fullsized":"2023-12-08T21:25:28.682828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:16:34.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'88","reported_seq":116,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.181521+0000","last_change":"2023-12-08T20:55:04.543349+0000","last_active":"2023-12-08T21:24:31.181521+0000","last_peered":"2023-12-08T21:24:31.181521+0000","last_clean":"2023-12-08T21:24:31.181521+0000","last_became_active":"2023-12-08T20:55:04.541074+0000","last_became_peered":"2023-12-08T20:55:04.541074+0000","last_unstale":"2023-12-08T21:24:31.181521+0000","last_undegraded":"2023-12-08T21:24:31.181521+0000","last_fullsized":"2023-12-08T21:24:31.181521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.568569+0000","last_change":"2023-12-08T20:54:56.413772+0000","last_active":"2023-12-08T21:25:37.568569+0000","last_peered":"2023-12-08T21:25:37.568569+0000","last_clean":"2023-12-08T21:25:37.568569+0000","last_became_active":"2023-12-08T20:54:56.413023+0000","last_became_peered":"2023-12-08T20:54:56.413023+0000","last_unstale":"2023-12-08T21:25:37.568569+0000","last_undegraded":"2023-12-08T21:25:37.568569+0000","last_fullsized":"2023-12-08T21:25:37.568569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:14.127627+0000","last_change":"2023-12-08T20:54:54.929238+0000","last_active":"2023-12-08T21:25:14.127627+0000","last_peered":"2023-12-08T21:25:14.127627+0000","last_clean":"2023-12-08T21:25:14.127627+0000","last_became_active":"2023-12-08T20:54:54.928543+0000","last_became_peered":"2023-12-08T20:54:54.928543+0000","last_unstale":"2023-12-08T21:25:14.127627+0000","last_undegraded":"2023-12-08T21:25:14.127627+0000","last_fullsized":"2023-12-08T21:25:14.127627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'85","reported_seq":113,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.176309+0000","last_change":"2023-12-08T20:55:04.540347+0000","last_active":"2023-12-08T21:24:31.176309+0000","last_peered":"2023-12-08T21:24:31.176309+0000","last_clean":"2023-12-08T21:24:31.176309+0000","last_became_active":"2023-12-08T20:55:04.535002+0000","last_became_peered":"2023-12-08T20:55:04.535002+0000","last_unstale":"2023-12-08T21:24:31.176309+0000","last_undegraded":"2023-12-08T21:24:31.176309+0000","last_fullsized":"2023-12-08T21:24:31.176309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'40","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526660+0000","last_change":"2023-12-08T20:56:00.382392+0000","last_active":"2023-12-08T21:25:37.526660+0000","last_peered":"2023-12-08T21:25:37.526660+0000","last_clean":"2023-12-08T21:25:37.526660+0000","last_became_active":"2023-12-08T20:56:00.381771+0000","last_became_peered":"2023-12-08T20:56:00.381771+0000","last_unstale":"2023-12-08T21:25:37.526660+0000","last_undegraded":"2023-12-08T21:25:37.526660+0000","last_fullsized":"2023-12-08T21:25:37.526660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:28.697280+0000","last_change":"2023-12-08T20:54:54.930839+0000","last_active":"2023-12-08T21:25:28.697280+0000","last_peered":"2023-12-08T21:25:28.697280+0000","last_clean":"2023-12-08T21:25:28.697280+0000","last_became_active":"2023-12-08T20:54:54.928065+0000","last_became_peered":"2023-12-08T20:54:54.928065+0000","last_unstale":"2023-12-08T21:25:28.697280+0000","last_undegraded":"2023-12-08T21:25:28.697280+0000","last_fullsized":"2023-12-08T21:25:28.697280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'59","reported_seq":87,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.072418+0000","last_change":"2023-12-08T20:55:04.520698+0000","last_active":"2023-12-08T21:24:31.072418+0000","last_peered":"2023-12-08T21:24:31.072418+0000","last_clean":"2023-12-08T21:24:31.072418+0000","last_became_active":"2023-12-08T20:55:04.516783+0000","last_became_peered":"2023-12-08T20:55:04.516783+0000","last_unstale":"2023-12-08T21:24:31.072418+0000","last_undegraded":"2023-12-08T21:24:31.072418+0000","last_fullsized":"2023-12-08T21:24:31.072418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:46:00.331700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.459902+0000","last_change":"2023-12-08T20:54:56.331045+0000","last_active":"2023-12-08T21:25:37.459902+0000","last_peered":"2023-12-08T21:25:37.459902+0000","last_clean":"2023-12-08T21:25:37.459902+0000","last_became_active":"2023-12-08T20:54:56.330346+0000","last_became_peered":"2023-12-08T20:54:56.330346+0000","last_unstale":"2023-12-08T21:25:37.459902+0000","last_undegraded":"2023-12-08T21:25:37.459902+0000","last_fullsized":"2023-12-08T21:25:37.459902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:43:36.950589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:58.411679+0000","last_change":"2023-12-08T20:54:54.927094+0000","last_active":"2023-12-08T21:24:58.411679+0000","last_peered":"2023-12-08T21:24:58.411679+0000","last_clean":"2023-12-08T21:24:58.411679+0000","last_became_active":"2023-12-08T20:54:54.926435+0000","last_became_peered":"2023-12-08T20:54:54.926435+0000","last_unstale":"2023-12-08T21:24:58.411679+0000","last_undegraded":"2023-12-08T21:24:58.411679+0000","last_fullsized":"2023-12-08T21:24:58.411679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:56:53.885956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'79","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:32.156187+0000","last_change":"2023-12-08T20:55:04.534630+0000","last_active":"2023-12-08T21:24:32.156187+0000","last_peered":"2023-12-08T21:24:32.156187+0000","last_clean":"2023-12-08T21:24:32.156187+0000","last_became_active":"2023-12-08T20:55:04.534289+0000","last_became_peered":"2023-12-08T20:55:04.534289+0000","last_unstale":"2023-12-08T21:24:32.156187+0000","last_undegraded":"2023-12-08T21:24:32.156187+0000","last_fullsized":"2023-12-08T21:24:32.156187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.564821+0000","last_change":"2023-12-08T20:54:56.376691+0000","last_active":"2023-12-08T21:25:37.564821+0000","last_peered":"2023-12-08T21:25:37.564821+0000","last_clean":"2023-12-08T21:25:37.564821+0000","last_became_active":"2023-12-08T20:54:56.375922+0000","last_became_peered":"2023-12-08T20:54:56.375922+0000","last_unstale":"2023-12-08T21:25:37.564821+0000","last_undegraded":"2023-12-08T21:25:37.564821+0000","last_fullsized":"2023-12-08T21:25:37.564821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'893","reported_seq":936,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:52.042951+0000","last_change":"2023-12-08T21:25:52.042995+0000","last_active":"2023-12-08T21:25:52.042951+0000","last_peered":"2023-12-08T21:25:52.042951+0000","last_clean":"2023-12-08T21:25:52.042951+0000","last_became_active":"2023-12-08T20:54:54.977999+0000","last_became_peered":"2023-12-08T20:54:54.977999+0000","last_unstale":"2023-12-08T21:25:52.042951+0000","last_undegraded":"2023-12-08T21:25:52.042951+0000","last_fullsized":"2023-12-08T21:25:52.042951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'893","last_scrub_stamp":"2023-12-08T21:25:52.042834+0000","last_deep_scrub":"30'893","last_deep_scrub_stamp":"2023-12-08T21:25:52.042834+0000","last_clean_scrub_stamp":"2023-12-08T21:25:52.042834+0000","objects_scrubbed":4,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:13:57.138876+0000","scrub_duration":0.033957383000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":887,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'80","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.225499+0000","last_change":"2023-12-08T20:55:04.522691+0000","last_active":"2023-12-08T21:24:28.225499+0000","last_peered":"2023-12-08T21:24:28.225499+0000","last_clean":"2023-12-08T21:24:28.225499+0000","last_became_active":"2023-12-08T20:55:04.522190+0000","last_became_peered":"2023-12-08T20:55:04.522190+0000","last_unstale":"2023-12-08T21:24:28.225499+0000","last_undegraded":"2023-12-08T21:24:28.225499+0000","last_fullsized":"2023-12-08T21:24:28.225499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:54:52.945031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.527006+0000","last_change":"2023-12-08T20:54:56.384439+0000","last_active":"2023-12-08T21:25:37.527006+0000","last_peered":"2023-12-08T21:25:37.527006+0000","last_clean":"2023-12-08T21:25:37.527006+0000","last_became_active":"2023-12-08T20:54:56.383561+0000","last_became_peered":"2023-12-08T20:54:56.383561+0000","last_unstale":"2023-12-08T21:25:37.527006+0000","last_undegraded":"2023-12-08T21:25:37.527006+0000","last_fullsized":"2023-12-08T21:25:37.527006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'406","reported_seq":439,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:28.706595+0000","last_change":"2023-12-08T20:54:54.980625+0000","last_active":"2023-12-08T21:25:28.706595+0000","last_peered":"2023-12-08T21:25:28.706595+0000","last_clean":"2023-12-08T21:25:28.706595+0000","last_became_active":"2023-12-08T20:54:54.980023+0000","last_became_peered":"2023-12-08T20:54:54.980023+0000","last_unstale":"2023-12-08T21:25:28.706595+0000","last_undegraded":"2023-12-08T21:25:28.706595+0000","last_fullsized":"2023-12-08T21:25:28.706595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:44:27.401600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'116","reported_seq":145,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.079548+0000","last_change":"2023-12-08T20:55:04.523658+0000","last_active":"2023-12-08T21:25:24.079548+0000","last_peered":"2023-12-08T21:25:24.079548+0000","last_clean":"2023-12-08T21:25:24.079548+0000","last_became_active":"2023-12-08T20:55:04.522325+0000","last_became_peered":"2023-12-08T20:55:04.522325+0000","last_unstale":"2023-12-08T21:25:24.079548+0000","last_undegraded":"2023-12-08T21:25:24.079548+0000","last_fullsized":"2023-12-08T21:25:24.079548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":12653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546813+0000","last_change":"2023-12-08T20:54:56.410075+0000","last_active":"2023-12-08T21:25:37.546813+0000","last_peered":"2023-12-08T21:25:37.546813+0000","last_clean":"2023-12-08T21:25:37.546813+0000","last_became_active":"2023-12-08T20:54:56.409539+0000","last_became_peered":"2023-12-08T20:54:56.409539+0000","last_unstale":"2023-12-08T21:25:37.546813+0000","last_undegraded":"2023-12-08T21:25:37.546813+0000","last_fullsized":"2023-12-08T21:25:37.546813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'3","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:27.777272+0000","last_change":"2023-12-08T20:54:54.936311+0000","last_active":"2023-12-08T21:25:27.777272+0000","last_peered":"2023-12-08T21:25:27.777272+0000","last_clean":"2023-12-08T21:25:27.777272+0000","last_became_active":"2023-12-08T20:54:54.935889+0000","last_became_peered":"2023-12-08T20:54:54.935889+0000","last_unstale":"2023-12-08T21:25:27.777272+0000","last_undegraded":"2023-12-08T21:25:27.777272+0000","last_fullsized":"2023-12-08T21:25:27.777272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'68","reported_seq":93,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:12.515603+0000","last_change":"2023-12-08T20:56:00.560908+0000","last_active":"2023-12-08T21:24:12.515603+0000","last_peered":"2023-12-08T21:24:12.515603+0000","last_clean":"2023-12-08T21:24:12.515603+0000","last_became_active":"2023-12-08T20:56:00.560282+0000","last_became_peered":"2023-12-08T20:56:00.560282+0000","last_unstale":"2023-12-08T21:24:12.515603+0000","last_undegraded":"2023-12-08T21:24:12.515603+0000","last_fullsized":"2023-12-08T21:24:12.515603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":7515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.687839+0000","last_change":"2023-12-08T20:54:56.376709+0000","last_active":"2023-12-08T21:25:37.687839+0000","last_peered":"2023-12-08T21:25:37.687839+0000","last_clean":"2023-12-08T21:25:37.687839+0000","last_became_active":"2023-12-08T20:54:56.369709+0000","last_became_peered":"2023-12-08T20:54:56.369709+0000","last_unstale":"2023-12-08T21:25:37.687839+0000","last_undegraded":"2023-12-08T21:25:37.687839+0000","last_fullsized":"2023-12-08T21:25:37.687839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'3","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:20.406938+0000","last_change":"2023-12-08T20:54:54.980040+0000","last_active":"2023-12-08T21:25:20.406938+0000","last_peered":"2023-12-08T21:25:20.406938+0000","last_clean":"2023-12-08T21:25:20.406938+0000","last_became_active":"2023-12-08T20:54:54.979751+0000","last_became_peered":"2023-12-08T20:54:54.979751+0000","last_unstale":"2023-12-08T21:25:20.406938+0000","last_undegraded":"2023-12-08T21:25:20.406938+0000","last_fullsized":"2023-12-08T21:25:20.406938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'79","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.293956+0000","last_change":"2023-12-08T20:55:04.513429+0000","last_active":"2023-12-08T21:24:33.293956+0000","last_peered":"2023-12-08T21:24:33.293956+0000","last_clean":"2023-12-08T21:24:33.293956+0000","last_became_active":"2023-12-08T20:55:04.511405+0000","last_became_peered":"2023-12-08T20:55:04.511405+0000","last_unstale":"2023-12-08T21:24:33.293956+0000","last_undegraded":"2023-12-08T21:24:33.293956+0000","last_fullsized":"2023-12-08T21:24:33.293956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:48:08.081679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:28.225720+0000","last_change":"2023-12-08T20:55:04.537067+0000","last_active":"2023-12-08T21:24:28.225720+0000","last_peered":"2023-12-08T21:24:28.225720+0000","last_clean":"2023-12-08T21:24:28.225720+0000","last_became_active":"2023-12-08T20:55:04.536497+0000","last_became_peered":"2023-12-08T20:55:04.536497+0000","last_unstale":"2023-12-08T21:24:28.225720+0000","last_undegraded":"2023-12-08T21:24:28.225720+0000","last_fullsized":"2023-12-08T21:24:28.225720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:48:49.322641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.702440+0000","last_change":"2023-12-08T20:54:56.318249+0000","last_active":"2023-12-08T21:25:37.702440+0000","last_peered":"2023-12-08T21:25:37.702440+0000","last_clean":"2023-12-08T21:25:37.702440+0000","last_became_active":"2023-12-08T20:54:56.317895+0000","last_became_peered":"2023-12-08T20:54:56.317895+0000","last_unstale":"2023-12-08T21:25:37.702440+0000","last_undegraded":"2023-12-08T21:25:37.702440+0000","last_fullsized":"2023-12-08T21:25:37.702440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:47:45.185235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:21.354085+0000","last_change":"2023-12-08T20:54:54.935924+0000","last_active":"2023-12-08T21:25:21.354085+0000","last_peered":"2023-12-08T21:25:21.354085+0000","last_clean":"2023-12-08T21:25:21.354085+0000","last_became_active":"2023-12-08T20:54:54.935578+0000","last_became_peered":"2023-12-08T20:54:54.935578+0000","last_unstale":"2023-12-08T21:25:21.354085+0000","last_undegraded":"2023-12-08T21:25:21.354085+0000","last_fullsized":"2023-12-08T21:25:21.354085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'80","reported_seq":110,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.109071+0000","last_change":"2023-12-08T20:55:04.535940+0000","last_active":"2023-12-08T21:24:30.109071+0000","last_peered":"2023-12-08T21:24:30.109071+0000","last_clean":"2023-12-08T21:24:30.109071+0000","last_became_active":"2023-12-08T20:55:04.535525+0000","last_became_peered":"2023-12-08T20:55:04.535525+0000","last_unstale":"2023-12-08T21:24:30.109071+0000","last_undegraded":"2023-12-08T21:24:30.109071+0000","last_fullsized":"2023-12-08T21:24:30.109071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":11364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548522+0000","last_change":"2023-12-08T20:54:56.413484+0000","last_active":"2023-12-08T21:25:37.548522+0000","last_peered":"2023-12-08T21:25:37.548522+0000","last_clean":"2023-12-08T21:25:37.548522+0000","last_became_active":"2023-12-08T20:54:56.412133+0000","last_became_peered":"2023-12-08T20:54:56.412133+0000","last_unstale":"2023-12-08T21:25:37.548522+0000","last_undegraded":"2023-12-08T21:25:37.548522+0000","last_fullsized":"2023-12-08T21:25:37.548522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:54.123528+0000","last_change":"2023-12-08T20:54:54.927237+0000","last_active":"2023-12-08T21:24:54.123528+0000","last_peered":"2023-12-08T21:24:54.123528+0000","last_clean":"2023-12-08T21:24:54.123528+0000","last_became_active":"2023-12-08T20:54:54.926804+0000","last_became_peered":"2023-12-08T20:54:54.926804+0000","last_unstale":"2023-12-08T21:24:54.123528+0000","last_undegraded":"2023-12-08T21:24:54.123528+0000","last_fullsized":"2023-12-08T21:24:54.123528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:30:21.341630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'615","reported_seq":649,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:27.778573+0000","last_change":"2023-12-08T20:54:54.931212+0000","last_active":"2023-12-08T21:25:27.778573+0000","last_peered":"2023-12-08T21:25:27.778573+0000","last_clean":"2023-12-08T21:25:27.778573+0000","last_became_active":"2023-12-08T20:54:54.930324+0000","last_became_peered":"2023-12-08T20:54:54.930324+0000","last_unstale":"2023-12-08T21:25:27.778573+0000","last_undegraded":"2023-12-08T21:25:27.778573+0000","last_fullsized":"2023-12-08T21:25:27.778573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.704911+0000","last_change":"2023-12-08T20:54:56.383879+0000","last_active":"2023-12-08T21:25:37.704911+0000","last_peered":"2023-12-08T21:25:37.704911+0000","last_clean":"2023-12-08T21:25:37.704911+0000","last_became_active":"2023-12-08T20:54:56.383467+0000","last_became_peered":"2023-12-08T20:54:56.383467+0000","last_unstale":"2023-12-08T21:25:37.704911+0000","last_undegraded":"2023-12-08T21:25:37.704911+0000","last_fullsized":"2023-12-08T21:25:37.704911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:08:59.236467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'50","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.296513+0000","last_change":"2023-12-08T20:55:04.541743+0000","last_active":"2023-12-08T21:24:33.296513+0000","last_peered":"2023-12-08T21:24:33.296513+0000","last_clean":"2023-12-08T21:24:33.296513+0000","last_became_active":"2023-12-08T20:55:04.536537+0000","last_became_peered":"2023-12-08T20:55:04.536537+0000","last_unstale":"2023-12-08T21:24:33.296513+0000","last_undegraded":"2023-12-08T21:24:33.296513+0000","last_fullsized":"2023-12-08T21:24:33.296513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:45.443252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'553","reported_seq":587,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:15.047723+0000","last_change":"2023-12-08T20:54:54.925711+0000","last_active":"2023-12-08T21:25:15.047723+0000","last_peered":"2023-12-08T21:25:15.047723+0000","last_clean":"2023-12-08T21:25:15.047723+0000","last_became_active":"2023-12-08T20:54:54.925229+0000","last_became_peered":"2023-12-08T20:54:54.925229+0000","last_unstale":"2023-12-08T21:25:15.047723+0000","last_undegraded":"2023-12-08T21:25:15.047723+0000","last_fullsized":"2023-12-08T21:25:15.047723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.570668+0000","last_change":"2023-12-08T20:54:56.404755+0000","last_active":"2023-12-08T21:25:37.570668+0000","last_peered":"2023-12-08T21:25:37.570668+0000","last_clean":"2023-12-08T21:25:37.570668+0000","last_became_active":"2023-12-08T20:54:56.403996+0000","last_became_peered":"2023-12-08T20:54:56.403996+0000","last_unstale":"2023-12-08T21:25:37.570668+0000","last_undegraded":"2023-12-08T21:25:37.570668+0000","last_fullsized":"2023-12-08T21:25:37.570668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'97","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.091219+0000","last_change":"2023-12-08T20:55:04.523477+0000","last_active":"2023-12-08T21:24:30.091219+0000","last_peered":"2023-12-08T21:24:30.091219+0000","last_clean":"2023-12-08T21:24:30.091219+0000","last_became_active":"2023-12-08T20:55:04.523137+0000","last_became_peered":"2023-12-08T20:55:04.523137+0000","last_unstale":"2023-12-08T21:24:30.091219+0000","last_undegraded":"2023-12-08T21:24:30.091219+0000","last_fullsized":"2023-12-08T21:24:30.091219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:33:03.066780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"30'37","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.669903+0000","last_change":"2023-12-08T20:54:56.379055+0000","last_active":"2023-12-08T21:25:37.669903+0000","last_peered":"2023-12-08T21:25:37.669903+0000","last_clean":"2023-12-08T21:25:37.669903+0000","last_became_active":"2023-12-08T20:54:56.373080+0000","last_became_peered":"2023-12-08T20:54:56.373080+0000","last_unstale":"2023-12-08T21:25:37.669903+0000","last_undegraded":"2023-12-08T21:25:37.669903+0000","last_fullsized":"2023-12-08T21:25:37.669903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'27","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.464046+0000","last_change":"2023-12-08T20:54:56.378688+0000","last_active":"2023-12-08T21:25:37.464046+0000","last_peered":"2023-12-08T21:25:37.464046+0000","last_clean":"2023-12-08T21:25:37.464046+0000","last_became_active":"2023-12-08T20:54:56.378154+0000","last_became_peered":"2023-12-08T20:54:56.378154+0000","last_unstale":"2023-12-08T21:25:37.464046+0000","last_undegraded":"2023-12-08T21:25:37.464046+0000","last_fullsized":"2023-12-08T21:25:37.464046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:22:06.625769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'26","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526856+0000","last_change":"2023-12-08T20:54:56.410526+0000","last_active":"2023-12-08T21:25:37.526856+0000","last_peered":"2023-12-08T21:25:37.526856+0000","last_clean":"2023-12-08T21:25:37.526856+0000","last_became_active":"2023-12-08T20:54:56.409863+0000","last_became_peered":"2023-12-08T20:54:56.409863+0000","last_unstale":"2023-12-08T21:25:37.526856+0000","last_undegraded":"2023-12-08T21:25:37.526856+0000","last_fullsized":"2023-12-08T21:25:37.526856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548856+0000","last_change":"2023-12-08T20:54:56.408750+0000","last_active":"2023-12-08T21:25:37.548856+0000","last_peered":"2023-12-08T21:25:37.548856+0000","last_clean":"2023-12-08T21:25:37.548856+0000","last_became_active":"2023-12-08T20:54:56.408205+0000","last_became_peered":"2023-12-08T20:54:56.408205+0000","last_unstale":"2023-12-08T21:25:37.548856+0000","last_undegraded":"2023-12-08T21:25:37.548856+0000","last_fullsized":"2023-12-08T21:25:37.548856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'16","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.474033+0000","last_change":"2023-12-08T20:54:56.386660+0000","last_active":"2023-12-08T21:25:37.474033+0000","last_peered":"2023-12-08T21:25:37.474033+0000","last_clean":"2023-12-08T21:25:37.474033+0000","last_became_active":"2023-12-08T20:54:56.386344+0000","last_became_peered":"2023-12-08T20:54:56.386344+0000","last_unstale":"2023-12-08T21:25:37.474033+0000","last_undegraded":"2023-12-08T21:25:37.474033+0000","last_fullsized":"2023-12-08T21:25:37.474033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:33:27.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.466511+0000","last_change":"2023-12-08T20:54:56.367640+0000","last_active":"2023-12-08T21:25:37.466511+0000","last_peered":"2023-12-08T21:25:37.466511+0000","last_clean":"2023-12-08T21:25:37.466511+0000","last_became_active":"2023-12-08T20:54:56.366967+0000","last_became_peered":"2023-12-08T20:54:56.366967+0000","last_unstale":"2023-12-08T21:25:37.466511+0000","last_undegraded":"2023-12-08T21:25:37.466511+0000","last_fullsized":"2023-12-08T21:25:37.466511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:22:24.171129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'32","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.686508+0000","last_change":"2023-12-08T20:54:56.376663+0000","last_active":"2023-12-08T21:25:37.686508+0000","last_peered":"2023-12-08T21:25:37.686508+0000","last_clean":"2023-12-08T21:25:37.686508+0000","last_became_active":"2023-12-08T20:54:56.371954+0000","last_became_peered":"2023-12-08T20:54:56.371954+0000","last_unstale":"2023-12-08T21:25:37.686508+0000","last_undegraded":"2023-12-08T21:25:37.686508+0000","last_fullsized":"2023-12-08T21:25:37.686508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546737+0000","last_change":"2023-12-08T20:54:56.410398+0000","last_active":"2023-12-08T21:25:37.546737+0000","last_peered":"2023-12-08T21:25:37.546737+0000","last_clean":"2023-12-08T21:25:37.546737+0000","last_became_active":"2023-12-08T20:54:56.409462+0000","last_became_peered":"2023-12-08T20:54:56.409462+0000","last_unstale":"2023-12-08T21:25:37.546737+0000","last_undegraded":"2023-12-08T21:25:37.546737+0000","last_fullsized":"2023-12-08T21:25:37.546737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'18","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526835+0000","last_change":"2023-12-08T20:54:56.415800+0000","last_active":"2023-12-08T21:25:37.526835+0000","last_peered":"2023-12-08T21:25:37.526835+0000","last_clean":"2023-12-08T21:25:37.526835+0000","last_became_active":"2023-12-08T20:54:56.415176+0000","last_became_peered":"2023-12-08T20:54:56.415176+0000","last_unstale":"2023-12-08T21:25:37.526835+0000","last_undegraded":"2023-12-08T21:25:37.526835+0000","last_fullsized":"2023-12-08T21:25:37.526835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'31","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548626+0000","last_change":"2023-12-08T20:54:56.401521+0000","last_active":"2023-12-08T21:25:37.548626+0000","last_peered":"2023-12-08T21:25:37.548626+0000","last_clean":"2023-12-08T21:25:37.548626+0000","last_became_active":"2023-12-08T20:54:56.400980+0000","last_became_peered":"2023-12-08T20:54:56.400980+0000","last_unstale":"2023-12-08T21:25:37.548626+0000","last_undegraded":"2023-12-08T21:25:37.548626+0000","last_fullsized":"2023-12-08T21:25:37.548626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'26","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.570718+0000","last_change":"2023-12-08T20:54:56.387218+0000","last_active":"2023-12-08T21:25:37.570718+0000","last_peered":"2023-12-08T21:25:37.570718+0000","last_clean":"2023-12-08T21:25:37.570718+0000","last_became_active":"2023-12-08T20:54:56.386413+0000","last_became_peered":"2023-12-08T20:54:56.386413+0000","last_unstale":"2023-12-08T21:25:37.570718+0000","last_undegraded":"2023-12-08T21:25:37.570718+0000","last_fullsized":"2023-12-08T21:25:37.570718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.704536+0000","last_change":"2023-12-08T20:54:56.371962+0000","last_active":"2023-12-08T21:25:37.704536+0000","last_peered":"2023-12-08T21:25:37.704536+0000","last_clean":"2023-12-08T21:25:37.704536+0000","last_became_active":"2023-12-08T20:54:56.371456+0000","last_became_peered":"2023-12-08T20:54:56.371456+0000","last_unstale":"2023-12-08T21:25:37.704536+0000","last_undegraded":"2023-12-08T21:25:37.704536+0000","last_fullsized":"2023-12-08T21:25:37.704536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:45:01.725223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'26","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572458+0000","last_change":"2023-12-08T20:54:56.381311+0000","last_active":"2023-12-08T21:25:37.572458+0000","last_peered":"2023-12-08T21:25:37.572458+0000","last_clean":"2023-12-08T21:25:37.572458+0000","last_became_active":"2023-12-08T20:54:56.380860+0000","last_became_peered":"2023-12-08T20:54:56.380860+0000","last_unstale":"2023-12-08T21:25:37.572458+0000","last_undegraded":"2023-12-08T21:25:37.572458+0000","last_fullsized":"2023-12-08T21:25:37.572458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'26","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.528032+0000","last_change":"2023-12-08T20:54:56.261370+0000","last_active":"2023-12-08T21:25:37.528032+0000","last_peered":"2023-12-08T21:25:37.528032+0000","last_clean":"2023-12-08T21:25:37.528032+0000","last_became_active":"2023-12-08T20:54:56.260387+0000","last_became_peered":"2023-12-08T20:54:56.260387+0000","last_unstale":"2023-12-08T21:25:37.528032+0000","last_undegraded":"2023-12-08T21:25:37.528032+0000","last_fullsized":"2023-12-08T21:25:37.528032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.468545+0000","last_change":"2023-12-08T20:54:56.388280+0000","last_active":"2023-12-08T21:25:37.468545+0000","last_peered":"2023-12-08T21:25:37.468545+0000","last_clean":"2023-12-08T21:25:37.468545+0000","last_became_active":"2023-12-08T20:54:56.387774+0000","last_became_peered":"2023-12-08T20:54:56.387774+0000","last_unstale":"2023-12-08T21:25:37.468545+0000","last_undegraded":"2023-12-08T21:25:37.468545+0000","last_fullsized":"2023-12-08T21:25:37.468545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:15:20.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'26","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.530151+0000","last_change":"2023-12-08T20:54:56.378804+0000","last_active":"2023-12-08T21:25:37.530151+0000","last_peered":"2023-12-08T21:25:37.530151+0000","last_clean":"2023-12-08T21:25:37.530151+0000","last_became_active":"2023-12-08T20:54:56.377029+0000","last_became_peered":"2023-12-08T20:54:56.377029+0000","last_unstale":"2023-12-08T21:25:37.530151+0000","last_undegraded":"2023-12-08T21:25:37.530151+0000","last_fullsized":"2023-12-08T21:25:37.530151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'28","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526877+0000","last_change":"2023-12-08T20:54:56.372118+0000","last_active":"2023-12-08T21:25:37.526877+0000","last_peered":"2023-12-08T21:25:37.526877+0000","last_clean":"2023-12-08T21:25:37.526877+0000","last_became_active":"2023-12-08T20:54:56.370707+0000","last_became_peered":"2023-12-08T20:54:56.370707+0000","last_unstale":"2023-12-08T21:25:37.526877+0000","last_undegraded":"2023-12-08T21:25:37.526877+0000","last_fullsized":"2023-12-08T21:25:37.526877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'29","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.552794+0000","last_change":"2023-12-08T20:54:56.405033+0000","last_active":"2023-12-08T21:25:37.552794+0000","last_peered":"2023-12-08T21:25:37.552794+0000","last_clean":"2023-12-08T21:25:37.552794+0000","last_became_active":"2023-12-08T20:54:56.401544+0000","last_became_peered":"2023-12-08T20:54:56.401544+0000","last_unstale":"2023-12-08T21:25:37.552794+0000","last_undegraded":"2023-12-08T21:25:37.552794+0000","last_fullsized":"2023-12-08T21:25:37.552794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.473127+0000","last_change":"2023-12-08T20:54:56.366037+0000","last_active":"2023-12-08T21:25:37.473127+0000","last_peered":"2023-12-08T21:25:37.473127+0000","last_clean":"2023-12-08T21:25:37.473127+0000","last_became_active":"2023-12-08T20:54:56.365432+0000","last_became_peered":"2023-12-08T20:54:56.365432+0000","last_unstale":"2023-12-08T21:25:37.473127+0000","last_undegraded":"2023-12-08T21:25:37.473127+0000","last_fullsized":"2023-12-08T21:25:37.473127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:48:49.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'32","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.474444+0000","last_change":"2023-12-08T20:54:56.393022+0000","last_active":"2023-12-08T21:25:37.474444+0000","last_peered":"2023-12-08T21:25:37.474444+0000","last_clean":"2023-12-08T21:25:37.474444+0000","last_became_active":"2023-12-08T20:54:56.392408+0000","last_became_peered":"2023-12-08T20:54:56.392408+0000","last_unstale":"2023-12-08T21:25:37.474444+0000","last_undegraded":"2023-12-08T21:25:37.474444+0000","last_fullsized":"2023-12-08T21:25:37.474444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:30:22.435898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572518+0000","last_change":"2023-12-08T20:54:56.380654+0000","last_active":"2023-12-08T21:25:37.572518+0000","last_peered":"2023-12-08T21:25:37.572518+0000","last_clean":"2023-12-08T21:25:37.572518+0000","last_became_active":"2023-12-08T20:54:56.380137+0000","last_became_peered":"2023-12-08T20:54:56.380137+0000","last_unstale":"2023-12-08T21:25:37.572518+0000","last_undegraded":"2023-12-08T21:25:37.572518+0000","last_fullsized":"2023-12-08T21:25:37.572518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.571425+0000","last_change":"2023-12-08T20:54:56.392997+0000","last_active":"2023-12-08T21:25:37.571425+0000","last_peered":"2023-12-08T21:25:37.571425+0000","last_clean":"2023-12-08T21:25:37.571425+0000","last_became_active":"2023-12-08T20:54:56.391299+0000","last_became_peered":"2023-12-08T20:54:56.391299+0000","last_unstale":"2023-12-08T21:25:37.571425+0000","last_undegraded":"2023-12-08T21:25:37.571425+0000","last_fullsized":"2023-12-08T21:25:37.571425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.563924+0000","last_change":"2023-12-08T20:54:56.393461+0000","last_active":"2023-12-08T21:25:37.563924+0000","last_peered":"2023-12-08T21:25:37.563924+0000","last_clean":"2023-12-08T21:25:37.563924+0000","last_became_active":"2023-12-08T20:54:56.392708+0000","last_became_peered":"2023-12-08T20:54:56.392708+0000","last_unstale":"2023-12-08T21:25:37.563924+0000","last_undegraded":"2023-12-08T21:25:37.563924+0000","last_fullsized":"2023-12-08T21:25:37.563924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.569914+0000","last_change":"2023-12-08T20:54:56.319183+0000","last_active":"2023-12-08T21:25:37.569914+0000","last_peered":"2023-12-08T21:25:37.569914+0000","last_clean":"2023-12-08T21:25:37.569914+0000","last_became_active":"2023-12-08T20:54:56.318400+0000","last_became_peered":"2023-12-08T20:54:56.318400+0000","last_unstale":"2023-12-08T21:25:37.569914+0000","last_undegraded":"2023-12-08T21:25:37.569914+0000","last_fullsized":"2023-12-08T21:25:37.569914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.552551+0000","last_change":"2023-12-08T20:54:56.414028+0000","last_active":"2023-12-08T21:25:37.552551+0000","last_peered":"2023-12-08T21:25:37.552551+0000","last_clean":"2023-12-08T21:25:37.552551+0000","last_became_active":"2023-12-08T20:54:56.413220+0000","last_became_peered":"2023-12-08T20:54:56.413220+0000","last_unstale":"2023-12-08T21:25:37.552551+0000","last_undegraded":"2023-12-08T21:25:37.552551+0000","last_fullsized":"2023-12-08T21:25:37.552551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.553989+0000","last_change":"2023-12-08T20:54:56.366203+0000","last_active":"2023-12-08T21:25:37.553989+0000","last_peered":"2023-12-08T21:25:37.553989+0000","last_clean":"2023-12-08T21:25:37.553989+0000","last_became_active":"2023-12-08T20:54:56.365448+0000","last_became_peered":"2023-12-08T20:54:56.365448+0000","last_unstale":"2023-12-08T21:25:37.553989+0000","last_undegraded":"2023-12-08T21:25:37.553989+0000","last_fullsized":"2023-12-08T21:25:37.553989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.673256+0000","last_change":"2023-12-08T20:54:56.373847+0000","last_active":"2023-12-08T21:25:37.673256+0000","last_peered":"2023-12-08T21:25:37.673256+0000","last_clean":"2023-12-08T21:25:37.673256+0000","last_became_active":"2023-12-08T20:54:56.369574+0000","last_became_peered":"2023-12-08T20:54:56.369574+0000","last_unstale":"2023-12-08T21:25:37.673256+0000","last_undegraded":"2023-12-08T21:25:37.673256+0000","last_fullsized":"2023-12-08T21:25:37.673256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.554372+0000","last_change":"2023-12-08T20:54:56.411972+0000","last_active":"2023-12-08T21:25:37.554372+0000","last_peered":"2023-12-08T21:25:37.554372+0000","last_clean":"2023-12-08T21:25:37.554372+0000","last_became_active":"2023-12-08T20:54:56.411339+0000","last_became_peered":"2023-12-08T20:54:56.411339+0000","last_unstale":"2023-12-08T21:25:37.554372+0000","last_undegraded":"2023-12-08T21:25:37.554372+0000","last_fullsized":"2023-12-08T21:25:37.554372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'17","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.669744+0000","last_change":"2023-12-08T20:54:56.370763+0000","last_active":"2023-12-08T21:25:37.669744+0000","last_peered":"2023-12-08T21:25:37.669744+0000","last_clean":"2023-12-08T21:25:37.669744+0000","last_became_active":"2023-12-08T20:54:56.369650+0000","last_became_peered":"2023-12-08T20:54:56.369650+0000","last_unstale":"2023-12-08T21:25:37.669744+0000","last_undegraded":"2023-12-08T21:25:37.669744+0000","last_fullsized":"2023-12-08T21:25:37.669744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'24","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548716+0000","last_change":"2023-12-08T20:54:56.409124+0000","last_active":"2023-12-08T21:25:37.548716+0000","last_peered":"2023-12-08T21:25:37.548716+0000","last_clean":"2023-12-08T21:25:37.548716+0000","last_became_active":"2023-12-08T20:54:56.408861+0000","last_became_peered":"2023-12-08T20:54:56.408861+0000","last_unstale":"2023-12-08T21:25:37.548716+0000","last_undegraded":"2023-12-08T21:25:37.548716+0000","last_fullsized":"2023-12-08T21:25:37.548716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'19","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548679+0000","last_change":"2023-12-08T20:54:56.407010+0000","last_active":"2023-12-08T21:25:37.548679+0000","last_peered":"2023-12-08T21:25:37.548679+0000","last_clean":"2023-12-08T21:25:37.548679+0000","last_became_active":"2023-12-08T20:54:56.404697+0000","last_became_peered":"2023-12-08T20:54:56.404697+0000","last_unstale":"2023-12-08T21:25:37.548679+0000","last_undegraded":"2023-12-08T21:25:37.548679+0000","last_fullsized":"2023-12-08T21:25:37.548679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.561971+0000","last_change":"2023-12-08T20:54:56.378873+0000","last_active":"2023-12-08T21:25:37.561971+0000","last_peered":"2023-12-08T21:25:37.561971+0000","last_clean":"2023-12-08T21:25:37.561971+0000","last_became_active":"2023-12-08T20:54:56.377835+0000","last_became_peered":"2023-12-08T20:54:56.377835+0000","last_unstale":"2023-12-08T21:25:37.561971+0000","last_undegraded":"2023-12-08T21:25:37.561971+0000","last_fullsized":"2023-12-08T21:25:37.561971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2350,"num_write_kb":252630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2525,"ondisk_log_size":2525,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1552,"ondisk_log_size":1552,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23858448,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":5673,"num_write_kb":26542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32464896,"data_stored":47716896,"data_compressed":4732252,"data_compressed_allocated":7307264,"data_compressed_original":22618112,"omap_allocated":0,"internal_metadata":0},"log_size":5212,"ondisk_log_size":5212,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509824,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":4588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":4698112,"data_stored":7801495,"data_compressed":855543,"data_compressed_allocated":1261568,"data_compressed_original":4567040,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.91400000000000003,"15min":0.878},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.371},"max":{"1min":1.268,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.012},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.93200000000000005,"15min":0.94299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.499},"max":{"1min":1.2649999999999999,"5min":1.4710000000000001,"15min":1.6479999999999999},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96299999999999997,"15min":0.92700000000000005},"min":{"1min":0.56299999999999994,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3280000000000001,"5min":1.405,"15min":1.405},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.93300000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.48599999999999999},"max":{"1min":1.1519999999999999,"5min":1.3640000000000001,"15min":1.504},"last":0.89400000000000002}]},{"osd":2,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.94699999999999995,"15min":0.91800000000000004},"min":{"1min":0.67100000000000004,"5min":0.54600000000000004,"15min":0.51900000000000002},"max":{"1min":1.2290000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98199999999999998,"15min":0.98999999999999999},"min":{"1min":0.69399999999999995,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":1.3049999999999999,"5min":1.361,"15min":1.776},"last":0.73899999999999999}]},{"osd":3,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0169999999999999,"15min":1.0089999999999999},"min":{"1min":0.75900000000000001,"5min":0.64100000000000001,"15min":0.46700000000000003},"max":{"1min":1.355,"5min":1.363,"15min":2.0840000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0720000000000001,"15min":1.0800000000000001},"min":{"1min":0.82099999999999995,"5min":0.61399999999999999,"15min":0.44800000000000001},"max":{"1min":1.276,"5min":1.468,"15min":2.181},"last":1.083}]},{"osd":4,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.90400000000000003,"15min":0.91500000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.30199999999999999},"max":{"1min":1.173,"5min":1.444,"15min":1.972},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.995,"5min":1.0249999999999999,"15min":1.0289999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4099999999999999,"5min":1.4830000000000001,"15min":1.8149999999999999},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.008,"15min":1.0189999999999999},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.41799999999999998},"max":{"1min":1.327,"5min":1.5760000000000001,"15min":2.3069999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0469999999999999,"15min":1.0669999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52100000000000002},"max":{"1min":1.3140000000000001,"5min":1.4470000000000001,"15min":1.8959999999999999},"last":1.0569999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1080000000000001,"15min":1.107},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.56999999999999995},"max":{"1min":1.353,"5min":1.5760000000000001,"15min":1.71},"last":1.036},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1519999999999999,"15min":1.167},"min":{"1min":0.69599999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3959999999999999,"5min":1.7110000000000001,"15min":1.8600000000000001},"last":1.1679999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509824,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62188,"kb_used_data":8804,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309652,"statfs":{"total":96636764160,"available":96573083648,"internally_reserved":0,"allocated":9015296,"data_stored":12714767,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.53600000000000003,"5min":0.376,"15min":0.27800000000000002},"max":{"1min":1.3520000000000001,"5min":1.3700000000000001,"15min":1.655},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81299999999999994,"15min":0.78400000000000003},"min":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.34699999999999998},"max":{"1min":1.383,"5min":1.504,"15min":1.7809999999999999},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.83799999999999997,"15min":0.82099999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.30399999999999999},"max":{"1min":1.254,"5min":1.5189999999999999,"15min":1.5329999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.93300000000000005,"15min":0.93600000000000005},"min":{"1min":0.52600000000000002,"5min":0.46200000000000002,"15min":0.26900000000000002},"max":{"1min":1.3700000000000001,"5min":1.4490000000000001,"15min":2.036},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.56599999999999995,"5min":0.48099999999999998,"15min":0.45500000000000002},"max":{"1min":1.5349999999999999,"5min":1.585,"15min":1.9470000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.002,"15min":0.98799999999999999},"min":{"1min":0.63900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.377,"5min":1.534,"15min":1.786},"last":0.442}]},{"osd":4,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.091,"15min":1.0820000000000001},"min":{"1min":0.79800000000000004,"5min":0.65500000000000003,"15min":0.52000000000000002},"max":{"1min":1.6839999999999999,"5min":1.73,"15min":1.73},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.171,"15min":1.143},"min":{"1min":0.85399999999999998,"5min":0.66300000000000003,"15min":0.53700000000000003},"max":{"1min":1.554,"5min":1.875,"15min":2.3039999999999998},"last":0.622}]},{"osd":5,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.80800000000000005,"5min":0.70999999999999996,"15min":0.65700000000000003},"max":{"1min":1.679,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.272,"15min":1.272},"min":{"1min":0.89500000000000002,"5min":0.747,"15min":0.55000000000000004},"max":{"1min":1.798,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3089999999999999,"15min":1.296},"min":{"1min":0.747,"5min":0.747,"15min":0.629},"max":{"1min":1.9179999999999999,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.234,"15min":1.2150000000000001},"min":{"1min":0.98299999999999998,"5min":0.83599999999999997,"15min":0.621},"max":{"1min":1.478,"5min":1.8460000000000001,"15min":1.9059999999999999},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Dec 8 21:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.282,"15min":1.2609999999999999},"min":{"1min":0.94699999999999995,"5min":0.72099999999999997,"15min":0.58899999999999997},"max":{"1min":1.6000000000000001,"5min":1.849,"15min":1.849},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.379,"5min":1.327,"15min":1.306},"min":{"1min":1.05,"5min":0.81799999999999995,"15min":0.58499999999999996},"max":{"1min":1.9239999999999999,"5min":1.966,"15min":2.1640000000000001},"last":0.64500000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509823,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37588,"kb_used_data":6412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334252,"statfs":{"total":96636764160,"available":96598274048,"internally_reserved":0,"allocated":6565888,"data_stored":8520553,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.747,"15min":0.748},"min":{"1min":0.50800000000000001,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.93200000000000005,"5min":1.296,"15min":1.4670000000000001},"last":0.376},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.81599999999999995,"15min":0.80500000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.316},"max":{"1min":1.262,"5min":1.429,"15min":1.482},"last":0.45000000000000001}]},{"osd":1,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.59299999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4430000000000001,"5min":1.466,"15min":1.6599999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.92600000000000005,"15min":0.90800000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":1.2809999999999999,"5min":1.3919999999999999,"15min":4.5620000000000003},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.88400000000000001,"15min":0.85699999999999998},"min":{"1min":0.63500000000000001,"5min":0.52400000000000002,"15min":0.39300000000000002},"max":{"1min":1.5049999999999999,"5min":1.704,"15min":1.704},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.048,"15min":1.014},"min":{"1min":0.75,"5min":0.63600000000000001,"15min":0.44500000000000001},"max":{"1min":1.643,"5min":1.643,"15min":1.661},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.1259999999999999,"15min":1.105},"min":{"1min":0.67800000000000005,"5min":0.65600000000000003,"15min":0.51200000000000001},"max":{"1min":1.3799999999999999,"5min":1.647,"15min":1.726},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.085,"15min":1.046},"min":{"1min":0.80300000000000005,"5min":0.67400000000000004,"15min":0.53700000000000003},"max":{"1min":1.359,"5min":1.609,"15min":1.6240000000000001},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.218,"15min":1.196},"min":{"1min":0.83199999999999996,"5min":0.74099999999999999,"15min":0.624},"max":{"1min":1.458,"5min":1.7649999999999999,"15min":1.8009999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.204,"15min":1.194},"min":{"1min":0.96599999999999997,"5min":0.85499999999999998,"15min":0.61099999999999999},"max":{"1min":1.466,"5min":1.7470000000000001,"15min":1.855},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1519999999999999,"15min":1.139},"min":{"1min":0.84699999999999998,"5min":0.80600000000000005,"15min":0.66300000000000003},"max":{"1min":1.478,"5min":1.5209999999999999,"15min":1.7270000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.246,"5min":1.282,"15min":1.2689999999999999},"min":{"1min":0.93999999999999995,"5min":0.77800000000000002,"15min":0.54700000000000004},"max":{"1min":1.5469999999999999,"5min":1.919,"15min":2.0150000000000001},"last":0.86899999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3,"15min":1.2729999999999999},"min":{"1min":1.0109999999999999,"5min":0.76200000000000001,"15min":0.56999999999999995},"max":{"1min":1.5489999999999999,"5min":1.8400000000000001,"15min":1.9810000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.242,"5min":1.2430000000000001,"15min":1.22},"min":{"1min":0.97499999999999998,"5min":0.82099999999999995,"15min":0.68500000000000005},"max":{"1min":1.6040000000000001,"5min":1.7869999999999999,"15min":1.8240000000000001},"last":0.69799999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509825,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":721711,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.50900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.7689999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.85799999999999998,"15min":0.80700000000000005},"min":{"1min":0.61299999999999999,"5min":0.34200000000000003,"15min":0.33700000000000002},"max":{"1min":1.3340000000000001,"5min":1.556,"15min":1.556},"last":1.1319999999999999}]},{"osd":2,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.75},"min":{"1min":0.54000000000000004,"5min":0.41699999999999998,"15min":0.41599999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.4510000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96699999999999997,"15min":0.91800000000000004},"min":{"1min":0.60599999999999998,"5min":0.50800000000000001,"15min":0.33500000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":2.0019999999999998},"last":1.0800000000000001}]},{"osd":3,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.002,"15min":0.95999999999999996},"min":{"1min":0.51100000000000001,"5min":0.46100000000000002,"15min":0.32400000000000001},"max":{"1min":1.3819999999999999,"5min":1.639,"15min":1.948},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97599999999999998,"15min":0.94099999999999995},"min":{"1min":0.69999999999999996,"5min":0.48699999999999999,"15min":0.35199999999999998},"max":{"1min":1.4099999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1339999999999999,"15min":1.0760000000000001},"min":{"1min":0.80500000000000005,"5min":0.67700000000000005,"15min":0.57299999999999995},"max":{"1min":1.577,"5min":1.879,"15min":1.879},"last":1.22},{"interface":"front","average":{"1min":1.149,"5min":1.194,"15min":1.163},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.626},"max":{"1min":1.5,"5min":1.7470000000000001,"15min":2.0259999999999998},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2190000000000001,"15min":1.163},"min":{"1min":0.76100000000000001,"5min":0.71899999999999997,"15min":0.60199999999999998},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.9179999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2270000000000001,"15min":1.1679999999999999},"min":{"1min":0.92800000000000005,"5min":0.65300000000000002,"15min":0.64600000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.048}]},{"osd":6,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.284,"15min":1.242},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.569,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.01},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.28,"15min":1.238},"min":{"1min":1.008,"5min":0.85299999999999998,"15min":0.66200000000000003},"max":{"1min":1.631,"5min":1.7529999999999999,"15min":2.0259999999999998},"last":1.4399999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3360000000000001,"15min":1.28},"min":{"1min":1.0640000000000001,"5min":0.82799999999999996,"15min":0.66600000000000004},"max":{"1min":1.526,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.349},{"interface":"front","average":{"1min":1.264,"5min":1.298,"15min":1.2450000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.67300000000000004},"max":{"1min":1.786,"5min":1.873,"15min":2.1880000000000002},"last":1.107}]}]},{"osd":0,"up_from":15,"seq":64424509824,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46668,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94325172,"statfs":{"total":96636764160,"available":96588976128,"internally_reserved":0,"allocated":3084288,"data_stored":4325633,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.52500000000000002,"5min":0.35699999999999998,"15min":0.35099999999999998},"max":{"1min":1.2430000000000001,"5min":1.3819999999999999,"15min":1.698},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82299999999999995,"15min":0.81299999999999994},"min":{"1min":0.629,"5min":0.46200000000000002,"15min":0.40600000000000003},"max":{"1min":1.4650000000000001,"5min":1.788,"15min":1.907},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84399999999999997,"15min":0.84699999999999998},"min":{"1min":0.60599999999999998,"5min":0.41999999999999998,"15min":0.34100000000000003},"max":{"1min":1.286,"5min":1.633,"15min":1.633},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.0660000000000001,"5min":0.92300000000000004,"15min":0.88500000000000001},"min":{"1min":0.68899999999999995,"5min":0.432,"15min":0.38400000000000001},"max":{"1min":1.47,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.82999999999999996,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":1.292,"5min":1.2969999999999999,"15min":1.657},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0389999999999999,"15min":1.02},"min":{"1min":0.83499999999999996,"5min":0.40999999999999998,"15min":0.38400000000000001},"max":{"1min":1.631,"5min":1.694,"15min":2.2850000000000001},"last":0.66600000000000004}]},{"osd":4,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.117,"15min":1.105},"min":{"1min":0.84499999999999997,"5min":0.64000000000000001,"15min":0.61299999999999999},"max":{"1min":1.3620000000000001,"5min":1.8480000000000001,"15min":2.1000000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.2330000000000001,"15min":1.1160000000000001},"min":{"1min":0.82799999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.617,"5min":14.787000000000001,"15min":14.787000000000001},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2330000000000001,"15min":1.1890000000000001},"min":{"1min":0.79700000000000004,"5min":0.68000000000000005,"15min":0.61699999999999999},"max":{"1min":1.534,"5min":2.218,"15min":2.218},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2350000000000001,"15min":1.1970000000000001},"min":{"1min":1.071,"5min":0.85499999999999998,"15min":0.66900000000000004},"max":{"1min":1.6870000000000001,"5min":2.0739999999999998,"15min":2.2309999999999999},"last":1.0389999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.167,"15min":1.145},"min":{"1min":0.82499999999999996,"5min":0.66600000000000004,"15min":0.65400000000000003},"max":{"1min":1.7390000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.373,"5min":1.323,"15min":1.284},"min":{"1min":1.046,"5min":0.747,"15min":0.68500000000000005},"max":{"1min":1.782,"5min":1.9379999999999999,"15min":2.1480000000000001},"last":0.97499999999999998}]},{"osd":7,"last update":"Fri Dec 8 21:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.302,"15min":1.2669999999999999},"min":{"1min":1.0249999999999999,"5min":0.83499999999999996,"15min":0.60199999999999998},"max":{"1min":1.784,"5min":2.0059999999999998,"15min":2.3300000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.226,"15min":1.216},"min":{"1min":1.0109999999999999,"5min":0.67000000000000004,"15min":0.58099999999999996},"max":{"1min":1.873,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":0.85099999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542527,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29016,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342824,"statfs":{"total":96636764160,"available":96607051776,"internally_reserved":0,"allocated":2048000,"data_stored":3016855,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.92600000000000005,"15min":0.91200000000000003},"min":{"1min":0.63400000000000001,"5min":0.55200000000000005,"15min":0.38100000000000001},"max":{"1min":1.2669999999999999,"5min":1.8069999999999999,"15min":1.8939999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.208,"5min":1.948,"15min":1.948},"last":0.67200000000000004}]},{"osd":1,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.96899999999999997,"15min":0.93700000000000006},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.244,"5min":3.246,"15min":3.246},"last":0.876},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95299999999999996,"15min":0.94599999999999995},"min":{"1min":0.72299999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.282,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.006}]},{"osd":2,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97999999999999998,"15min":0.97499999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.712,"15min":1.9399999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.018,"5min":0.97499999999999998,"15min":0.97899999999999998},"min":{"1min":0.79000000000000004,"5min":0.50700000000000001,"15min":0.47799999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.8280000000000001},"last":1.1870000000000001}]},{"osd":3,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0509999999999999,"15min":1.036},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.55300000000000005},"max":{"1min":1.3400000000000001,"5min":1.528,"15min":1.528},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.002,"5min":1.024,"15min":1.0109999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.359,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.95099999999999996}]},{"osd":4,"last update":"Fri Dec 8 21:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93999999999999995,"15min":0.96499999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.55300000000000005},"max":{"1min":1.272,"5min":1.3859999999999999,"15min":1.45},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.92600000000000005,"15min":0.98899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2709999999999999,"5min":1.371,"15min":1.5680000000000001},"last":1.0940000000000001}]},{"osd":5,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92800000000000005,"15min":0.98099999999999998},"min":{"1min":0.63800000000000001,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.2270000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.212},{"interface":"front","average":{"1min":1.085,"5min":1.0920000000000001,"15min":1.127},"min":{"1min":0.67800000000000005,"5min":0.66200000000000003,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.6419999999999999,"15min":1.857},"last":1.0620000000000001}]},{"osd":6,"last update":"Fri Dec 8 21:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0289999999999999,"15min":1.079},"min":{"1min":0.77400000000000002,"5min":0.68799999999999994,"15min":0.57399999999999995},"max":{"1min":1.2789999999999999,"5min":1.8380000000000001,"15min":1.948},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.194,"15min":1.212},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6399999999999999,"5min":1.6639999999999999,"15min":2.0019999999999998},"last":1.1259999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542528,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42332,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329508,"statfs":{"total":96636764160,"available":96593416192,"internally_reserved":0,"allocated":2904064,"data_stored":4325577,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.92700000000000005,"15min":0.90100000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48799999999999999},"max":{"1min":1.3919999999999999,"5min":1.395,"15min":1.4430000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.94199999999999995,"15min":0.90300000000000002},"min":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.44900000000000001},"max":{"1min":1.3420000000000001,"5min":1.3979999999999999,"15min":1.4790000000000001},"last":1.044}]},{"osd":1,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.96899999999999997,"15min":0.93300000000000005},"min":{"1min":0.65400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2849999999999999,"5min":1.49,"15min":1.49},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.64300000000000002,"5min":0.53600000000000003,"15min":0.48699999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.512},"last":0.78500000000000003}]},{"osd":2,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98099999999999998,"15min":0.93799999999999994},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.45900000000000002},"max":{"1min":1.357,"5min":1.421,"15min":1.421},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0169999999999999,"15min":0.99199999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.51300000000000001},"max":{"1min":1.4410000000000001,"5min":1.546,"15min":1.546},"last":1.115}]},{"osd":3,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0229999999999999,"15min":1.0209999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.56000000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.708},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.72499999999999998,"5min":0.627,"15min":0.54700000000000004},"max":{"1min":1.389,"5min":1.542,"15min":1.7},"last":0.96299999999999997}]},{"osd":4,"last update":"Fri Dec 8 21:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.96099999999999997,"15min":0.97499999999999998},"min":{"1min":0.68400000000000005,"5min":0.60499999999999998,"15min":0.50900000000000001},"max":{"1min":1.319,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.022,"15min":1.0029999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.57899999999999996},"max":{"1min":1.55,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.1919999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.67500000000000004,"5min":0.56499999999999995,"15min":0.53100000000000003},"max":{"1min":1.2110000000000001,"5min":1.79,"15min":1.79},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1140000000000001,"15min":1.111},"min":{"1min":0.80200000000000005,"5min":0.69399999999999995,"15min":0.432},"max":{"1min":1.6120000000000001,"5min":1.694,"15min":1.694},"last":1.1499999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:24:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0609999999999999,"15min":1.0640000000000001},"min":{"1min":0.72899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.696,"5min":1.732,"15min":1.732},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.196,"15min":1.1990000000000001},"min":{"1min":0.78600000000000003,"5min":0.71499999999999997,"15min":0.47299999999999998},"max":{"1min":1.532,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.4039999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542526,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55520,"kb_used_data":6296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316320,"statfs":{"total":96636764160,"available":96579911680,"internally_reserved":0,"allocated":6447104,"data_stored":8521225,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.90200000000000002},"min":{"1min":0.63900000000000001,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.6000000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92200000000000004,"15min":0.90800000000000003},"min":{"1min":0.54200000000000004,"5min":0.51000000000000001,"15min":0.41399999999999998},"max":{"1min":1.1359999999999999,"5min":1.3440000000000001,"15min":1.391},"last":1.2869999999999999}]},{"osd":1,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93799999999999994,"15min":0.91100000000000003},"min":{"1min":0.64100000000000001,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":1.2629999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0289999999999999,"15min":0.998},"min":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.46100000000000002},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4570000000000001},"last":0.877}]},{"osd":2,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0029999999999999,"15min":1.0089999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3400000000000001,"5min":1.4710000000000001,"15min":1.681},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.95399999999999996,"15min":0.94899999999999995},"min":{"1min":0.67700000000000005,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.1479999999999999,"5min":1.52,"15min":1.52},"last":1.1639999999999999}]},{"osd":3,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.996,"15min":0.98699999999999999},"min":{"1min":0.65500000000000003,"5min":0.63100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2150000000000001,"5min":1.927,"15min":1.927},"last":0.995},{"interface":"front","average":{"1min":1.167,"5min":1.143,"15min":1.1140000000000001},"min":{"1min":0.84199999999999997,"5min":0.64100000000000001,"15min":0.433},"max":{"1min":1.3680000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0389999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.876,"15min":0.91700000000000004},"min":{"1min":0.63700000000000001,"5min":0.56599999999999995,"15min":0.46300000000000002},"max":{"1min":1.034,"5min":1.28,"15min":1.504},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0069999999999999,"15min":0.998},"min":{"1min":0.74299999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.2090000000000001}]},{"osd":6,"last update":"Fri Dec 8 21:25:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.03,"15min":1.0549999999999999},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.54500000000000004},"max":{"1min":1.415,"5min":1.478,"15min":1.617},"last":1.135},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0660000000000001,"15min":1.0569999999999999},"min":{"1min":0.80600000000000005,"5min":0.69899999999999995,"15min":0.52900000000000003},"max":{"1min":1.294,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.1000000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:25:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.159,"15min":1.157},"min":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.39400000000000002},"max":{"1min":1.524,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.254},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0800000000000001,"15min":1.0960000000000001},"min":{"1min":0.72699999999999998,"5min":0.58299999999999996,"15min":0.45400000000000001},"max":{"1min":1.238,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.073}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":4194360,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6246400,"data_stored":8389280,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8695808,"data_stored":12583494,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":8389952,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4313088,"data_stored":7079854,"data_compressed":822166,"data_compressed_allocated":1216512,"data_compressed_original":3993600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":4194304,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1728512,"data_stored":2885582,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T21:25:56.408 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.408 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.409 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.409 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.409 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.409 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.409 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.409 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.409 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.409 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.409 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.410 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.410 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.410 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.410 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.410 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.410 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.410 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.410 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.410 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.411 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.411 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.411 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.411 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.411 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.411 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.411 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.411 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.411 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.411 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.412 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.412 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.412 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.412 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.412 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.412 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.412 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.412 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.412 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.412 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.413 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.413 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.413 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.413 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.413 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.413 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.413 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.413 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.413 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.413 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.414 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.414 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.414 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.414 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.414 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.414 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.415 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.415 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.415 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.415 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.415 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.415 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.416 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.416 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.416 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.416 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.416 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.416 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.417 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.417 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.417 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.417 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.417 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.417 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.418 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.418 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.418 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.418 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.418 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.418 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.419 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.419 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.419 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.419 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.419 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.419 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.420 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.420 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.420 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.420 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.420 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.421 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.421 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.421 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.421 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.421 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.421 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.422 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.422 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.422 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.422 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.422 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.422 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.423 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.423 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.423 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.423 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.423 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.424 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.424 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.424 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.424 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.424 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.425 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.425 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.425 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.425 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.425 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.425 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.426 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.426 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.426 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.427 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:25:56.427 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-08T21:26:03.549 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:26:03.552 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:26:16.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T21:26:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.566+0000 7f3fcfb6e640 1 Processor -- start 2023-12-08T21:26:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.566+0000 7f3fcfb6e640 1 -- start start 2023-12-08T21:26:16.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.566+0000 7f3fcfb6e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3fc8153a80 0x7f3fc80c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:16.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.566+0000 7f3fcfb6e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc815a620 con 0x7f3fc806b1d0 2023-12-08T21:26:16.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.566+0000 7f3fcfb6e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc8159730 con 0x7f3fc806ec90 2023-12-08T21:26:16.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.566+0000 7f3fcfb6e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc8159a10 con 0x7f3fc8153a80 2023-12-08T21:26:16.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.566+0000 7f3fcd109640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3fc806b1d0 0x7f3fc806a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:32964/0 (socket says 172.21.15.53:32964) 2023-12-08T21:26:16.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.566+0000 7f3fcd109640 1 -- 172.21.15.53:0/2878770130 learned_addr learned my addr 172.21.15.53:0/2878770130 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:26:16.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.566+0000 7f3fcd90a640 1 --2- 172.21.15.53:0/2878770130 >> v2:172.21.15.146:3300/0 conn(0x7f3fc8153a80 0x7f3fc80c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:16.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.570+0000 7f3fcc908640 1 -- 172.21.15.53:0/2878770130 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582969084 0 0) 0x7f3fb8001120 con 0x7f3fc806b1d0 2023-12-08T21:26:16.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.570+0000 7f3fcc908640 1 -- 172.21.15.53:0/2878770130 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fb4003530 con 0x7f3fc806b1d0 2023-12-08T21:26:16.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.578+0000 7f3fcd90a640 1 -- 172.21.15.53:0/2878770130 >> v1:172.21.15.146:6789/0 conn(0x7f3fc806ec90 legacy=0x7f3fc806f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:16.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.578+0000 7f3fcd90a640 1 -- 172.21.15.53:0/2878770130 >> v1:172.21.15.53:6789/0 conn(0x7f3fc806b1d0 legacy=0x7f3fc806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:16.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.578+0000 7f3fcd90a640 1 -- 172.21.15.53:0/2878770130 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc8159cf0 con 0x7f3fc8153a80 2023-12-08T21:26:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.586+0000 7f3fcd90a640 1 --2- 172.21.15.53:0/2878770130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc8153a80 0x7f3fc80c2ca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009d90 tx=0x7f3fc401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c22fb0e28956c9e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:26:16.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.598+0000 7f3fcc908640 1 -- 172.21.15.53:0/2878770130 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40a59e0 con 0x7f3fc8153a80 2023-12-08T21:26:16.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.598+0000 7f3fcc908640 1 -- 172.21.15.53:0/2878770130 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc40a5b40 con 0x7f3fc8153a80 2023-12-08T21:26:16.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.598+0000 7f3fcc908640 1 -- 172.21.15.53:0/2878770130 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40ad440 con 0x7f3fc8153a80 2023-12-08T21:26:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.598+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2878770130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc8153a80 msgr2=0x7f3fc80c2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.598+0000 7f3fcfb6e640 1 --2- 172.21.15.53:0/2878770130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc8153a80 0x7f3fc80c2ca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009d90 tx=0x7f3fc401c920 comp rx=0 tx=0).stop 2023-12-08T21:26:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.598+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2878770130 shutdown_connections 2023-12-08T21:26:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.598+0000 7f3fcfb6e640 1 --2- 172.21.15.53:0/2878770130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc8153a80 0x7f3fc80c2ca0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.598+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2878770130 >> 172.21.15.53:0/2878770130 conn(0x7f3fc806b6c0 msgr2=0x7f3fc806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:26:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.598+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2878770130 shutdown_connections 2023-12-08T21:26:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.598+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2878770130 wait complete. 2023-12-08T21:26:16.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fcfb6e640 1 Processor -- start 2023-12-08T21:26:16.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fcfb6e640 1 -- start start 2023-12-08T21:26:16.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fcfb6e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc806b1d0 0x7f3fc80c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:16.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fcfb6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fc806ec90 0x7f3fc81446d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:16.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fcfb6e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fc8153a80 0x7f3fc8140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:16.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fcfb6e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc81429f0 con 0x7f3fc806ec90 2023-12-08T21:26:16.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fcfb6e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc80c5750 con 0x7f3fc806b1d0 2023-12-08T21:26:16.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fcfb6e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc81421d0 con 0x7f3fc8153a80 2023-12-08T21:26:16.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fcd109640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fc806ec90 0x7f3fc81446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:16.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fcd109640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fc806ec90 0x7f3fc81446d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49254/0 (socket says 172.21.15.53:49254) 2023-12-08T21:26:16.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fcd109640 1 -- 172.21.15.53:0/2727321113 learned_addr learned my addr 172.21.15.53:0/2727321113 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:26:16.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fce10b640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fc8153a80 0x7f3fc8140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:16.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.602+0000 7f3fcd90a640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc806b1d0 0x7f3fc80c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:16.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.606+0000 7f3fcd109640 1 -- 172.21.15.53:0/2727321113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fc8153a80 msgr2=0x7f3fc8140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:16.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.606+0000 7f3fcd109640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fc8153a80 0x7f3fc8140960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:16.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.606+0000 7f3fcd109640 1 -- 172.21.15.53:0/2727321113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc806b1d0 msgr2=0x7f3fc80c35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:16.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.606+0000 7f3fcd109640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc806b1d0 0x7f3fc80c35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:16.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.606+0000 7f3fcd109640 1 -- 172.21.15.53:0/2727321113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc4009a70 con 0x7f3fc806ec90 2023-12-08T21:26:16.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.610+0000 7f3fcd109640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fc806ec90 0x7f3fc81446d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c730 tx=0x7f3fb800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:26:16.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.614+0000 7f3fbe7fc640 1 -- 172.21.15.53:0/2727321113 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8005ac0 con 0x7f3fc806ec90 2023-12-08T21:26:16.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.614+0000 7f3fbe7fc640 1 -- 172.21.15.53:0/2727321113 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb8005c20 con 0x7f3fc806ec90 2023-12-08T21:26:16.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.614+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2727321113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc8145110 con 0x7f3fc806ec90 2023-12-08T21:26:16.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.614+0000 7f3fbe7fc640 1 -- 172.21.15.53:0/2727321113 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8007070 con 0x7f3fc806ec90 2023-12-08T21:26:16.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.614+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2727321113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc80c5090 con 0x7f3fc806ec90 2023-12-08T21:26:16.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.614+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2727321113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc8074190 con 0x7f3fc806ec90 2023-12-08T21:26:16.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.918+0000 7f3fbe7fc640 1 -- 172.21.15.53:0/2727321113 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3fb80071d0 con 0x7f3fc806ec90 2023-12-08T21:26:16.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.918+0000 7f3fbe7fc640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3fac0664c0 0x7f3fac068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:16.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.918+0000 7f3fcd90a640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3fac0664c0 0x7f3fac068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:16.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.918+0000 7f3fcd90a640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3fac0664c0 0x7f3fac068980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40af000 tx=0x7f3fc40a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:26:16.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.958+0000 7f3fbe7fc640 1 -- 172.21.15.53:0/2727321113 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f3fb8007d90 con 0x7f3fc806ec90 2023-12-08T21:26:16.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:16.958+0000 7f3fbe7fc640 1 -- 172.21.15.53:0/2727321113 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3fb8050b80 con 0x7f3fc806ec90 2023-12-08T21:26:17.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.134+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2727321113 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fc815a620 con 0x7f3fac0664c0 2023-12-08T21:26:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.162+0000 7f3fbe7fc640 1 -- 172.21.15.53:0/2727321113 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368258 (secure 0 0 0) 0x7f3fc815a620 con 0x7f3fac0664c0 2023-12-08T21:26:17.166 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:26:17.168 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-12-08T21:26:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.166+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2727321113 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3fac0664c0 msgr2=0x7f3fac068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.166+0000 7f3fcfb6e640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3fac0664c0 0x7f3fac068980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40af000 tx=0x7f3fc40a7070 comp rx=0 tx=0).stop 2023-12-08T21:26:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.166+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2727321113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fc806ec90 msgr2=0x7f3fc81446d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.166+0000 7f3fcfb6e640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fc806ec90 0x7f3fc81446d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c730 tx=0x7f3fb800cbf0 comp rx=0 tx=0).stop 2023-12-08T21:26:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.166+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2727321113 shutdown_connections 2023-12-08T21:26:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.166+0000 7f3fcfb6e640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f3fac0664c0 0x7f3fac068980 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.166+0000 7f3fcfb6e640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fc8153a80 0x7f3fc8140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.166+0000 7f3fcfb6e640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fc806ec90 0x7f3fc81446d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.166+0000 7f3fcfb6e640 1 --2- 172.21.15.53:0/2727321113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc806b1d0 0x7f3fc80c35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:17.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.166+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2727321113 >> 172.21.15.53:0/2727321113 conn(0x7f3fc806b6c0 msgr2=0x7f3fc813f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:26:17.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.166+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2727321113 shutdown_connections 2023-12-08T21:26:17.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:17.166+0000 7f3fcfb6e640 1 -- 172.21.15.53:0/2727321113 wait complete. 2023-12-08T21:26:17.189 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":989,"stamp":"2023-12-08T21:26:16.059590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24448816,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":690,"num_read_kb":695,"num_write":8182,"num_write_kb":281588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9426,"ondisk_log_size":9426,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332312,"kb_used_data":34328,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754642408,"statfs":{"total":773094113280,"available":772753825792,"internally_reserved":0,"allocated":35151872,"data_stored":49947816,"data_compressed":4799006,"data_compressed_allocated":7397376,"data_compressed_original":23764992,"omap_allocated":12752,"internal_metadata":305057328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005230"},"pg_stats":[{"pgid":"2.1f","version":"30'723","reported_seq":768,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.005407+0000","last_change":"2023-12-08T21:26:04.005407+0000","last_active":"2023-12-08T21:26:04.005407+0000","last_peered":"2023-12-08T21:26:04.005407+0000","last_clean":"2023-12-08T21:26:04.005407+0000","last_became_active":"2023-12-08T20:54:54.982479+0000","last_became_peered":"2023-12-08T20:54:54.982479+0000","last_unstale":"2023-12-08T21:26:04.005407+0000","last_undegraded":"2023-12-08T21:26:04.005407+0000","last_fullsized":"2023-12-08T21:26:04.005407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'723","last_scrub_stamp":"2023-12-08T21:26:04.005126+0000","last_deep_scrub":"30'723","last_deep_scrub_stamp":"2023-12-08T21:26:04.005126+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.005126+0000","objects_scrubbed":3,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:15:19.024106+0000","scrub_duration":0.032565425000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":4491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.546695+0000","last_change":"2023-12-08T20:54:56.407614+0000","last_active":"2023-12-08T21:25:37.546695+0000","last_peered":"2023-12-08T21:25:37.546695+0000","last_clean":"2023-12-08T21:25:37.546695+0000","last_became_active":"2023-12-08T20:54:56.406245+0000","last_became_peered":"2023-12-08T20:54:56.406245+0000","last_unstale":"2023-12-08T21:25:37.546695+0000","last_undegraded":"2023-12-08T21:25:37.546695+0000","last_fullsized":"2023-12-08T21:25:37.546695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'66","reported_seq":94,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.288884+0000","last_change":"2023-12-08T20:55:04.459400+0000","last_active":"2023-12-08T21:24:33.288884+0000","last_peered":"2023-12-08T21:24:33.288884+0000","last_clean":"2023-12-08T21:24:33.288884+0000","last_became_active":"2023-12-08T20:55:04.458087+0000","last_became_peered":"2023-12-08T20:55:04.458087+0000","last_unstale":"2023-12-08T21:24:33.288884+0000","last_undegraded":"2023-12-08T21:24:33.288884+0000","last_fullsized":"2023-12-08T21:24:33.288884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'291","reported_seq":336,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:12.896378+0000","last_change":"2023-12-08T21:26:12.896418+0000","last_active":"2023-12-08T21:26:12.896378+0000","last_peered":"2023-12-08T21:26:12.896378+0000","last_clean":"2023-12-08T21:26:12.896378+0000","last_became_active":"2023-12-08T20:54:54.929391+0000","last_became_peered":"2023-12-08T20:54:54.929391+0000","last_unstale":"2023-12-08T21:26:12.896378+0000","last_undegraded":"2023-12-08T21:26:12.896378+0000","last_fullsized":"2023-12-08T21:26:12.896378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'291","last_scrub_stamp":"2023-12-08T21:26:12.896235+0000","last_deep_scrub":"30'291","last_deep_scrub_stamp":"2023-12-08T21:26:12.896235+0000","last_clean_scrub_stamp":"2023-12-08T21:26:12.896235+0000","objects_scrubbed":1,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:55:16.287502+0000","scrub_duration":0.026480232999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759983,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":2843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:05.915231+0000","last_change":"2023-12-08T21:26:05.915231+0000","last_active":"2023-12-08T21:26:05.915231+0000","last_peered":"2023-12-08T21:26:05.915231+0000","last_clean":"2023-12-08T21:26:05.915231+0000","last_became_active":"2023-12-08T20:54:56.408361+0000","last_became_peered":"2023-12-08T20:54:56.408361+0000","last_unstale":"2023-12-08T21:26:05.915231+0000","last_undegraded":"2023-12-08T21:26:05.915231+0000","last_fullsized":"2023-12-08T21:26:05.915231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:05.914915+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:05.914915+0000","last_clean_scrub_stamp":"2023-12-08T21:26:05.914915+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:55:04.773085+0000","scrub_duration":0.0057752130000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'74","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:29.773661+0000","last_change":"2023-12-08T20:55:04.529086+0000","last_active":"2023-12-08T21:24:29.773661+0000","last_peered":"2023-12-08T21:24:29.773661+0000","last_clean":"2023-12-08T21:24:29.773661+0000","last_became_active":"2023-12-08T20:55:04.528732+0000","last_became_peered":"2023-12-08T20:55:04.528732+0000","last_unstale":"2023-12-08T21:24:29.773661+0000","last_undegraded":"2023-12-08T21:24:29.773661+0000","last_fullsized":"2023-12-08T21:24:29.773661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'10","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.114439+0000","last_change":"2023-12-08T21:26:06.114494+0000","last_active":"2023-12-08T21:26:06.114439+0000","last_peered":"2023-12-08T21:26:06.114439+0000","last_clean":"2023-12-08T21:26:06.114439+0000","last_became_active":"2023-12-08T20:54:54.935620+0000","last_became_peered":"2023-12-08T20:54:54.935620+0000","last_unstale":"2023-12-08T21:26:06.114439+0000","last_undegraded":"2023-12-08T21:26:06.114439+0000","last_fullsized":"2023-12-08T21:26:06.114439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'10","last_scrub_stamp":"2023-12-08T21:26:06.114261+0000","last_deep_scrub":"30'10","last_deep_scrub_stamp":"2023-12-08T21:26:06.114261+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.114261+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:08:13.151028+0000","scrub_duration":0.0062390579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'23","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.720222+0000","last_change":"2023-12-08T21:25:55.720252+0000","last_active":"2023-12-08T21:25:55.720222+0000","last_peered":"2023-12-08T21:25:55.720222+0000","last_clean":"2023-12-08T21:25:55.720222+0000","last_became_active":"2023-12-08T20:54:56.380927+0000","last_became_peered":"2023-12-08T20:54:56.380927+0000","last_unstale":"2023-12-08T21:25:55.720222+0000","last_undegraded":"2023-12-08T21:25:55.720222+0000","last_fullsized":"2023-12-08T21:25:55.720222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-12-08T21:25:55.720096+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-12-08T21:25:55.720096+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.720096+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:07:37.367406+0000","scrub_duration":0.001780451,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'75","reported_seq":103,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.075186+0000","last_change":"2023-12-08T20:55:04.527024+0000","last_active":"2023-12-08T21:25:04.075186+0000","last_peered":"2023-12-08T21:25:04.075186+0000","last_clean":"2023-12-08T21:25:04.075186+0000","last_became_active":"2023-12-08T20:55:04.526605+0000","last_became_peered":"2023-12-08T20:55:04.526605+0000","last_unstale":"2023-12-08T21:25:04.075186+0000","last_undegraded":"2023-12-08T21:25:04.075186+0000","last_fullsized":"2023-12-08T21:25:04.075186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'4","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.138425+0000","last_change":"2023-12-08T21:25:59.138488+0000","last_active":"2023-12-08T21:25:59.138425+0000","last_peered":"2023-12-08T21:25:59.138425+0000","last_clean":"2023-12-08T21:25:59.138425+0000","last_became_active":"2023-12-08T20:54:54.926132+0000","last_became_peered":"2023-12-08T20:54:54.926132+0000","last_unstale":"2023-12-08T21:25:59.138425+0000","last_undegraded":"2023-12-08T21:25:59.138425+0000","last_fullsized":"2023-12-08T21:25:59.138425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:25:59.138233+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:25:59.138233+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.138233+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:45:09.492467+0000","scrub_duration":0.0063764290000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.270295+0000","last_change":"2023-12-08T21:25:53.270348+0000","last_active":"2023-12-08T21:25:53.270295+0000","last_peered":"2023-12-08T21:25:53.270295+0000","last_clean":"2023-12-08T21:25:53.270295+0000","last_became_active":"2023-12-08T20:54:56.387528+0000","last_became_peered":"2023-12-08T20:54:56.387528+0000","last_unstale":"2023-12-08T21:25:53.270295+0000","last_undegraded":"2023-12-08T21:25:53.270295+0000","last_fullsized":"2023-12-08T21:25:53.270295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-12-08T21:25:53.270101+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-12-08T21:25:53.270101+0000","last_clean_scrub_stamp":"2023-12-08T21:25:53.270101+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:05:32.821478+0000","scrub_duration":0.0031071860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'65","reported_seq":93,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.075060+0000","last_change":"2023-12-08T20:55:04.523251+0000","last_active":"2023-12-08T21:25:04.075060+0000","last_peered":"2023-12-08T21:25:04.075060+0000","last_clean":"2023-12-08T21:25:04.075060+0000","last_became_active":"2023-12-08T20:55:04.522777+0000","last_became_peered":"2023-12-08T20:55:04.522777+0000","last_unstale":"2023-12-08T21:25:04.075060+0000","last_undegraded":"2023-12-08T21:25:04.075060+0000","last_fullsized":"2023-12-08T21:25:04.075060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'17","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:56.220369+0000","last_change":"2023-12-08T21:25:56.220422+0000","last_active":"2023-12-08T21:25:56.220369+0000","last_peered":"2023-12-08T21:25:56.220369+0000","last_clean":"2023-12-08T21:25:56.220369+0000","last_became_active":"2023-12-08T20:54:56.318855+0000","last_became_peered":"2023-12-08T20:54:56.318855+0000","last_unstale":"2023-12-08T21:25:56.220369+0000","last_undegraded":"2023-12-08T21:25:56.220369+0000","last_fullsized":"2023-12-08T21:25:56.220369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:25:56.220174+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:25:56.220174+0000","last_clean_scrub_stamp":"2023-12-08T21:25:56.220174+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:56:56.117995+0000","scrub_duration":0.0032244330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'722","reported_seq":757,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:15.971162+0000","last_change":"2023-12-08T20:54:54.929584+0000","last_active":"2023-12-08T21:25:15.971162+0000","last_peered":"2023-12-08T21:25:15.971162+0000","last_clean":"2023-12-08T21:25:15.971162+0000","last_became_active":"2023-12-08T20:54:54.928702+0000","last_became_peered":"2023-12-08T20:54:54.928702+0000","last_unstale":"2023-12-08T21:25:15.971162+0000","last_undegraded":"2023-12-08T21:25:15.971162+0000","last_fullsized":"2023-12-08T21:25:15.971162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'78","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.281055+0000","last_change":"2023-12-08T20:55:04.535786+0000","last_active":"2023-12-08T21:24:33.281055+0000","last_peered":"2023-12-08T21:24:33.281055+0000","last_clean":"2023-12-08T21:24:33.281055+0000","last_became_active":"2023-12-08T20:55:04.535119+0000","last_became_peered":"2023-12-08T20:55:04.535119+0000","last_unstale":"2023-12-08T21:24:33.281055+0000","last_undegraded":"2023-12-08T21:24:33.281055+0000","last_fullsized":"2023-12-08T21:24:33.281055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":12383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'19","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.326746+0000","last_change":"2023-12-08T21:26:08.326859+0000","last_active":"2023-12-08T21:26:08.326746+0000","last_peered":"2023-12-08T21:26:08.326746+0000","last_clean":"2023-12-08T21:26:08.326746+0000","last_became_active":"2023-12-08T20:54:56.370044+0000","last_became_peered":"2023-12-08T20:54:56.370044+0000","last_unstale":"2023-12-08T21:26:08.326746+0000","last_undegraded":"2023-12-08T21:26:08.326746+0000","last_fullsized":"2023-12-08T21:26:08.326746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2023-12-08T21:26:08.326522+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2023-12-08T21:26:08.326522+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.326522+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:07:31.757565+0000","scrub_duration":0.0050124770000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'5","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:57.537252+0000","last_change":"2023-12-08T21:25:57.537304+0000","last_active":"2023-12-08T21:25:57.537252+0000","last_peered":"2023-12-08T21:25:57.537252+0000","last_clean":"2023-12-08T21:25:57.537252+0000","last_became_active":"2023-12-08T20:54:54.922960+0000","last_became_peered":"2023-12-08T20:54:54.922960+0000","last_unstale":"2023-12-08T21:25:57.537252+0000","last_undegraded":"2023-12-08T21:25:57.537252+0000","last_fullsized":"2023-12-08T21:25:57.537252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:25:57.537058+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:25:57.537058+0000","last_clean_scrub_stamp":"2023-12-08T21:25:57.537058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:59:00.836091+0000","scrub_duration":0.0026381299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'95","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:32.087861+0000","last_change":"2023-12-08T20:55:04.522655+0000","last_active":"2023-12-08T21:24:32.087861+0000","last_peered":"2023-12-08T21:24:32.087861+0000","last_clean":"2023-12-08T21:24:32.087861+0000","last_became_active":"2023-12-08T20:55:04.522172+0000","last_became_peered":"2023-12-08T20:55:04.522172+0000","last_unstale":"2023-12-08T21:24:32.087861+0000","last_undegraded":"2023-12-08T21:24:32.087861+0000","last_fullsized":"2023-12-08T21:24:32.087861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'24","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.988500+0000","last_change":"2023-12-08T21:26:06.988550+0000","last_active":"2023-12-08T21:26:06.988500+0000","last_peered":"2023-12-08T21:26:06.988500+0000","last_clean":"2023-12-08T21:26:06.988500+0000","last_became_active":"2023-12-08T20:54:56.365552+0000","last_became_peered":"2023-12-08T20:54:56.365552+0000","last_unstale":"2023-12-08T21:26:06.988500+0000","last_undegraded":"2023-12-08T21:26:06.988500+0000","last_fullsized":"2023-12-08T21:26:06.988500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:06.988314+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:06.988314+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.988314+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:03:51.063039+0000","scrub_duration":0.0036073989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'3","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.063454+0000","last_change":"2023-12-08T21:26:01.063563+0000","last_active":"2023-12-08T21:26:01.063454+0000","last_peered":"2023-12-08T21:26:01.063454+0000","last_clean":"2023-12-08T21:26:01.063454+0000","last_became_active":"2023-12-08T20:54:54.979668+0000","last_became_peered":"2023-12-08T20:54:54.979668+0000","last_unstale":"2023-12-08T21:26:01.063454+0000","last_undegraded":"2023-12-08T21:26:01.063454+0000","last_fullsized":"2023-12-08T21:26:01.063454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:26:01.063157+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:26:01.063157+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.063157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:35:10.066399+0000","scrub_duration":0.0036668270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'67","reported_seq":96,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.181780+0000","last_change":"2023-12-08T20:55:04.513186+0000","last_active":"2023-12-08T21:24:31.181780+0000","last_peered":"2023-12-08T21:24:31.181780+0000","last_clean":"2023-12-08T21:24:31.181780+0000","last_became_active":"2023-12-08T20:55:04.512549+0000","last_became_peered":"2023-12-08T20:55:04.512549+0000","last_unstale":"2023-12-08T21:24:31.181780+0000","last_undegraded":"2023-12-08T21:24:31.181780+0000","last_fullsized":"2023-12-08T21:24:31.181780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:05.098379+0000","last_change":"2023-12-08T21:26:05.098498+0000","last_active":"2023-12-08T21:26:05.098379+0000","last_peered":"2023-12-08T21:26:05.098379+0000","last_clean":"2023-12-08T21:26:05.098379+0000","last_became_active":"2023-12-08T20:54:56.260355+0000","last_became_peered":"2023-12-08T20:54:56.260355+0000","last_unstale":"2023-12-08T21:26:05.098379+0000","last_undegraded":"2023-12-08T21:26:05.098379+0000","last_fullsized":"2023-12-08T21:26:05.098379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:05.098155+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:05.098155+0000","last_clean_scrub_stamp":"2023-12-08T21:26:05.098155+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:42:49.369328+0000","scrub_duration":0.0031917870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'6","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:00.129273+0000","last_change":"2023-12-08T21:26:00.129326+0000","last_active":"2023-12-08T21:26:00.129273+0000","last_peered":"2023-12-08T21:26:00.129273+0000","last_clean":"2023-12-08T21:26:00.129273+0000","last_became_active":"2023-12-08T20:54:54.925888+0000","last_became_peered":"2023-12-08T20:54:54.925888+0000","last_unstale":"2023-12-08T21:26:00.129273+0000","last_undegraded":"2023-12-08T21:26:00.129273+0000","last_fullsized":"2023-12-08T21:26:00.129273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:26:00.129079+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:26:00.129079+0000","last_clean_scrub_stamp":"2023-12-08T21:26:00.129079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:31:04.788470+0000","scrub_duration":0.002440752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'77","reported_seq":106,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:29.774010+0000","last_change":"2023-12-08T20:55:04.529041+0000","last_active":"2023-12-08T21:24:29.774010+0000","last_peered":"2023-12-08T21:24:29.774010+0000","last_clean":"2023-12-08T21:24:29.774010+0000","last_became_active":"2023-12-08T20:55:04.528640+0000","last_became_peered":"2023-12-08T20:55:04.528640+0000","last_unstale":"2023-12-08T21:24:29.774010+0000","last_undegraded":"2023-12-08T21:24:29.774010+0000","last_fullsized":"2023-12-08T21:24:29.774010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.094936+0000","last_change":"2023-12-08T21:25:55.094987+0000","last_active":"2023-12-08T21:25:55.094936+0000","last_peered":"2023-12-08T21:25:55.094936+0000","last_clean":"2023-12-08T21:25:55.094936+0000","last_became_active":"2023-12-08T20:54:56.364597+0000","last_became_peered":"2023-12-08T20:54:56.364597+0000","last_unstale":"2023-12-08T21:25:55.094936+0000","last_undegraded":"2023-12-08T21:25:55.094936+0000","last_fullsized":"2023-12-08T21:25:55.094936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-12-08T21:25:55.094713+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-12-08T21:25:55.094713+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.094713+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:04:47.008353+0000","scrub_duration":0.00344094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'5","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:17.406141+0000","last_change":"2023-12-08T20:54:54.928399+0000","last_active":"2023-12-08T21:25:17.406141+0000","last_peered":"2023-12-08T21:25:17.406141+0000","last_clean":"2023-12-08T21:25:17.406141+0000","last_became_active":"2023-12-08T20:54:54.927814+0000","last_became_peered":"2023-12-08T20:54:54.927814+0000","last_unstale":"2023-12-08T21:25:17.406141+0000","last_undegraded":"2023-12-08T21:25:17.406141+0000","last_fullsized":"2023-12-08T21:25:17.406141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'64","reported_seq":94,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.296494+0000","last_change":"2023-12-08T20:55:04.523561+0000","last_active":"2023-12-08T21:24:33.296494+0000","last_peered":"2023-12-08T21:24:33.296494+0000","last_clean":"2023-12-08T21:24:33.296494+0000","last_became_active":"2023-12-08T20:55:04.522714+0000","last_became_peered":"2023-12-08T20:55:04.522714+0000","last_unstale":"2023-12-08T21:24:33.296494+0000","last_undegraded":"2023-12-08T21:24:33.296494+0000","last_fullsized":"2023-12-08T21:24:33.296494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":9451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.701201+0000","last_change":"2023-12-08T20:54:56.331268+0000","last_active":"2023-12-08T21:25:37.701201+0000","last_peered":"2023-12-08T21:25:37.701201+0000","last_clean":"2023-12-08T21:25:37.701201+0000","last_became_active":"2023-12-08T20:54:56.330508+0000","last_became_peered":"2023-12-08T20:54:56.330508+0000","last_unstale":"2023-12-08T21:25:37.701201+0000","last_undegraded":"2023-12-08T21:25:37.701201+0000","last_fullsized":"2023-12-08T21:25:37.701201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'333","reported_seq":377,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:02.992564+0000","last_change":"2023-12-08T21:26:02.992617+0000","last_active":"2023-12-08T21:26:02.992564+0000","last_peered":"2023-12-08T21:26:02.992564+0000","last_clean":"2023-12-08T21:26:02.992564+0000","last_became_active":"2023-12-08T20:54:54.981168+0000","last_became_peered":"2023-12-08T20:54:54.981168+0000","last_unstale":"2023-12-08T21:26:02.992564+0000","last_undegraded":"2023-12-08T21:26:02.992564+0000","last_fullsized":"2023-12-08T21:26:02.992564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'333","last_scrub_stamp":"2023-12-08T21:26:02.992373+0000","last_deep_scrub":"30'333","last_deep_scrub_stamp":"2023-12-08T21:26:02.992373+0000","last_clean_scrub_stamp":"2023-12-08T21:26:02.992373+0000","objects_scrubbed":1,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:49:36.659212+0000","scrub_duration":0.013256799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'104","reported_seq":135,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:12.042794+0000","last_change":"2023-12-08T20:55:04.513360+0000","last_active":"2023-12-08T21:25:12.042794+0000","last_peered":"2023-12-08T21:25:12.042794+0000","last_clean":"2023-12-08T21:25:12.042794+0000","last_became_active":"2023-12-08T20:55:04.511032+0000","last_became_peered":"2023-12-08T20:55:04.511032+0000","last_unstale":"2023-12-08T21:25:12.042794+0000","last_undegraded":"2023-12-08T21:25:12.042794+0000","last_fullsized":"2023-12-08T21:25:12.042794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":14212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'22","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.466208+0000","last_change":"2023-12-08T21:26:06.466208+0000","last_active":"2023-12-08T21:26:06.466208+0000","last_peered":"2023-12-08T21:26:06.466208+0000","last_clean":"2023-12-08T21:26:06.466208+0000","last_became_active":"2023-12-08T20:54:56.409291+0000","last_became_peered":"2023-12-08T20:54:56.409291+0000","last_unstale":"2023-12-08T21:26:06.466208+0000","last_undegraded":"2023-12-08T21:26:06.466208+0000","last_fullsized":"2023-12-08T21:26:06.466208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:06.465949+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:06.465949+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.465949+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:01:20.008768+0000","scrub_duration":0.0028777999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'5","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:26.710053+0000","last_change":"2023-12-08T20:54:54.978750+0000","last_active":"2023-12-08T21:25:26.710053+0000","last_peered":"2023-12-08T21:25:26.710053+0000","last_clean":"2023-12-08T21:25:26.710053+0000","last_became_active":"2023-12-08T20:54:54.978416+0000","last_became_peered":"2023-12-08T20:54:54.978416+0000","last_unstale":"2023-12-08T21:25:26.710053+0000","last_undegraded":"2023-12-08T21:25:26.710053+0000","last_fullsized":"2023-12-08T21:25:26.710053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'75","reported_seq":105,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.187523+0000","last_change":"2023-12-08T20:55:04.507859+0000","last_active":"2023-12-08T21:24:31.187523+0000","last_peered":"2023-12-08T21:24:31.187523+0000","last_clean":"2023-12-08T21:24:31.187523+0000","last_became_active":"2023-12-08T20:55:04.507454+0000","last_became_peered":"2023-12-08T20:55:04.507454+0000","last_unstale":"2023-12-08T21:24:31.187523+0000","last_undegraded":"2023-12-08T21:24:31.187523+0000","last_fullsized":"2023-12-08T21:24:31.187523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'17","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.919801+0000","last_change":"2023-12-08T21:25:55.919895+0000","last_active":"2023-12-08T21:25:55.919801+0000","last_peered":"2023-12-08T21:25:55.919801+0000","last_clean":"2023-12-08T21:25:55.919801+0000","last_became_active":"2023-12-08T20:54:56.369974+0000","last_became_peered":"2023-12-08T20:54:56.369974+0000","last_unstale":"2023-12-08T21:25:55.919801+0000","last_undegraded":"2023-12-08T21:25:55.919801+0000","last_fullsized":"2023-12-08T21:25:55.919801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:25:55.919642+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:25:55.919642+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.919642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:26:40.855619+0000","scrub_duration":0.0027648270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'3","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.967650+0000","last_change":"2023-12-08T21:26:08.967650+0000","last_active":"2023-12-08T21:26:08.967650+0000","last_peered":"2023-12-08T21:26:08.967650+0000","last_clean":"2023-12-08T21:26:08.967650+0000","last_became_active":"2023-12-08T20:54:54.925022+0000","last_became_peered":"2023-12-08T20:54:54.925022+0000","last_unstale":"2023-12-08T21:26:08.967650+0000","last_undegraded":"2023-12-08T21:26:08.967650+0000","last_fullsized":"2023-12-08T21:26:08.967650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:26:08.967384+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:26:08.967384+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.967384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:00:44.981669+0000","scrub_duration":0.0030121089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'85","reported_seq":115,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:29.756559+0000","last_change":"2023-12-08T20:55:04.531931+0000","last_active":"2023-12-08T21:24:29.756559+0000","last_peered":"2023-12-08T21:24:29.756559+0000","last_clean":"2023-12-08T21:24:29.756559+0000","last_became_active":"2023-12-08T20:55:04.530774+0000","last_became_peered":"2023-12-08T20:55:04.530774+0000","last_unstale":"2023-12-08T21:24:29.756559+0000","last_undegraded":"2023-12-08T21:24:29.756559+0000","last_fullsized":"2023-12-08T21:24:29.756559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:48.955617+0000","last_change":"2023-12-08T21:25:48.955617+0000","last_active":"2023-12-08T21:25:48.955617+0000","last_peered":"2023-12-08T21:25:48.955617+0000","last_clean":"2023-12-08T21:25:48.955617+0000","last_became_active":"2023-12-08T20:54:56.385090+0000","last_became_peered":"2023-12-08T20:54:56.385090+0000","last_unstale":"2023-12-08T21:25:48.955617+0000","last_undegraded":"2023-12-08T21:25:48.955617+0000","last_fullsized":"2023-12-08T21:25:48.955617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:25:48.955488+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:25:48.955488+0000","last_clean_scrub_stamp":"2023-12-08T21:25:48.955488+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:12:34.372718+0000","scrub_duration":0.001815419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'6","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:51.795438+0000","last_change":"2023-12-08T20:54:54.932503+0000","last_active":"2023-12-08T21:25:51.795438+0000","last_peered":"2023-12-08T21:25:51.795438+0000","last_clean":"2023-12-08T21:25:51.795438+0000","last_became_active":"2023-12-08T20:54:54.932121+0000","last_became_peered":"2023-12-08T20:54:54.932121+0000","last_unstale":"2023-12-08T21:25:51.795438+0000","last_undegraded":"2023-12-08T21:25:51.795438+0000","last_fullsized":"2023-12-08T21:25:51.795438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'55","reported_seq":85,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:26.214926+0000","last_change":"2023-12-08T20:55:04.529911+0000","last_active":"2023-12-08T21:24:26.214926+0000","last_peered":"2023-12-08T21:24:26.214926+0000","last_clean":"2023-12-08T21:24:26.214926+0000","last_became_active":"2023-12-08T20:55:04.528698+0000","last_became_peered":"2023-12-08T20:55:04.528698+0000","last_unstale":"2023-12-08T21:24:26.214926+0000","last_undegraded":"2023-12-08T21:24:26.214926+0000","last_fullsized":"2023-12-08T21:24:26.214926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'24","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548809+0000","last_change":"2023-12-08T20:54:56.413886+0000","last_active":"2023-12-08T21:25:37.548809+0000","last_peered":"2023-12-08T21:25:37.548809+0000","last_clean":"2023-12-08T21:25:37.548809+0000","last_became_active":"2023-12-08T20:54:56.412786+0000","last_became_peered":"2023-12-08T20:54:56.412786+0000","last_unstale":"2023-12-08T21:25:37.548809+0000","last_undegraded":"2023-12-08T21:25:37.548809+0000","last_fullsized":"2023-12-08T21:25:37.548809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'577","reported_seq":1196,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:05.340354+0000","last_change":"2023-12-08T21:26:05.340354+0000","last_active":"2023-12-08T21:26:05.340354+0000","last_peered":"2023-12-08T21:26:05.340354+0000","last_clean":"2023-12-08T21:26:05.340354+0000","last_became_active":"2023-12-08T20:54:54.922014+0000","last_became_peered":"2023-12-08T20:54:54.922014+0000","last_unstale":"2023-12-08T21:26:05.340354+0000","last_undegraded":"2023-12-08T21:26:05.340354+0000","last_fullsized":"2023-12-08T21:26:05.340354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'577","last_scrub_stamp":"2023-12-08T21:26:05.340116+0000","last_deep_scrub":"30'577","last_deep_scrub_stamp":"2023-12-08T21:26:05.340116+0000","last_clean_scrub_stamp":"2023-12-08T21:26:05.340116+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:25.924782+0000","scrub_duration":0.0067660819999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125475,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":574,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'71","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:27.832956+0000","last_change":"2023-12-08T20:55:04.509438+0000","last_active":"2023-12-08T21:25:27.832956+0000","last_peered":"2023-12-08T21:25:27.832956+0000","last_clean":"2023-12-08T21:25:27.832956+0000","last_became_active":"2023-12-08T20:55:04.508219+0000","last_became_peered":"2023-12-08T20:55:04.508219+0000","last_unstale":"2023-12-08T21:25:27.832956+0000","last_undegraded":"2023-12-08T21:25:27.832956+0000","last_fullsized":"2023-12-08T21:25:27.832956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'15","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.515080+0000","last_change":"2023-12-08T21:26:01.515080+0000","last_active":"2023-12-08T21:26:01.515080+0000","last_peered":"2023-12-08T21:26:01.515080+0000","last_clean":"2023-12-08T21:26:01.515080+0000","last_became_active":"2023-12-08T20:54:56.370121+0000","last_became_peered":"2023-12-08T20:54:56.370121+0000","last_unstale":"2023-12-08T21:26:01.515080+0000","last_undegraded":"2023-12-08T21:26:01.515080+0000","last_fullsized":"2023-12-08T21:26:01.515080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2023-12-08T21:26:01.514730+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2023-12-08T21:26:01.514730+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.514730+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:38:40.393317+0000","scrub_duration":0.0030279830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'5","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:15.000762+0000","last_change":"2023-12-08T20:54:54.927599+0000","last_active":"2023-12-08T21:25:15.000762+0000","last_peered":"2023-12-08T21:25:15.000762+0000","last_clean":"2023-12-08T21:25:15.000762+0000","last_became_active":"2023-12-08T20:54:54.927120+0000","last_became_peered":"2023-12-08T20:54:54.927120+0000","last_unstale":"2023-12-08T21:25:15.000762+0000","last_undegraded":"2023-12-08T21:25:15.000762+0000","last_fullsized":"2023-12-08T21:25:15.000762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'100","reported_seq":130,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.118553+0000","last_change":"2023-12-08T20:55:04.546945+0000","last_active":"2023-12-08T21:25:24.118553+0000","last_peered":"2023-12-08T21:25:24.118553+0000","last_clean":"2023-12-08T21:25:24.118553+0000","last_became_active":"2023-12-08T20:55:04.546439+0000","last_became_peered":"2023-12-08T20:55:04.546439+0000","last_unstale":"2023-12-08T21:25:24.118553+0000","last_undegraded":"2023-12-08T21:25:24.118553+0000","last_fullsized":"2023-12-08T21:25:24.118553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'20","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.022881+0000","last_change":"2023-12-08T21:26:08.022881+0000","last_active":"2023-12-08T21:26:08.022881+0000","last_peered":"2023-12-08T21:26:08.022881+0000","last_clean":"2023-12-08T21:26:08.022881+0000","last_became_active":"2023-12-08T20:54:56.372205+0000","last_became_peered":"2023-12-08T20:54:56.372205+0000","last_unstale":"2023-12-08T21:26:08.022881+0000","last_undegraded":"2023-12-08T21:26:08.022881+0000","last_fullsized":"2023-12-08T21:26:08.022881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:08.022557+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:08.022557+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.022557+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:31:12.681949+0000","scrub_duration":0.0030864669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'2","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:51.795403+0000","last_change":"2023-12-08T20:54:54.929937+0000","last_active":"2023-12-08T21:25:51.795403+0000","last_peered":"2023-12-08T21:25:51.795403+0000","last_clean":"2023-12-08T21:25:51.795403+0000","last_became_active":"2023-12-08T20:54:54.929177+0000","last_became_peered":"2023-12-08T20:54:54.929177+0000","last_unstale":"2023-12-08T21:25:51.795403+0000","last_undegraded":"2023-12-08T21:25:51.795403+0000","last_fullsized":"2023-12-08T21:25:51.795403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:50.676527+0000","last_change":"2023-12-08T21:25:50.676647+0000","last_active":"2023-12-08T21:25:50.676527+0000","last_peered":"2023-12-08T21:25:50.676527+0000","last_clean":"2023-12-08T21:25:50.676527+0000","last_became_active":"2023-12-08T20:54:16.147507+0000","last_became_peered":"2023-12-08T20:54:16.147507+0000","last_unstale":"2023-12-08T21:25:50.676527+0000","last_undegraded":"2023-12-08T21:25:50.676527+0000","last_fullsized":"2023-12-08T21:25:50.676527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-12-08T21:25:50.676240+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-12-08T21:25:50.676240+0000","last_clean_scrub_stamp":"2023-12-08T21:25:50.676240+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:06:52.271476+0000","scrub_duration":0.014230578000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'75","reported_seq":105,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:29.765402+0000","last_change":"2023-12-08T20:55:04.515531+0000","last_active":"2023-12-08T21:24:29.765402+0000","last_peered":"2023-12-08T21:24:29.765402+0000","last_clean":"2023-12-08T21:24:29.765402+0000","last_became_active":"2023-12-08T20:55:04.515200+0000","last_became_peered":"2023-12-08T20:55:04.515200+0000","last_unstale":"2023-12-08T21:24:29.765402+0000","last_undegraded":"2023-12-08T21:24:29.765402+0000","last_fullsized":"2023-12-08T21:24:29.765402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.528239+0000","last_change":"2023-12-08T20:54:56.318724+0000","last_active":"2023-12-08T21:25:37.528239+0000","last_peered":"2023-12-08T21:25:37.528239+0000","last_clean":"2023-12-08T21:25:37.528239+0000","last_became_active":"2023-12-08T20:54:56.318408+0000","last_became_peered":"2023-12-08T20:54:56.318408+0000","last_unstale":"2023-12-08T21:25:37.528239+0000","last_undegraded":"2023-12-08T21:25:37.528239+0000","last_fullsized":"2023-12-08T21:25:37.528239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'4","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.531801+0000","last_change":"2023-12-08T21:25:59.531853+0000","last_active":"2023-12-08T21:25:59.531801+0000","last_peered":"2023-12-08T21:25:59.531801+0000","last_clean":"2023-12-08T21:25:59.531801+0000","last_became_active":"2023-12-08T20:54:54.925610+0000","last_became_peered":"2023-12-08T20:54:54.925610+0000","last_unstale":"2023-12-08T21:25:59.531801+0000","last_undegraded":"2023-12-08T21:25:59.531801+0000","last_fullsized":"2023-12-08T21:25:59.531801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:25:59.531609+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:25:59.531609+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.531609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:03:16.867575+0000","scrub_duration":0.0031837789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'78","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:34.080954+0000","last_change":"2023-12-08T20:55:04.523264+0000","last_active":"2023-12-08T21:25:34.080954+0000","last_peered":"2023-12-08T21:25:34.080954+0000","last_clean":"2023-12-08T21:25:34.080954+0000","last_became_active":"2023-12-08T20:55:04.522245+0000","last_became_peered":"2023-12-08T20:55:04.522245+0000","last_unstale":"2023-12-08T21:25:34.080954+0000","last_undegraded":"2023-12-08T21:25:34.080954+0000","last_fullsized":"2023-12-08T21:25:34.080954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572105+0000","last_change":"2023-12-08T20:54:56.378291+0000","last_active":"2023-12-08T21:25:37.572105+0000","last_peered":"2023-12-08T21:25:37.572105+0000","last_clean":"2023-12-08T21:25:37.572105+0000","last_became_active":"2023-12-08T20:54:56.377762+0000","last_became_peered":"2023-12-08T20:54:56.377762+0000","last_unstale":"2023-12-08T21:25:37.572105+0000","last_undegraded":"2023-12-08T21:25:37.572105+0000","last_fullsized":"2023-12-08T21:25:37.572105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'5","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:11.908962+0000","last_change":"2023-12-08T21:26:11.909020+0000","last_active":"2023-12-08T21:26:11.908962+0000","last_peered":"2023-12-08T21:26:11.908962+0000","last_clean":"2023-12-08T21:26:11.908962+0000","last_became_active":"2023-12-08T20:54:54.935472+0000","last_became_peered":"2023-12-08T20:54:54.935472+0000","last_unstale":"2023-12-08T21:26:11.908962+0000","last_undegraded":"2023-12-08T21:26:11.908962+0000","last_fullsized":"2023-12-08T21:26:11.908962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:11.908761+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:11.908761+0000","last_clean_scrub_stamp":"2023-12-08T21:26:11.908761+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:47:38.208187+0000","scrub_duration":0.0077929649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'94","reported_seq":123,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:33.296332+0000","last_change":"2023-12-08T20:55:04.534674+0000","last_active":"2023-12-08T21:24:33.296332+0000","last_peered":"2023-12-08T21:24:33.296332+0000","last_clean":"2023-12-08T21:24:33.296332+0000","last_became_active":"2023-12-08T20:55:04.533305+0000","last_became_peered":"2023-12-08T20:55:04.533305+0000","last_unstale":"2023-12-08T21:24:33.296332+0000","last_undegraded":"2023-12-08T21:24:33.296332+0000","last_fullsized":"2023-12-08T21:24:33.296332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":6556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:52.008661+0000","last_change":"2023-12-08T21:25:52.008697+0000","last_active":"2023-12-08T21:25:52.008661+0000","last_peered":"2023-12-08T21:25:52.008661+0000","last_clean":"2023-12-08T21:25:52.008661+0000","last_became_active":"2023-12-08T20:54:56.379933+0000","last_became_peered":"2023-12-08T20:54:56.379933+0000","last_unstale":"2023-12-08T21:25:52.008661+0000","last_undegraded":"2023-12-08T21:25:52.008661+0000","last_fullsized":"2023-12-08T21:25:52.008661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:25:52.008566+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:25:52.008566+0000","last_clean_scrub_stamp":"2023-12-08T21:25:52.008566+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:27:19.773108+0000","scrub_duration":0.001762434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'5","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.012091+0000","last_change":"2023-12-08T21:26:06.012158+0000","last_active":"2023-12-08T21:26:06.012091+0000","last_peered":"2023-12-08T21:26:06.012091+0000","last_clean":"2023-12-08T21:26:06.012091+0000","last_became_active":"2023-12-08T20:54:54.982414+0000","last_became_peered":"2023-12-08T20:54:54.982414+0000","last_unstale":"2023-12-08T21:26:06.012091+0000","last_undegraded":"2023-12-08T21:26:06.012091+0000","last_fullsized":"2023-12-08T21:26:06.012091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:06.011895+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:06.011895+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.011895+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:09:55.169141+0000","scrub_duration":0.0062428880000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'68","reported_seq":98,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.088327+0000","last_change":"2023-12-08T20:55:04.515310+0000","last_active":"2023-12-08T21:25:24.088327+0000","last_peered":"2023-12-08T21:25:24.088327+0000","last_clean":"2023-12-08T21:25:24.088327+0000","last_became_active":"2023-12-08T20:55:04.514907+0000","last_became_peered":"2023-12-08T20:55:04.514907+0000","last_unstale":"2023-12-08T21:25:24.088327+0000","last_undegraded":"2023-12-08T21:25:24.088327+0000","last_fullsized":"2023-12-08T21:25:24.088327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'19","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.997357+0000","last_change":"2023-12-08T21:25:53.997391+0000","last_active":"2023-12-08T21:25:53.997357+0000","last_peered":"2023-12-08T21:25:53.997357+0000","last_clean":"2023-12-08T21:25:53.997357+0000","last_became_active":"2023-12-08T20:54:56.377430+0000","last_became_peered":"2023-12-08T20:54:56.377430+0000","last_unstale":"2023-12-08T21:25:53.997357+0000","last_undegraded":"2023-12-08T21:25:53.997357+0000","last_fullsized":"2023-12-08T21:25:53.997357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2023-12-08T21:25:53.997259+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2023-12-08T21:25:53.997259+0000","last_clean_scrub_stamp":"2023-12-08T21:25:53.997259+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:43:24.527309+0000","scrub_duration":0.0013451629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'4","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:02.148485+0000","last_change":"2023-12-08T21:26:02.148544+0000","last_active":"2023-12-08T21:26:02.148485+0000","last_peered":"2023-12-08T21:26:02.148485+0000","last_clean":"2023-12-08T21:26:02.148485+0000","last_became_active":"2023-12-08T20:54:54.926386+0000","last_became_peered":"2023-12-08T20:54:54.926386+0000","last_unstale":"2023-12-08T21:26:02.148485+0000","last_undegraded":"2023-12-08T21:26:02.148485+0000","last_fullsized":"2023-12-08T21:26:02.148485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:26:02.148292+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:26:02.148292+0000","last_clean_scrub_stamp":"2023-12-08T21:26:02.148292+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:05:49.099297+0000","scrub_duration":0.0069923229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'113","reported_seq":151,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:12.893870+0000","last_change":"2023-12-08T21:26:12.893986+0000","last_active":"2023-12-08T21:26:12.893870+0000","last_peered":"2023-12-08T21:26:12.893870+0000","last_clean":"2023-12-08T21:26:12.893870+0000","last_became_active":"2023-12-08T20:55:04.523074+0000","last_became_peered":"2023-12-08T20:55:04.523074+0000","last_unstale":"2023-12-08T21:26:12.893870+0000","last_undegraded":"2023-12-08T21:26:12.893870+0000","last_fullsized":"2023-12-08T21:26:12.893870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'113","last_scrub_stamp":"2023-12-08T21:26:12.893631+0000","last_deep_scrub":"30'113","last_deep_scrub_stamp":"2023-12-08T21:26:12.893631+0000","last_clean_scrub_stamp":"2023-12-08T21:26:12.893631+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:22:11.324216+0000","scrub_duration":0.0069858769999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":11577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:10.138076+0000","last_change":"2023-12-08T21:26:10.138136+0000","last_active":"2023-12-08T21:26:10.138076+0000","last_peered":"2023-12-08T21:26:10.138076+0000","last_clean":"2023-12-08T21:26:10.138076+0000","last_became_active":"2023-12-08T20:54:56.371132+0000","last_became_peered":"2023-12-08T20:54:56.371132+0000","last_unstale":"2023-12-08T21:26:10.138076+0000","last_undegraded":"2023-12-08T21:26:10.138076+0000","last_fullsized":"2023-12-08T21:26:10.138076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:10.137863+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:10.137863+0000","last_clean_scrub_stamp":"2023-12-08T21:26:10.137863+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:21.181423+0000","scrub_duration":0.0030374600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'18","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:58.116724+0000","last_change":"2023-12-08T21:25:58.116788+0000","last_active":"2023-12-08T21:25:58.116724+0000","last_peered":"2023-12-08T21:25:58.116724+0000","last_clean":"2023-12-08T21:25:58.116724+0000","last_became_active":"2023-12-08T20:54:54.984661+0000","last_became_peered":"2023-12-08T20:54:54.984661+0000","last_unstale":"2023-12-08T21:25:58.116724+0000","last_undegraded":"2023-12-08T21:25:58.116724+0000","last_fullsized":"2023-12-08T21:25:58.116724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:25:58.116543+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:25:58.116543+0000","last_clean_scrub_stamp":"2023-12-08T21:25:58.116543+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:16.122167+0000","scrub_duration":0.0098436089999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'88","reported_seq":116,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.181521+0000","last_change":"2023-12-08T20:55:04.543349+0000","last_active":"2023-12-08T21:24:31.181521+0000","last_peered":"2023-12-08T21:24:31.181521+0000","last_clean":"2023-12-08T21:24:31.181521+0000","last_became_active":"2023-12-08T20:55:04.541074+0000","last_became_peered":"2023-12-08T20:55:04.541074+0000","last_unstale":"2023-12-08T21:24:31.181521+0000","last_undegraded":"2023-12-08T21:24:31.181521+0000","last_fullsized":"2023-12-08T21:24:31.181521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'20","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.783826+0000","last_change":"2023-12-08T21:26:01.783879+0000","last_active":"2023-12-08T21:26:01.783826+0000","last_peered":"2023-12-08T21:26:01.783826+0000","last_clean":"2023-12-08T21:26:01.783826+0000","last_became_active":"2023-12-08T20:54:56.413023+0000","last_became_peered":"2023-12-08T20:54:56.413023+0000","last_unstale":"2023-12-08T21:26:01.783826+0000","last_undegraded":"2023-12-08T21:26:01.783826+0000","last_fullsized":"2023-12-08T21:26:01.783826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:01.783626+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:01.783626+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.783626+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:22.368293+0000","scrub_duration":0.0030916820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'1","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:09.105683+0000","last_change":"2023-12-08T21:26:09.105734+0000","last_active":"2023-12-08T21:26:09.105683+0000","last_peered":"2023-12-08T21:26:09.105683+0000","last_clean":"2023-12-08T21:26:09.105683+0000","last_became_active":"2023-12-08T20:54:54.928543+0000","last_became_peered":"2023-12-08T20:54:54.928543+0000","last_unstale":"2023-12-08T21:26:09.105683+0000","last_undegraded":"2023-12-08T21:26:09.105683+0000","last_fullsized":"2023-12-08T21:26:09.105683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-08T21:26:09.105497+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-08T21:26:09.105497+0000","last_clean_scrub_stamp":"2023-12-08T21:26:09.105497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:15:16.777211+0000","scrub_duration":0.0026113529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'85","reported_seq":113,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:31.176309+0000","last_change":"2023-12-08T20:55:04.540347+0000","last_active":"2023-12-08T21:24:31.176309+0000","last_peered":"2023-12-08T21:24:31.176309+0000","last_clean":"2023-12-08T21:24:31.176309+0000","last_became_active":"2023-12-08T20:55:04.535002+0000","last_became_peered":"2023-12-08T20:55:04.535002+0000","last_unstale":"2023-12-08T21:24:31.176309+0000","last_undegraded":"2023-12-08T21:24:31.176309+0000","last_fullsized":"2023-12-08T21:24:31.176309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'40","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526660+0000","last_change":"2023-12-08T20:56:00.382392+0000","last_active":"2023-12-08T21:25:37.526660+0000","last_peered":"2023-12-08T21:25:37.526660+0000","last_clean":"2023-12-08T21:25:37.526660+0000","last_became_active":"2023-12-08T20:56:00.381771+0000","last_became_peered":"2023-12-08T20:56:00.381771+0000","last_unstale":"2023-12-08T21:25:37.526660+0000","last_undegraded":"2023-12-08T21:25:37.526660+0000","last_fullsized":"2023-12-08T21:25:37.526660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:28.697280+0000","last_change":"2023-12-08T20:54:54.930839+0000","last_active":"2023-12-08T21:25:28.697280+0000","last_peered":"2023-12-08T21:25:28.697280+0000","last_clean":"2023-12-08T21:25:28.697280+0000","last_became_active":"2023-12-08T20:54:54.928065+0000","last_became_peered":"2023-12-08T20:54:54.928065+0000","last_unstale":"2023-12-08T21:25:28.697280+0000","last_undegraded":"2023-12-08T21:25:28.697280+0000","last_fullsized":"2023-12-08T21:25:28.697280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'59","reported_seq":88,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.834692+0000","last_change":"2023-12-08T20:55:04.520698+0000","last_active":"2023-12-08T21:25:37.834692+0000","last_peered":"2023-12-08T21:25:37.834692+0000","last_clean":"2023-12-08T21:25:37.834692+0000","last_became_active":"2023-12-08T20:55:04.516783+0000","last_became_peered":"2023-12-08T20:55:04.516783+0000","last_unstale":"2023-12-08T21:25:37.834692+0000","last_undegraded":"2023-12-08T21:25:37.834692+0000","last_fullsized":"2023-12-08T21:25:37.834692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.473575+0000","last_change":"2023-12-08T20:54:56.331045+0000","last_active":"2023-12-08T21:25:37.473575+0000","last_peered":"2023-12-08T21:25:37.473575+0000","last_clean":"2023-12-08T21:25:37.473575+0000","last_became_active":"2023-12-08T20:54:56.330346+0000","last_became_peered":"2023-12-08T20:54:56.330346+0000","last_unstale":"2023-12-08T21:25:37.473575+0000","last_undegraded":"2023-12-08T21:25:37.473575+0000","last_fullsized":"2023-12-08T21:25:37.473575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'6","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:58.290149+0000","last_change":"2023-12-08T21:25:58.290260+0000","last_active":"2023-12-08T21:25:58.290149+0000","last_peered":"2023-12-08T21:25:58.290149+0000","last_clean":"2023-12-08T21:25:58.290149+0000","last_became_active":"2023-12-08T20:54:54.926435+0000","last_became_peered":"2023-12-08T20:54:54.926435+0000","last_unstale":"2023-12-08T21:25:58.290149+0000","last_undegraded":"2023-12-08T21:25:58.290149+0000","last_fullsized":"2023-12-08T21:25:58.290149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:25:58.289922+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:25:58.289922+0000","last_clean_scrub_stamp":"2023-12-08T21:25:58.289922+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:28:27.891672+0000","scrub_duration":0.0072454040000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'79","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:32.156187+0000","last_change":"2023-12-08T20:55:04.534630+0000","last_active":"2023-12-08T21:24:32.156187+0000","last_peered":"2023-12-08T21:24:32.156187+0000","last_clean":"2023-12-08T21:24:32.156187+0000","last_became_active":"2023-12-08T20:55:04.534289+0000","last_became_peered":"2023-12-08T20:55:04.534289+0000","last_unstale":"2023-12-08T21:24:32.156187+0000","last_undegraded":"2023-12-08T21:24:32.156187+0000","last_fullsized":"2023-12-08T21:24:32.156187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'24","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.093618+0000","last_change":"2023-12-08T21:25:55.093643+0000","last_active":"2023-12-08T21:25:55.093618+0000","last_peered":"2023-12-08T21:25:55.093618+0000","last_clean":"2023-12-08T21:25:55.093618+0000","last_became_active":"2023-12-08T20:54:56.375922+0000","last_became_peered":"2023-12-08T20:54:56.375922+0000","last_unstale":"2023-12-08T21:25:55.093618+0000","last_undegraded":"2023-12-08T21:25:55.093618+0000","last_fullsized":"2023-12-08T21:25:55.093618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:25:55.093529+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:25:55.093529+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.093529+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:56:51.759799+0000","scrub_duration":0.0031557159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'893","reported_seq":936,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:52.042951+0000","last_change":"2023-12-08T21:25:52.042995+0000","last_active":"2023-12-08T21:25:52.042951+0000","last_peered":"2023-12-08T21:25:52.042951+0000","last_clean":"2023-12-08T21:25:52.042951+0000","last_became_active":"2023-12-08T20:54:54.977999+0000","last_became_peered":"2023-12-08T20:54:54.977999+0000","last_unstale":"2023-12-08T21:25:52.042951+0000","last_undegraded":"2023-12-08T21:25:52.042951+0000","last_fullsized":"2023-12-08T21:25:52.042951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'893","last_scrub_stamp":"2023-12-08T21:25:52.042834+0000","last_deep_scrub":"30'893","last_deep_scrub_stamp":"2023-12-08T21:25:52.042834+0000","last_clean_scrub_stamp":"2023-12-08T21:25:52.042834+0000","objects_scrubbed":4,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:13:57.138876+0000","scrub_duration":0.033957383000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":887,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'80","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:27.046177+0000","last_change":"2023-12-08T20:55:04.522691+0000","last_active":"2023-12-08T21:25:27.046177+0000","last_peered":"2023-12-08T21:25:27.046177+0000","last_clean":"2023-12-08T21:25:27.046177+0000","last_became_active":"2023-12-08T20:55:04.522190+0000","last_became_peered":"2023-12-08T20:55:04.522190+0000","last_unstale":"2023-12-08T21:25:27.046177+0000","last_undegraded":"2023-12-08T21:25:27.046177+0000","last_fullsized":"2023-12-08T21:25:27.046177+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:11.108977+0000","last_change":"2023-12-08T21:26:11.109034+0000","last_active":"2023-12-08T21:26:11.108977+0000","last_peered":"2023-12-08T21:26:11.108977+0000","last_clean":"2023-12-08T21:26:11.108977+0000","last_became_active":"2023-12-08T20:54:56.383561+0000","last_became_peered":"2023-12-08T20:54:56.383561+0000","last_unstale":"2023-12-08T21:26:11.108977+0000","last_undegraded":"2023-12-08T21:26:11.108977+0000","last_fullsized":"2023-12-08T21:26:11.108977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:11.108774+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:11.108774+0000","last_clean_scrub_stamp":"2023-12-08T21:26:11.108774+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:26:31.478244+0000","scrub_duration":0.0032197039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'407","reported_seq":449,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.289790+0000","last_change":"2023-12-08T21:26:04.289869+0000","last_active":"2023-12-08T21:26:04.289790+0000","last_peered":"2023-12-08T21:26:04.289790+0000","last_clean":"2023-12-08T21:26:04.289790+0000","last_became_active":"2023-12-08T20:54:54.980023+0000","last_became_peered":"2023-12-08T20:54:54.980023+0000","last_unstale":"2023-12-08T21:26:04.289790+0000","last_undegraded":"2023-12-08T21:26:04.289790+0000","last_fullsized":"2023-12-08T21:26:04.289790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'407","last_scrub_stamp":"2023-12-08T21:26:04.289595+0000","last_deep_scrub":"30'407","last_deep_scrub_stamp":"2023-12-08T21:26:04.289595+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.289595+0000","objects_scrubbed":2,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:14:17.977538+0000","scrub_duration":0.006696993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'116","reported_seq":145,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.079548+0000","last_change":"2023-12-08T20:55:04.523658+0000","last_active":"2023-12-08T21:25:24.079548+0000","last_peered":"2023-12-08T21:25:24.079548+0000","last_clean":"2023-12-08T21:25:24.079548+0000","last_became_active":"2023-12-08T20:55:04.522325+0000","last_became_peered":"2023-12-08T20:55:04.522325+0000","last_unstale":"2023-12-08T21:25:24.079548+0000","last_undegraded":"2023-12-08T21:25:24.079548+0000","last_fullsized":"2023-12-08T21:25:24.079548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":12653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'29","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.923326+0000","last_change":"2023-12-08T21:25:59.923377+0000","last_active":"2023-12-08T21:25:59.923326+0000","last_peered":"2023-12-08T21:25:59.923326+0000","last_clean":"2023-12-08T21:25:59.923326+0000","last_became_active":"2023-12-08T20:54:56.409539+0000","last_became_peered":"2023-12-08T20:54:56.409539+0000","last_unstale":"2023-12-08T21:25:59.923326+0000","last_undegraded":"2023-12-08T21:25:59.923326+0000","last_fullsized":"2023-12-08T21:25:59.923326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-12-08T21:25:59.923139+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-12-08T21:25:59.923139+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.923139+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:20:00.596635+0000","scrub_duration":0.0048008690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'3","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.174722+0000","last_change":"2023-12-08T21:26:01.174774+0000","last_active":"2023-12-08T21:26:01.174722+0000","last_peered":"2023-12-08T21:26:01.174722+0000","last_clean":"2023-12-08T21:26:01.174722+0000","last_became_active":"2023-12-08T20:54:54.935889+0000","last_became_peered":"2023-12-08T20:54:54.935889+0000","last_unstale":"2023-12-08T21:26:01.174722+0000","last_undegraded":"2023-12-08T21:26:01.174722+0000","last_fullsized":"2023-12-08T21:26:01.174722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:26:01.174531+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:26:01.174531+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.174531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:17:02.143286+0000","scrub_duration":0.0027935500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'68","reported_seq":93,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:12.515603+0000","last_change":"2023-12-08T20:56:00.560908+0000","last_active":"2023-12-08T21:24:12.515603+0000","last_peered":"2023-12-08T21:24:12.515603+0000","last_clean":"2023-12-08T21:24:12.515603+0000","last_became_active":"2023-12-08T20:56:00.560282+0000","last_became_peered":"2023-12-08T20:56:00.560282+0000","last_unstale":"2023-12-08T21:24:12.515603+0000","last_undegraded":"2023-12-08T21:24:12.515603+0000","last_fullsized":"2023-12-08T21:24:12.515603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":7515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.687839+0000","last_change":"2023-12-08T20:54:56.376709+0000","last_active":"2023-12-08T21:25:37.687839+0000","last_peered":"2023-12-08T21:25:37.687839+0000","last_clean":"2023-12-08T21:25:37.687839+0000","last_became_active":"2023-12-08T20:54:56.369709+0000","last_became_peered":"2023-12-08T20:54:56.369709+0000","last_unstale":"2023-12-08T21:25:37.687839+0000","last_undegraded":"2023-12-08T21:25:37.687839+0000","last_fullsized":"2023-12-08T21:25:37.687839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'3","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:54.755366+0000","last_change":"2023-12-08T21:25:54.755396+0000","last_active":"2023-12-08T21:25:54.755366+0000","last_peered":"2023-12-08T21:25:54.755366+0000","last_clean":"2023-12-08T21:25:54.755366+0000","last_became_active":"2023-12-08T20:54:54.979751+0000","last_became_peered":"2023-12-08T20:54:54.979751+0000","last_unstale":"2023-12-08T21:25:54.755366+0000","last_undegraded":"2023-12-08T21:25:54.755366+0000","last_fullsized":"2023-12-08T21:25:54.755366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:25:54.755239+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:25:54.755239+0000","last_clean_scrub_stamp":"2023-12-08T21:25:54.755239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:03:48.852944+0000","scrub_duration":0.002413353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'79","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:27.046109+0000","last_change":"2023-12-08T20:55:04.513429+0000","last_active":"2023-12-08T21:25:27.046109+0000","last_peered":"2023-12-08T21:25:27.046109+0000","last_clean":"2023-12-08T21:25:27.046109+0000","last_became_active":"2023-12-08T20:55:04.511405+0000","last_became_peered":"2023-12-08T20:55:04.511405+0000","last_unstale":"2023-12-08T21:25:27.046109+0000","last_undegraded":"2023-12-08T21:25:27.046109+0000","last_fullsized":"2023-12-08T21:25:27.046109+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":96,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:12.042970+0000","last_change":"2023-12-08T20:55:04.537067+0000","last_active":"2023-12-08T21:25:12.042970+0000","last_peered":"2023-12-08T21:25:12.042970+0000","last_clean":"2023-12-08T21:25:12.042970+0000","last_became_active":"2023-12-08T20:55:04.536497+0000","last_became_peered":"2023-12-08T20:55:04.536497+0000","last_unstale":"2023-12-08T21:25:12.042970+0000","last_undegraded":"2023-12-08T21:25:12.042970+0000","last_fullsized":"2023-12-08T21:25:12.042970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.702614+0000","last_change":"2023-12-08T20:54:56.318249+0000","last_active":"2023-12-08T21:25:37.702614+0000","last_peered":"2023-12-08T21:25:37.702614+0000","last_clean":"2023-12-08T21:25:37.702614+0000","last_became_active":"2023-12-08T20:54:56.317895+0000","last_became_peered":"2023-12-08T20:54:56.317895+0000","last_unstale":"2023-12-08T21:25:37.702614+0000","last_undegraded":"2023-12-08T21:25:37.702614+0000","last_fullsized":"2023-12-08T21:25:37.702614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:21.354085+0000","last_change":"2023-12-08T20:54:54.935924+0000","last_active":"2023-12-08T21:25:21.354085+0000","last_peered":"2023-12-08T21:25:21.354085+0000","last_clean":"2023-12-08T21:25:21.354085+0000","last_became_active":"2023-12-08T20:54:54.935578+0000","last_became_peered":"2023-12-08T20:54:54.935578+0000","last_unstale":"2023-12-08T21:25:21.354085+0000","last_undegraded":"2023-12-08T21:25:21.354085+0000","last_fullsized":"2023-12-08T21:25:21.354085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'80","reported_seq":110,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:24:30.109071+0000","last_change":"2023-12-08T20:55:04.535940+0000","last_active":"2023-12-08T21:24:30.109071+0000","last_peered":"2023-12-08T21:24:30.109071+0000","last_clean":"2023-12-08T21:24:30.109071+0000","last_became_active":"2023-12-08T20:55:04.535525+0000","last_became_peered":"2023-12-08T20:55:04.535525+0000","last_unstale":"2023-12-08T21:24:30.109071+0000","last_undegraded":"2023-12-08T21:24:30.109071+0000","last_fullsized":"2023-12-08T21:24:30.109071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":11364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548522+0000","last_change":"2023-12-08T20:54:56.413484+0000","last_active":"2023-12-08T21:25:37.548522+0000","last_peered":"2023-12-08T21:25:37.548522+0000","last_clean":"2023-12-08T21:25:37.548522+0000","last_became_active":"2023-12-08T20:54:56.412133+0000","last_became_peered":"2023-12-08T20:54:56.412133+0000","last_unstale":"2023-12-08T21:25:37.548522+0000","last_undegraded":"2023-12-08T21:25:37.548522+0000","last_fullsized":"2023-12-08T21:25:37.548522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'3","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:58.532414+0000","last_change":"2023-12-08T21:25:58.532461+0000","last_active":"2023-12-08T21:25:58.532414+0000","last_peered":"2023-12-08T21:25:58.532414+0000","last_clean":"2023-12-08T21:25:58.532414+0000","last_became_active":"2023-12-08T20:54:54.926804+0000","last_became_peered":"2023-12-08T20:54:54.926804+0000","last_unstale":"2023-12-08T21:25:58.532414+0000","last_undegraded":"2023-12-08T21:25:58.532414+0000","last_fullsized":"2023-12-08T21:25:58.532414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:25:58.532282+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:25:58.532282+0000","last_clean_scrub_stamp":"2023-12-08T21:25:58.532282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:57:27.213154+0000","scrub_duration":0.0026443899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'615","reported_seq":649,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:27.778573+0000","last_change":"2023-12-08T20:54:54.931212+0000","last_active":"2023-12-08T21:25:27.778573+0000","last_peered":"2023-12-08T21:25:27.778573+0000","last_clean":"2023-12-08T21:25:27.778573+0000","last_became_active":"2023-12-08T20:54:54.930324+0000","last_became_peered":"2023-12-08T20:54:54.930324+0000","last_unstale":"2023-12-08T21:25:27.778573+0000","last_undegraded":"2023-12-08T21:25:27.778573+0000","last_fullsized":"2023-12-08T21:25:27.778573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:53.270644+0000","last_clean_scrub_stamp":"2023-12-08T20:54:53.270644+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.998145+0000","last_change":"2023-12-08T21:26:08.998185+0000","last_active":"2023-12-08T21:26:08.998145+0000","last_peered":"2023-12-08T21:26:08.998145+0000","last_clean":"2023-12-08T21:26:08.998145+0000","last_became_active":"2023-12-08T20:54:56.383467+0000","last_became_peered":"2023-12-08T20:54:56.383467+0000","last_unstale":"2023-12-08T21:26:08.998145+0000","last_undegraded":"2023-12-08T21:26:08.998145+0000","last_fullsized":"2023-12-08T21:26:08.998145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:08.998020+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:08.998020+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.998020+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:43:06.448077+0000","scrub_duration":0.0029810240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'50","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:07.041841+0000","last_change":"2023-12-08T20:55:04.541743+0000","last_active":"2023-12-08T21:25:07.041841+0000","last_peered":"2023-12-08T21:25:07.041841+0000","last_clean":"2023-12-08T21:25:07.041841+0000","last_became_active":"2023-12-08T20:55:04.536537+0000","last_became_peered":"2023-12-08T20:55:04.536537+0000","last_unstale":"2023-12-08T21:25:07.041841+0000","last_undegraded":"2023-12-08T21:25:07.041841+0000","last_fullsized":"2023-12-08T21:25:07.041841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'554","reported_seq":596,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:10.943632+0000","last_change":"2023-12-08T21:26:10.943758+0000","last_active":"2023-12-08T21:26:10.943632+0000","last_peered":"2023-12-08T21:26:10.943632+0000","last_clean":"2023-12-08T21:26:10.943632+0000","last_became_active":"2023-12-08T20:54:54.925229+0000","last_became_peered":"2023-12-08T20:54:54.925229+0000","last_unstale":"2023-12-08T21:26:10.943632+0000","last_undegraded":"2023-12-08T21:26:10.943632+0000","last_fullsized":"2023-12-08T21:26:10.943632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'554","last_scrub_stamp":"2023-12-08T21:26:10.943330+0000","last_deep_scrub":"30'554","last_deep_scrub_stamp":"2023-12-08T21:26:10.943330+0000","last_clean_scrub_stamp":"2023-12-08T21:26:10.943330+0000","objects_scrubbed":1,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:10:30.749700+0000","scrub_duration":0.033797185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'20","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:00.754130+0000","last_change":"2023-12-08T21:26:00.754182+0000","last_active":"2023-12-08T21:26:00.754130+0000","last_peered":"2023-12-08T21:26:00.754130+0000","last_clean":"2023-12-08T21:26:00.754130+0000","last_became_active":"2023-12-08T20:54:56.403996+0000","last_became_peered":"2023-12-08T20:54:56.403996+0000","last_unstale":"2023-12-08T21:26:00.754130+0000","last_undegraded":"2023-12-08T21:26:00.754130+0000","last_fullsized":"2023-12-08T21:26:00.754130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:00.753925+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:00.753925+0000","last_clean_scrub_stamp":"2023-12-08T21:26:00.753925+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:14:14.441869+0000","scrub_duration":0.003347722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'97","reported_seq":125,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:07.060531+0000","last_change":"2023-12-08T20:55:04.523477+0000","last_active":"2023-12-08T21:25:07.060531+0000","last_peered":"2023-12-08T21:25:07.060531+0000","last_clean":"2023-12-08T21:25:07.060531+0000","last_became_active":"2023-12-08T20:55:04.523137+0000","last_became_peered":"2023-12-08T20:55:04.523137+0000","last_unstale":"2023-12-08T21:25:07.060531+0000","last_undegraded":"2023-12-08T21:25:07.060531+0000","last_fullsized":"2023-12-08T21:25:07.060531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"30'37","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.876227+0000","last_change":"2023-12-08T21:26:08.876227+0000","last_active":"2023-12-08T21:26:08.876227+0000","last_peered":"2023-12-08T21:26:08.876227+0000","last_clean":"2023-12-08T21:26:08.876227+0000","last_became_active":"2023-12-08T20:54:56.373080+0000","last_became_peered":"2023-12-08T20:54:56.373080+0000","last_unstale":"2023-12-08T21:26:08.876227+0000","last_undegraded":"2023-12-08T21:26:08.876227+0000","last_fullsized":"2023-12-08T21:26:08.876227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'37","last_scrub_stamp":"2023-12-08T21:26:08.875831+0000","last_deep_scrub":"30'37","last_deep_scrub_stamp":"2023-12-08T21:26:08.875831+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.875831+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:35:17.879073+0000","scrub_duration":0.003168078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'27","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:07.352563+0000","last_change":"2023-12-08T21:26:07.352563+0000","last_active":"2023-12-08T21:26:07.352563+0000","last_peered":"2023-12-08T21:26:07.352563+0000","last_clean":"2023-12-08T21:26:07.352563+0000","last_became_active":"2023-12-08T20:54:56.378154+0000","last_became_peered":"2023-12-08T20:54:56.378154+0000","last_unstale":"2023-12-08T21:26:07.352563+0000","last_undegraded":"2023-12-08T21:26:07.352563+0000","last_fullsized":"2023-12-08T21:26:07.352563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-12-08T21:26:07.352305+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-12-08T21:26:07.352305+0000","last_clean_scrub_stamp":"2023-12-08T21:26:07.352305+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:43:19.113869+0000","scrub_duration":0.0029496069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'26","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:02.075761+0000","last_change":"2023-12-08T21:26:02.075761+0000","last_active":"2023-12-08T21:26:02.075761+0000","last_peered":"2023-12-08T21:26:02.075761+0000","last_clean":"2023-12-08T21:26:02.075761+0000","last_became_active":"2023-12-08T20:54:56.409863+0000","last_became_peered":"2023-12-08T20:54:56.409863+0000","last_unstale":"2023-12-08T21:26:02.075761+0000","last_undegraded":"2023-12-08T21:26:02.075761+0000","last_fullsized":"2023-12-08T21:26:02.075761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:02.075490+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:02.075490+0000","last_clean_scrub_stamp":"2023-12-08T21:26:02.075490+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:56:07.407825+0000","scrub_duration":0.0028810989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.548856+0000","last_change":"2023-12-08T20:54:56.408750+0000","last_active":"2023-12-08T21:25:37.548856+0000","last_peered":"2023-12-08T21:25:37.548856+0000","last_clean":"2023-12-08T21:25:37.548856+0000","last_became_active":"2023-12-08T20:54:56.408205+0000","last_became_peered":"2023-12-08T20:54:56.408205+0000","last_unstale":"2023-12-08T21:25:37.548856+0000","last_undegraded":"2023-12-08T21:25:37.548856+0000","last_fullsized":"2023-12-08T21:25:37.548856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'16","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.474171+0000","last_change":"2023-12-08T20:54:56.386660+0000","last_active":"2023-12-08T21:25:37.474171+0000","last_peered":"2023-12-08T21:25:37.474171+0000","last_clean":"2023-12-08T21:25:37.474171+0000","last_became_active":"2023-12-08T20:54:56.386344+0000","last_became_peered":"2023-12-08T20:54:56.386344+0000","last_unstale":"2023-12-08T21:25:37.474171+0000","last_undegraded":"2023-12-08T21:25:37.474171+0000","last_fullsized":"2023-12-08T21:25:37.474171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'21","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.469673+0000","last_change":"2023-12-08T20:54:56.367640+0000","last_active":"2023-12-08T21:25:37.469673+0000","last_peered":"2023-12-08T21:25:37.469673+0000","last_clean":"2023-12-08T21:25:37.469673+0000","last_became_active":"2023-12-08T20:54:56.366967+0000","last_became_peered":"2023-12-08T20:54:56.366967+0000","last_unstale":"2023-12-08T21:25:37.469673+0000","last_undegraded":"2023-12-08T21:25:37.469673+0000","last_fullsized":"2023-12-08T21:25:37.469673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'32","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.686508+0000","last_change":"2023-12-08T20:54:56.376663+0000","last_active":"2023-12-08T21:25:37.686508+0000","last_peered":"2023-12-08T21:25:37.686508+0000","last_clean":"2023-12-08T21:25:37.686508+0000","last_became_active":"2023-12-08T20:54:56.371954+0000","last_became_peered":"2023-12-08T20:54:56.371954+0000","last_unstale":"2023-12-08T21:25:37.686508+0000","last_undegraded":"2023-12-08T21:25:37.686508+0000","last_fullsized":"2023-12-08T21:25:37.686508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:03.870345+0000","last_change":"2023-12-08T21:26:03.870397+0000","last_active":"2023-12-08T21:26:03.870345+0000","last_peered":"2023-12-08T21:26:03.870345+0000","last_clean":"2023-12-08T21:26:03.870345+0000","last_became_active":"2023-12-08T20:54:56.409462+0000","last_became_peered":"2023-12-08T20:54:56.409462+0000","last_unstale":"2023-12-08T21:26:03.870345+0000","last_undegraded":"2023-12-08T21:26:03.870345+0000","last_fullsized":"2023-12-08T21:26:03.870345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:03.870148+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:03.870148+0000","last_clean_scrub_stamp":"2023-12-08T21:26:03.870148+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:04:32.166396+0000","scrub_duration":0.0033986340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'18","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.202058+0000","last_change":"2023-12-08T21:25:59.202112+0000","last_active":"2023-12-08T21:25:59.202058+0000","last_peered":"2023-12-08T21:25:59.202058+0000","last_clean":"2023-12-08T21:25:59.202058+0000","last_became_active":"2023-12-08T20:54:56.415176+0000","last_became_peered":"2023-12-08T20:54:56.415176+0000","last_unstale":"2023-12-08T21:25:59.202058+0000","last_undegraded":"2023-12-08T21:25:59.202058+0000","last_fullsized":"2023-12-08T21:25:59.202058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:25:59.201838+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:25:59.201838+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.201838+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:55:02.593105+0000","scrub_duration":0.0031189780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'31","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.841471+0000","last_change":"2023-12-08T21:26:13.841528+0000","last_active":"2023-12-08T21:26:13.841471+0000","last_peered":"2023-12-08T21:26:13.841471+0000","last_clean":"2023-12-08T21:26:13.841471+0000","last_became_active":"2023-12-08T20:54:56.400980+0000","last_became_peered":"2023-12-08T20:54:56.400980+0000","last_unstale":"2023-12-08T21:26:13.841471+0000","last_undegraded":"2023-12-08T21:26:13.841471+0000","last_fullsized":"2023-12-08T21:26:13.841471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-12-08T21:26:13.841252+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-12-08T21:26:13.841252+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.841252+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:55:29.119051+0000","scrub_duration":0.0036066679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:03.827489+0000","last_change":"2023-12-08T21:26:03.827576+0000","last_active":"2023-12-08T21:26:03.827489+0000","last_peered":"2023-12-08T21:26:03.827489+0000","last_clean":"2023-12-08T21:26:03.827489+0000","last_became_active":"2023-12-08T20:54:56.386413+0000","last_became_peered":"2023-12-08T20:54:56.386413+0000","last_unstale":"2023-12-08T21:26:03.827489+0000","last_undegraded":"2023-12-08T21:26:03.827489+0000","last_fullsized":"2023-12-08T21:26:03.827489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:03.827291+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:03.827291+0000","last_clean_scrub_stamp":"2023-12-08T21:26:03.827291+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:43:15.588855+0000","scrub_duration":0.003078543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'34","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.705254+0000","last_change":"2023-12-08T20:54:56.371962+0000","last_active":"2023-12-08T21:25:37.705254+0000","last_peered":"2023-12-08T21:25:37.705254+0000","last_clean":"2023-12-08T21:25:37.705254+0000","last_became_active":"2023-12-08T20:54:56.371456+0000","last_became_peered":"2023-12-08T20:54:56.371456+0000","last_unstale":"2023-12-08T21:25:37.705254+0000","last_undegraded":"2023-12-08T21:25:37.705254+0000","last_fullsized":"2023-12-08T21:25:37.705254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'26","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572458+0000","last_change":"2023-12-08T20:54:56.381311+0000","last_active":"2023-12-08T21:25:37.572458+0000","last_peered":"2023-12-08T21:25:37.572458+0000","last_clean":"2023-12-08T21:25:37.572458+0000","last_became_active":"2023-12-08T20:54:56.380860+0000","last_became_peered":"2023-12-08T20:54:56.380860+0000","last_unstale":"2023-12-08T21:25:37.572458+0000","last_undegraded":"2023-12-08T21:25:37.572458+0000","last_fullsized":"2023-12-08T21:25:37.572458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'26","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.528032+0000","last_change":"2023-12-08T20:54:56.261370+0000","last_active":"2023-12-08T21:25:37.528032+0000","last_peered":"2023-12-08T21:25:37.528032+0000","last_clean":"2023-12-08T21:25:37.528032+0000","last_became_active":"2023-12-08T20:54:56.260387+0000","last_became_peered":"2023-12-08T20:54:56.260387+0000","last_unstale":"2023-12-08T21:25:37.528032+0000","last_undegraded":"2023-12-08T21:25:37.528032+0000","last_fullsized":"2023-12-08T21:25:37.528032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'32","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:10.301571+0000","last_change":"2023-12-08T21:26:10.301625+0000","last_active":"2023-12-08T21:26:10.301571+0000","last_peered":"2023-12-08T21:26:10.301571+0000","last_clean":"2023-12-08T21:26:10.301571+0000","last_became_active":"2023-12-08T20:54:56.387774+0000","last_became_peered":"2023-12-08T20:54:56.387774+0000","last_unstale":"2023-12-08T21:26:10.301571+0000","last_undegraded":"2023-12-08T21:26:10.301571+0000","last_fullsized":"2023-12-08T21:26:10.301571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:10.301372+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:10.301372+0000","last_clean_scrub_stamp":"2023-12-08T21:26:10.301372+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:19:37.645203+0000","scrub_duration":0.0036295450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'26","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.530151+0000","last_change":"2023-12-08T20:54:56.378804+0000","last_active":"2023-12-08T21:25:37.530151+0000","last_peered":"2023-12-08T21:25:37.530151+0000","last_clean":"2023-12-08T21:25:37.530151+0000","last_became_active":"2023-12-08T20:54:56.377029+0000","last_became_peered":"2023-12-08T20:54:56.377029+0000","last_unstale":"2023-12-08T21:25:37.530151+0000","last_undegraded":"2023-12-08T21:25:37.530151+0000","last_fullsized":"2023-12-08T21:25:37.530151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.145181+0000","last_change":"2023-12-08T21:26:13.145289+0000","last_active":"2023-12-08T21:26:13.145181+0000","last_peered":"2023-12-08T21:26:13.145181+0000","last_clean":"2023-12-08T21:26:13.145181+0000","last_became_active":"2023-12-08T20:54:56.370707+0000","last_became_peered":"2023-12-08T20:54:56.370707+0000","last_unstale":"2023-12-08T21:26:13.145181+0000","last_undegraded":"2023-12-08T21:26:13.145181+0000","last_fullsized":"2023-12-08T21:26:13.145181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:13.144948+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:13.144948+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.144948+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:29:20.754089+0000","scrub_duration":0.0029542679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'29","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.552794+0000","last_change":"2023-12-08T20:54:56.405033+0000","last_active":"2023-12-08T21:25:37.552794+0000","last_peered":"2023-12-08T21:25:37.552794+0000","last_clean":"2023-12-08T21:25:37.552794+0000","last_became_active":"2023-12-08T20:54:56.401544+0000","last_became_peered":"2023-12-08T20:54:56.401544+0000","last_unstale":"2023-12-08T21:25:37.552794+0000","last_undegraded":"2023-12-08T21:25:37.552794+0000","last_fullsized":"2023-12-08T21:25:37.552794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.497763+0000","last_change":"2023-12-08T21:26:04.497882+0000","last_active":"2023-12-08T21:26:04.497763+0000","last_peered":"2023-12-08T21:26:04.497763+0000","last_clean":"2023-12-08T21:26:04.497763+0000","last_became_active":"2023-12-08T20:54:56.365432+0000","last_became_peered":"2023-12-08T20:54:56.365432+0000","last_unstale":"2023-12-08T21:26:04.497763+0000","last_undegraded":"2023-12-08T21:26:04.497763+0000","last_fullsized":"2023-12-08T21:26:04.497763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:04.497467+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:04.497467+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.497467+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:58:46.607618+0000","scrub_duration":0.0033388139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'32","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:03.491196+0000","last_change":"2023-12-08T21:26:03.491249+0000","last_active":"2023-12-08T21:26:03.491196+0000","last_peered":"2023-12-08T21:26:03.491196+0000","last_clean":"2023-12-08T21:26:03.491196+0000","last_became_active":"2023-12-08T20:54:56.392408+0000","last_became_peered":"2023-12-08T20:54:56.392408+0000","last_unstale":"2023-12-08T21:26:03.491196+0000","last_undegraded":"2023-12-08T21:26:03.491196+0000","last_fullsized":"2023-12-08T21:26:03.491196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:03.490973+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:03.490973+0000","last_clean_scrub_stamp":"2023-12-08T21:26:03.490973+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:48.345009+0000","scrub_duration":0.0042798330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.572518+0000","last_change":"2023-12-08T20:54:56.380654+0000","last_active":"2023-12-08T21:25:37.572518+0000","last_peered":"2023-12-08T21:25:37.572518+0000","last_clean":"2023-12-08T21:25:37.572518+0000","last_became_active":"2023-12-08T20:54:56.380137+0000","last_became_peered":"2023-12-08T20:54:56.380137+0000","last_unstale":"2023-12-08T21:25:37.572518+0000","last_undegraded":"2023-12-08T21:25:37.572518+0000","last_fullsized":"2023-12-08T21:25:37.572518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.571425+0000","last_change":"2023-12-08T20:54:56.392997+0000","last_active":"2023-12-08T21:25:37.571425+0000","last_peered":"2023-12-08T21:25:37.571425+0000","last_clean":"2023-12-08T21:25:37.571425+0000","last_became_active":"2023-12-08T20:54:56.391299+0000","last_became_peered":"2023-12-08T20:54:56.391299+0000","last_unstale":"2023-12-08T21:25:37.571425+0000","last_undegraded":"2023-12-08T21:25:37.571425+0000","last_fullsized":"2023-12-08T21:25:37.571425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'32","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.100325+0000","last_change":"2023-12-08T21:26:14.100437+0000","last_active":"2023-12-08T21:26:14.100325+0000","last_peered":"2023-12-08T21:26:14.100325+0000","last_clean":"2023-12-08T21:26:14.100325+0000","last_became_active":"2023-12-08T20:54:56.392708+0000","last_became_peered":"2023-12-08T20:54:56.392708+0000","last_unstale":"2023-12-08T21:26:14.100325+0000","last_undegraded":"2023-12-08T21:26:14.100325+0000","last_fullsized":"2023-12-08T21:26:14.100325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:14.100007+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:14.100007+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.100007+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:23:56.090149+0000","scrub_duration":0.0033906460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'30","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:07.864957+0000","last_change":"2023-12-08T21:26:07.865013+0000","last_active":"2023-12-08T21:26:07.864957+0000","last_peered":"2023-12-08T21:26:07.864957+0000","last_clean":"2023-12-08T21:26:07.864957+0000","last_became_active":"2023-12-08T20:54:56.318400+0000","last_became_peered":"2023-12-08T20:54:56.318400+0000","last_unstale":"2023-12-08T21:26:07.864957+0000","last_undegraded":"2023-12-08T21:26:07.864957+0000","last_fullsized":"2023-12-08T21:26:07.864957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-12-08T21:26:07.864752+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-12-08T21:26:07.864752+0000","last_clean_scrub_stamp":"2023-12-08T21:26:07.864752+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:43:38.394802+0000","scrub_duration":0.0055178909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.552551+0000","last_change":"2023-12-08T20:54:56.414028+0000","last_active":"2023-12-08T21:25:37.552551+0000","last_peered":"2023-12-08T21:25:37.552551+0000","last_clean":"2023-12-08T21:25:37.552551+0000","last_became_active":"2023-12-08T20:54:56.413220+0000","last_became_peered":"2023-12-08T20:54:56.413220+0000","last_unstale":"2023-12-08T21:25:37.552551+0000","last_undegraded":"2023-12-08T21:25:37.552551+0000","last_fullsized":"2023-12-08T21:25:37.552551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:11.113585+0000","last_change":"2023-12-08T21:26:11.113697+0000","last_active":"2023-12-08T21:26:11.113585+0000","last_peered":"2023-12-08T21:26:11.113585+0000","last_clean":"2023-12-08T21:26:11.113585+0000","last_became_active":"2023-12-08T20:54:56.365448+0000","last_became_peered":"2023-12-08T20:54:56.365448+0000","last_unstale":"2023-12-08T21:26:11.113585+0000","last_undegraded":"2023-12-08T21:26:11.113585+0000","last_fullsized":"2023-12-08T21:26:11.113585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:26:11.113287+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:26:11.113287+0000","last_clean_scrub_stamp":"2023-12-08T21:26:11.113287+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:21:06.223582+0000","scrub_duration":0.0035769590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'25","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.890733+0000","last_change":"2023-12-08T21:26:06.890777+0000","last_active":"2023-12-08T21:26:06.890733+0000","last_peered":"2023-12-08T21:26:06.890733+0000","last_clean":"2023-12-08T21:26:06.890733+0000","last_became_active":"2023-12-08T20:54:56.369574+0000","last_became_peered":"2023-12-08T20:54:56.369574+0000","last_unstale":"2023-12-08T21:26:06.890733+0000","last_undegraded":"2023-12-08T21:26:06.890733+0000","last_fullsized":"2023-12-08T21:26:06.890733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-12-08T21:26:06.890558+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-12-08T21:26:06.890558+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.890558+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:42:36.323222+0000","scrub_duration":0.0032420529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'21","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.103052+0000","last_change":"2023-12-08T21:26:13.103090+0000","last_active":"2023-12-08T21:26:13.103052+0000","last_peered":"2023-12-08T21:26:13.103052+0000","last_clean":"2023-12-08T21:26:13.103052+0000","last_became_active":"2023-12-08T20:54:56.411339+0000","last_became_peered":"2023-12-08T20:54:56.411339+0000","last_unstale":"2023-12-08T21:26:13.103052+0000","last_undegraded":"2023-12-08T21:26:13.103052+0000","last_fullsized":"2023-12-08T21:26:13.103052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:13.102896+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:13.102896+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.102896+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:37:09.675808+0000","scrub_duration":0.0030662670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'17","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.669744+0000","last_change":"2023-12-08T20:54:56.370763+0000","last_active":"2023-12-08T21:25:37.669744+0000","last_peered":"2023-12-08T21:25:37.669744+0000","last_clean":"2023-12-08T21:25:37.669744+0000","last_became_active":"2023-12-08T20:54:56.369650+0000","last_became_peered":"2023-12-08T20:54:56.369650+0000","last_unstale":"2023-12-08T21:25:37.669744+0000","last_undegraded":"2023-12-08T21:25:37.669744+0000","last_fullsized":"2023-12-08T21:25:37.669744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.876732+0000","last_change":"2023-12-08T21:26:04.876732+0000","last_active":"2023-12-08T21:26:04.876732+0000","last_peered":"2023-12-08T21:26:04.876732+0000","last_clean":"2023-12-08T21:26:04.876732+0000","last_became_active":"2023-12-08T20:54:56.408861+0000","last_became_peered":"2023-12-08T20:54:56.408861+0000","last_unstale":"2023-12-08T21:26:04.876732+0000","last_undegraded":"2023-12-08T21:26:04.876732+0000","last_fullsized":"2023-12-08T21:26:04.876732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:04.876470+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:04.876470+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.876470+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:42:10.809218+0000","scrub_duration":0.0033527380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'19","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.790935+0000","last_change":"2023-12-08T20:54:56.407010+0000","last_active":"2023-12-08T21:25:53.790935+0000","last_peered":"2023-12-08T21:25:53.790935+0000","last_clean":"2023-12-08T21:25:53.790935+0000","last_became_active":"2023-12-08T20:54:56.404697+0000","last_became_peered":"2023-12-08T20:54:56.404697+0000","last_unstale":"2023-12-08T21:25:53.790935+0000","last_undegraded":"2023-12-08T21:25:53.790935+0000","last_fullsized":"2023-12-08T21:25:53.790935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:48.796338+0000","last_change":"2023-12-08T20:54:56.378873+0000","last_active":"2023-12-08T21:25:48.796338+0000","last_peered":"2023-12-08T21:25:48.796338+0000","last_clean":"2023-12-08T21:25:48.796338+0000","last_became_active":"2023-12-08T20:54:56.377835+0000","last_became_peered":"2023-12-08T20:54:56.377835+0000","last_unstale":"2023-12-08T21:25:48.796338+0000","last_undegraded":"2023-12-08T21:25:48.796338+0000","last_fullsized":"2023-12-08T21:25:48.796338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2350,"num_write_kb":252630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2525,"ondisk_log_size":2525,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1552,"ondisk_log_size":1552,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23858448,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":5673,"num_write_kb":26542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32464896,"data_stored":47716896,"data_compressed":4732252,"data_compressed_allocated":7307264,"data_compressed_original":22618112,"omap_allocated":0,"internal_metadata":0},"log_size":5230,"ondisk_log_size":5230,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509828,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":4588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":4698112,"data_stored":7801495,"data_compressed":855543,"data_compressed_allocated":1261568,"data_compressed_original":4567040,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.90900000000000003,"15min":0.88700000000000001},"min":{"1min":0.58499999999999996,"5min":0.57299999999999995,"15min":0.371},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92200000000000004,"15min":0.93899999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.262,"5min":1.4710000000000001,"15min":1.6479999999999999},"last":1.0680000000000001}]},{"osd":1,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.97199999999999998,"15min":0.93300000000000005},"min":{"1min":0.68799999999999994,"5min":0.52000000000000002,"15min":0.44400000000000001},"max":{"1min":1.2869999999999999,"5min":1.3640000000000001,"15min":1.405},"last":1.091},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.91500000000000004,"15min":0.93400000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.48599999999999999},"max":{"1min":1.1659999999999999,"5min":1.3500000000000001,"15min":1.504},"last":1.046}]},{"osd":2,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96199999999999997,"15min":0.92100000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.022},{"interface":"front","average":{"1min":0.873,"5min":0.95699999999999996,"15min":0.98299999999999998},"min":{"1min":0.63,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":1.1919999999999999,"5min":1.3109999999999999,"15min":1.776},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.99099999999999999,"15min":1.0029999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.46700000000000003},"max":{"1min":1.089,"5min":1.363,"15min":2.0840000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0549999999999999,"15min":1.0760000000000001},"min":{"1min":0.78900000000000003,"5min":0.61399999999999999,"15min":0.44800000000000001},"max":{"1min":1.387,"5min":1.427,"15min":2.181},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.89600000000000002,"15min":0.91800000000000004},"min":{"1min":0.69199999999999995,"5min":0.35699999999999998,"15min":0.30199999999999999},"max":{"1min":1.25,"5min":1.444,"15min":1.972},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.02,"15min":1.0329999999999999},"min":{"1min":0.69499999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.587,"5min":1.587,"15min":1.8149999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":0.999,"15min":1.026},"min":{"1min":0.73399999999999999,"5min":0.48199999999999998,"15min":0.41799999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":2.3069999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.129,"5min":1.0489999999999999,"15min":1.069},"min":{"1min":0.80900000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.8959999999999999},"last":1.119}]},{"osd":7,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.109,"15min":1.1100000000000001},"min":{"1min":0.74099999999999999,"5min":0.65100000000000002,"15min":0.56999999999999995},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1599999999999999,"15min":1.1719999999999999},"min":{"1min":0.92300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5529999999999999,"5min":1.7110000000000001,"15min":1.8600000000000001},"last":0.996}]}]},{"osd":3,"up_from":15,"seq":64424509828,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62188,"kb_used_data":8804,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309652,"statfs":{"total":96636764160,"available":96573083648,"internally_reserved":0,"allocated":9015296,"data_stored":12714767,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.27800000000000002},"max":{"1min":1.0700000000000001,"5min":1.3700000000000001,"15min":1.655},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.79200000000000004,"15min":0.77500000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.34699999999999998},"max":{"1min":1.0649999999999999,"5min":1.504,"15min":1.7809999999999999},"last":0.85499999999999998}]},{"osd":1,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.30399999999999999},"max":{"1min":1.016,"5min":1.5189999999999999,"15min":1.5329999999999999},"last":0.754},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.91600000000000004,"15min":0.92500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.26900000000000002},"max":{"1min":1.1910000000000001,"5min":1.4490000000000001,"15min":2.036},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.92700000000000005,"15min":0.92400000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0669999999999999,"5min":1.585,"15min":1.9470000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.96999999999999997,"15min":0.98199999999999998},"min":{"1min":0.442,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1699999999999999,"5min":1.4450000000000001,"15min":1.786},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0640000000000001,"15min":1.079},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.52000000000000002},"max":{"1min":1.718,"5min":1.73,"15min":1.73},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.056,"5min":1.147,"15min":1.137},"min":{"1min":0.622,"5min":0.622,"15min":0.53700000000000003},"max":{"1min":1.4990000000000001,"5min":1.875,"15min":2.3039999999999998},"last":1.0109999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.177,"15min":1.165},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.65700000000000003},"max":{"1min":1.635,"5min":2.0619999999999998,"15min":2.2999999999999998},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.228,"15min":1.2649999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.55000000000000004},"max":{"1min":1.681,"5min":2.0129999999999999,"15min":2.9319999999999999},"last":1.095}]},{"osd":6,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.258,"15min":1.284},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.587,"5min":1.9199999999999999,"15min":2.5510000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2150000000000001,"15min":1.2170000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.621},"max":{"1min":1.55,"5min":1.8460000000000001,"15min":1.9059999999999999},"last":1.1599999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.258,"15min":1.2589999999999999},"min":{"1min":0.78400000000000003,"5min":0.72099999999999997,"15min":0.58899999999999997},"max":{"1min":1.611,"5min":1.849,"15min":1.849},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.3149999999999999,"15min":1.2969999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.58499999999999996},"max":{"1min":1.8620000000000001,"5min":1.966,"15min":2.1640000000000001},"last":1.2090000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509827,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37588,"kb_used_data":6412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334252,"statfs":{"total":96636764160,"available":96598274048,"internally_reserved":0,"allocated":6565888,"data_stored":8520553,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.747,"15min":0.748},"min":{"1min":0.50800000000000001,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.93200000000000005,"5min":1.296,"15min":1.4670000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.81599999999999995,"15min":0.80500000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.316},"max":{"1min":1.262,"5min":1.429,"15min":1.482},"last":1.53}]},{"osd":1,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.59299999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4430000000000001,"5min":1.466,"15min":1.6599999999999999},"last":1.169},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.92600000000000005,"15min":0.90800000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":1.2809999999999999,"5min":1.3919999999999999,"15min":4.5620000000000003},"last":1.105}]},{"osd":3,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.88400000000000001,"15min":0.85699999999999998},"min":{"1min":0.63500000000000001,"5min":0.52400000000000002,"15min":0.39300000000000002},"max":{"1min":1.5049999999999999,"5min":1.704,"15min":1.704},"last":1.044},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.048,"15min":1.014},"min":{"1min":0.75,"5min":0.63600000000000001,"15min":0.44500000000000001},"max":{"1min":1.643,"5min":1.643,"15min":1.661},"last":1.4330000000000001}]},{"osd":4,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.1259999999999999,"15min":1.105},"min":{"1min":0.67800000000000005,"5min":0.65600000000000003,"15min":0.51200000000000001},"max":{"1min":1.3799999999999999,"5min":1.647,"15min":1.726},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.085,"15min":1.046},"min":{"1min":0.80300000000000005,"5min":0.67400000000000004,"15min":0.53700000000000003},"max":{"1min":1.359,"5min":1.609,"15min":1.6240000000000001},"last":1.2589999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.218,"15min":1.196},"min":{"1min":0.83199999999999996,"5min":0.74099999999999999,"15min":0.624},"max":{"1min":1.458,"5min":1.7649999999999999,"15min":1.8009999999999999},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.204,"15min":1.194},"min":{"1min":0.96599999999999997,"5min":0.85499999999999998,"15min":0.61099999999999999},"max":{"1min":1.466,"5min":1.7470000000000001,"15min":1.855},"last":1.667}]},{"osd":6,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1519999999999999,"15min":1.139},"min":{"1min":0.84699999999999998,"5min":0.80600000000000005,"15min":0.66300000000000003},"max":{"1min":1.478,"5min":1.5209999999999999,"15min":1.7270000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.282,"15min":1.2689999999999999},"min":{"1min":0.93999999999999995,"5min":0.77800000000000002,"15min":0.54700000000000004},"max":{"1min":1.5469999999999999,"5min":1.919,"15min":2.0150000000000001},"last":1.8100000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:25:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3,"15min":1.2729999999999999},"min":{"1min":1.0109999999999999,"5min":0.76200000000000001,"15min":0.56999999999999995},"max":{"1min":1.5489999999999999,"5min":1.8400000000000001,"15min":1.9810000000000001},"last":1.7729999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.2430000000000001,"15min":1.22},"min":{"1min":0.97499999999999998,"5min":0.82099999999999995,"15min":0.68500000000000005},"max":{"1min":1.6040000000000001,"5min":1.7869999999999999,"15min":1.8240000000000001},"last":1.74}]}]},{"osd":1,"up_from":15,"seq":64424509829,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":721711,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.50900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.7689999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.85799999999999998,"15min":0.80700000000000005},"min":{"1min":0.61299999999999999,"5min":0.34200000000000003,"15min":0.33700000000000002},"max":{"1min":1.3340000000000001,"5min":1.556,"15min":1.556},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.75},"min":{"1min":0.54000000000000004,"5min":0.41699999999999998,"15min":0.41599999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.4510000000000001},"last":0.996},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96699999999999997,"15min":0.91800000000000004},"min":{"1min":0.60599999999999998,"5min":0.50800000000000001,"15min":0.33500000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":2.0019999999999998},"last":1.046}]},{"osd":3,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.002,"15min":0.95999999999999996},"min":{"1min":0.51100000000000001,"5min":0.46100000000000002,"15min":0.32400000000000001},"max":{"1min":1.3819999999999999,"5min":1.639,"15min":1.948},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97599999999999998,"15min":0.94099999999999995},"min":{"1min":0.69999999999999996,"5min":0.48699999999999999,"15min":0.35199999999999998},"max":{"1min":1.4099999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.89300000000000002}]},{"osd":4,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1339999999999999,"15min":1.0760000000000001},"min":{"1min":0.80500000000000005,"5min":0.67700000000000005,"15min":0.57299999999999995},"max":{"1min":1.577,"5min":1.879,"15min":1.879},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.194,"15min":1.163},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.626},"max":{"1min":1.5,"5min":1.7470000000000001,"15min":2.0259999999999998},"last":1.284}]},{"osd":5,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2190000000000001,"15min":1.163},"min":{"1min":0.76100000000000001,"5min":0.71899999999999997,"15min":0.60199999999999998},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.9179999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2270000000000001,"15min":1.1679999999999999},"min":{"1min":0.92800000000000005,"5min":0.65300000000000002,"15min":0.64600000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.3340000000000001}]},{"osd":6,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.284,"15min":1.242},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.569,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.419},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.28,"15min":1.238},"min":{"1min":1.008,"5min":0.85299999999999998,"15min":0.66200000000000003},"max":{"1min":1.631,"5min":1.7529999999999999,"15min":2.0259999999999998},"last":1.2589999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3360000000000001,"15min":1.28},"min":{"1min":1.0640000000000001,"5min":0.82799999999999996,"15min":0.66600000000000004},"max":{"1min":1.526,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.298,"15min":1.2450000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.67300000000000004},"max":{"1min":1.786,"5min":1.873,"15min":2.1880000000000002},"last":1.3899999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509828,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46668,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94325172,"statfs":{"total":96636764160,"available":96588976128,"internally_reserved":0,"allocated":3084288,"data_stored":4325633,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1319999999999999,"5min":1.3819999999999999,"15min":1.698},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81000000000000005,"15min":0.80000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1990000000000001,"5min":1.788,"15min":1.907},"last":1.2689999999999999}]},{"osd":2,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.34100000000000003},"max":{"1min":1.2989999999999999,"5min":1.633,"15min":1.633},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91500000000000004,"15min":0.875},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.639,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.81799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.657},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0289999999999999,"15min":1.016},"min":{"1min":0.48399999999999999,"5min":0.40999999999999998,"15min":0.38400000000000001},"max":{"1min":1.4890000000000001,"5min":1.694,"15min":2.2850000000000001},"last":0.999}]},{"osd":4,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.1000000000000001},"last":1.177},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.081,"15min":1.1160000000000001},"min":{"1min":0.68500000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":14.787000000000001},"last":1.1040000000000001}]},{"osd":5,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1890000000000001,"15min":1.1839999999999999},"min":{"1min":0.76700000000000002,"5min":0.68000000000000005,"15min":0.61699999999999999},"max":{"1min":1.726,"5min":1.726,"15min":2.218},"last":1.228},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.226,"15min":1.2010000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.66900000000000004},"max":{"1min":1.8009999999999999,"5min":1.8740000000000001,"15min":2.2309999999999999},"last":1.073}]},{"osd":6,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1499999999999999,"15min":1.1419999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.3380000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2929999999999999,"15min":1.28},"min":{"1min":0.80900000000000005,"5min":0.747,"15min":0.68500000000000005},"max":{"1min":1.927,"5min":1.927,"15min":2.1480000000000001},"last":1.125}]},{"osd":7,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.2729999999999999,"15min":1.266},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.60199999999999998},"max":{"1min":1.9730000000000001,"5min":2.0059999999999998,"15min":2.3300000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2250000000000001,"15min":1.218},"min":{"1min":0.73999999999999999,"5min":0.67000000000000004,"15min":0.58099999999999996},"max":{"1min":2.024,"5min":2.024,"15min":2.4319999999999999},"last":1.0369999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542531,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29016,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342824,"statfs":{"total":96636764160,"available":96607051776,"internally_reserved":0,"allocated":2048000,"data_stored":3016855,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.92600000000000005,"15min":0.91200000000000003},"min":{"1min":0.63400000000000001,"5min":0.55200000000000005,"15min":0.38100000000000001},"max":{"1min":1.2669999999999999,"5min":1.8069999999999999,"15min":1.8939999999999999},"last":1.016},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.208,"5min":1.948,"15min":1.948},"last":0.745}]},{"osd":1,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.96899999999999997,"15min":0.93700000000000006},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.244,"5min":3.246,"15min":3.246},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95299999999999996,"15min":0.94599999999999995},"min":{"1min":0.72299999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.282,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":0.94499999999999995}]},{"osd":2,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97999999999999998,"15min":0.97499999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.712,"15min":1.9399999999999999},"last":0.996},{"interface":"front","average":{"1min":1.018,"5min":0.97499999999999998,"15min":0.97899999999999998},"min":{"1min":0.79000000000000004,"5min":0.50700000000000001,"15min":0.47799999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.8280000000000001},"last":1.1120000000000001}]},{"osd":3,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0509999999999999,"15min":1.036},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.55300000000000005},"max":{"1min":1.3400000000000001,"5min":1.528,"15min":1.528},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.002,"5min":1.024,"15min":1.0109999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.359,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.0429999999999999}]},{"osd":4,"last update":"Fri Dec 8 21:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93999999999999995,"15min":0.96499999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.55300000000000005},"max":{"1min":1.272,"5min":1.3859999999999999,"15min":1.45},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.92600000000000005,"15min":0.98899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2709999999999999,"5min":1.371,"15min":1.5680000000000001},"last":0.88}]},{"osd":5,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92800000000000005,"15min":0.98099999999999998},"min":{"1min":0.63800000000000001,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.2270000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.085,"5min":1.0920000000000001,"15min":1.127},"min":{"1min":0.67800000000000005,"5min":0.66200000000000003,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.6419999999999999,"15min":1.857},"last":0.80000000000000004}]},{"osd":6,"last update":"Fri Dec 8 21:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0289999999999999,"15min":1.079},"min":{"1min":0.77400000000000002,"5min":0.68799999999999994,"15min":0.57399999999999995},"max":{"1min":1.2789999999999999,"5min":1.8380000000000001,"15min":1.948},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.202,"5min":1.194,"15min":1.212},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6399999999999999,"5min":1.6639999999999999,"15min":2.0019999999999998},"last":1.0680000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542532,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42332,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329508,"statfs":{"total":96636764160,"available":96593416192,"internally_reserved":0,"allocated":2904064,"data_stored":4325577,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94699999999999995,"15min":0.89900000000000002},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48799999999999999},"max":{"1min":1.2390000000000001,"5min":1.395,"15min":1.4430000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.96699999999999997,"15min":0.90800000000000003},"min":{"1min":0.66800000000000004,"5min":0.56599999999999995,"15min":0.44900000000000001},"max":{"1min":1.3200000000000001,"5min":1.3979999999999999,"15min":1.4790000000000001},"last":1.1279999999999999}]},{"osd":1,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.98699999999999999,"15min":0.93999999999999995},"min":{"1min":0.59099999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.92700000000000005,"15min":0.91900000000000004},"min":{"1min":0.78500000000000003,"5min":0.53600000000000003,"15min":0.48699999999999999},"max":{"1min":1.304,"5min":1.4159999999999999,"15min":1.512},"last":1.304}]},{"osd":2,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.96999999999999997,"15min":0.93700000000000006},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.53800000000000003},"max":{"1min":1.2729999999999999,"5min":1.357,"15min":1.421},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0429999999999999,"15min":0.999},"min":{"1min":0.80000000000000004,"5min":0.59099999999999997,"15min":0.51300000000000001},"max":{"1min":1.4690000000000001,"5min":1.546,"15min":1.546},"last":1.3759999999999999}]},{"osd":3,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.032,"15min":1.0229999999999999},"min":{"1min":0.69299999999999995,"5min":0.621,"15min":0.56000000000000005},"max":{"1min":1.3700000000000001,"5min":1.5529999999999999,"15min":1.708},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1559999999999999,"15min":1.1259999999999999},"min":{"1min":0.77400000000000002,"5min":0.72499999999999998,"15min":0.54700000000000004},"max":{"1min":1.3959999999999999,"5min":1.542,"15min":1.7},"last":1.341}]},{"osd":4,"last update":"Fri Dec 8 21:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.96399999999999997,"15min":0.97299999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.50900000000000001},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.016,"15min":1.0009999999999999},"min":{"1min":0.71899999999999997,"5min":0.64000000000000001,"15min":0.57899999999999996},"max":{"1min":1.3169999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.2410000000000001}]},{"osd":5,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.69099999999999995,"5min":0.56499999999999995,"15min":0.53100000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.79},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1200000000000001,"15min":1.113},"min":{"1min":0.90400000000000003,"5min":0.69399999999999995,"15min":0.432},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.94699999999999995}]},{"osd":7,"last update":"Fri Dec 8 21:26:03 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.0600000000000001,"15min":1.0620000000000001},"min":{"1min":0.70399999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5820000000000001,"5min":1.732,"15min":1.732},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.198,"15min":1.198},"min":{"1min":0.79900000000000004,"5min":0.75900000000000001,"15min":0.47299999999999998},"max":{"1min":1.6859999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.413}]}]},{"osd":4,"up_from":14,"seq":60129542530,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55520,"kb_used_data":6296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316320,"statfs":{"total":96636764160,"available":96579911680,"internally_reserved":0,"allocated":6447104,"data_stored":8521225,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.90200000000000002},"min":{"1min":0.63900000000000001,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.6000000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92200000000000004,"15min":0.90800000000000003},"min":{"1min":0.54200000000000004,"5min":0.51000000000000001,"15min":0.41399999999999998},"max":{"1min":1.1359999999999999,"5min":1.3440000000000001,"15min":1.391},"last":1.351}]},{"osd":1,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93799999999999994,"15min":0.91100000000000003},"min":{"1min":0.64100000000000001,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":1.2629999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0289999999999999,"15min":0.998},"min":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.46100000000000002},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4570000000000001},"last":1.2749999999999999}]},{"osd":2,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0029999999999999,"15min":1.0089999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3400000000000001,"5min":1.4710000000000001,"15min":1.681},"last":1.4079999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.95399999999999996,"15min":0.94899999999999995},"min":{"1min":0.67700000000000005,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.1479999999999999,"5min":1.52,"15min":1.52},"last":1.2250000000000001}]},{"osd":3,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.996,"15min":0.98699999999999999},"min":{"1min":0.65500000000000003,"5min":0.63100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2150000000000001,"5min":1.927,"15min":1.927},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.143,"15min":1.1140000000000001},"min":{"1min":0.84199999999999997,"5min":0.64100000000000001,"15min":0.433},"max":{"1min":1.3680000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0389999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.876,"15min":0.91700000000000004},"min":{"1min":0.63700000000000001,"5min":0.56599999999999995,"15min":0.46300000000000002},"max":{"1min":1.034,"5min":1.28,"15min":1.504},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0069999999999999,"15min":0.998},"min":{"1min":0.74299999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.145}]},{"osd":6,"last update":"Fri Dec 8 21:25:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.03,"15min":1.0549999999999999},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.54500000000000004},"max":{"1min":1.415,"5min":1.478,"15min":1.617},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0660000000000001,"15min":1.0569999999999999},"min":{"1min":0.80600000000000005,"5min":0.69899999999999995,"15min":0.52900000000000003},"max":{"1min":1.294,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.79300000000000004}]},{"osd":7,"last update":"Fri Dec 8 21:25:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.159,"15min":1.157},"min":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.39400000000000002},"max":{"1min":1.524,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.335},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0800000000000001,"15min":1.0960000000000001},"min":{"1min":0.72699999999999998,"5min":0.58299999999999996,"15min":0.45400000000000001},"max":{"1min":1.238,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.4650000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":4194360,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6246400,"data_stored":8389280,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8695808,"data_stored":12583494,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":8389952,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4313088,"data_stored":7079854,"data_compressed":822166,"data_compressed_allocated":1216512,"data_compressed_original":3993600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":4194304,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1728512,"data_stored":2885582,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T21:26:17.195 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.195 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.196 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.196 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.196 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.196 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.196 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.196 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.196 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.196 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.197 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.197 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.197 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.197 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.197 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.197 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.197 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.197 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.198 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.198 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.198 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.198 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.198 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.198 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.198 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.198 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.198 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.199 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.199 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.199 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.199 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.199 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.199 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.199 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.199 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.200 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.200 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.200 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.200 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.200 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.200 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.200 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.200 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.201 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.201 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.201 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.201 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.201 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-12-08T20:54:53.270644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=53, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.201 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.201 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.201 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.201 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.202 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.202 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.202 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.202 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.202 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.202 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.202 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.203 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.203 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.203 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.203 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.203 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.203 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:17.203 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-08T21:26:22.807 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:32:51.603 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:26:22.825 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:32:51.620 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:26:22.990 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:32:51.711 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:26:23.005 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:32:51.727 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:26:23.019 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:32:51.741 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:26:23.026 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:32:51.749 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:26:23.113 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:32:51.908 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:26:23.250 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:32:51.972 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:26:23.251 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:32:51.974 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:26:33.655 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:26:33.658 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:26:37.204 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T21:26:37.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.342+0000 7f170a434640 1 Processor -- start 2023-12-08T21:26:37.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.342+0000 7f170a434640 1 -- start start 2023-12-08T21:26:37.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.342+0000 7f170a434640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17040c94b0 0x7f17040c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:37.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.342+0000 7f170a434640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17040c75d0 0x7f1704161e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:37.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.342+0000 7f170a434640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17040c6c00 con 0x7f17041518f0 2023-12-08T21:26:37.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.342+0000 7f170a434640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17040c3920 con 0x7f17040c94b0 2023-12-08T21:26:37.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.342+0000 7f170a434640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17040c7a60 con 0x7f17040c75d0 2023-12-08T21:26:37.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.354+0000 7f17089d1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17040c75d0 0x7f1704161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:37.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.358+0000 7f17089d1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17040c75d0 0x7f1704161e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:59926/0 (socket says 172.21.15.53:59926) 2023-12-08T21:26:37.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.358+0000 7f17089d1640 1 -- 172.21.15.53:0/207859710 learned_addr learned my addr 172.21.15.53:0/207859710 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:26:37.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.426+0000 7f17037fe640 1 --2- 172.21.15.53:0/207859710 >> v2:172.21.15.53:3300/0 conn(0x7f17040c94b0 0x7f17040c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.434+0000 7f17037fe640 1 -- 172.21.15.53:0/207859710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17040c75d0 msgr2=0x7f1704161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:26:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.434+0000 7f17037fe640 1 --2- 172.21.15.53:0/207859710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17040c75d0 0x7f1704161e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.434+0000 7f17037fe640 1 -- 172.21.15.53:0/207859710 >> v1:172.21.15.53:6789/0 conn(0x7f17041518f0 legacy=0x7f170406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.434+0000 7f17037fe640 1 -- 172.21.15.53:0/207859710 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17040c41b0 con 0x7f17040c94b0 2023-12-08T21:26:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.442+0000 7f17037fe640 1 --2- 172.21.15.53:0/207859710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17040c94b0 0x7f17040c7090 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009d90 tx=0x7f16f801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d144bc18accbac server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:26:37.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.450+0000 7f1702ffd640 1 -- 172.21.15.53:0/207859710 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80a59a0 con 0x7f17040c94b0 2023-12-08T21:26:37.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.450+0000 7f1702ffd640 1 -- 172.21.15.53:0/207859710 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f80a5b00 con 0x7f17040c94b0 2023-12-08T21:26:37.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.450+0000 7f1702ffd640 1 -- 172.21.15.53:0/207859710 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80a5e90 con 0x7f17040c94b0 2023-12-08T21:26:37.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.454+0000 7f170a434640 1 -- 172.21.15.53:0/207859710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17040c94b0 msgr2=0x7f17040c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:37.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.454+0000 7f170a434640 1 --2- 172.21.15.53:0/207859710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17040c94b0 0x7f17040c7090 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009d90 tx=0x7f16f801c8c0 comp rx=0 tx=0).stop 2023-12-08T21:26:37.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.454+0000 7f170a434640 1 -- 172.21.15.53:0/207859710 shutdown_connections 2023-12-08T21:26:37.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.454+0000 7f170a434640 1 --2- 172.21.15.53:0/207859710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17040c75d0 0x7f1704161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:37.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.454+0000 7f170a434640 1 --2- 172.21.15.53:0/207859710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17040c94b0 0x7f17040c7090 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:37.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.454+0000 7f170a434640 1 -- 172.21.15.53:0/207859710 >> 172.21.15.53:0/207859710 conn(0x7f17040c8990 msgr2=0x7f17040c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:26:37.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.454+0000 7f170a434640 1 -- 172.21.15.53:0/207859710 shutdown_connections 2023-12-08T21:26:37.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.454+0000 7f170a434640 1 -- 172.21.15.53:0/207859710 wait complete. 2023-12-08T21:26:37.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.454+0000 7f170a434640 1 Processor -- start 2023-12-08T21:26:37.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.454+0000 7f170a434640 1 -- start start 2023-12-08T21:26:37.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.458+0000 7f170a434640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17040c75d0 0x7f17041f0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.458+0000 7f170a434640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17040c94b0 0x7f170415b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.458+0000 7f170a434640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17041518f0 0x7f17041571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.458+0000 7f170a434640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1704145830 con 0x7f17041518f0 2023-12-08T21:26:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.458+0000 7f170a434640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17041f08a0 con 0x7f17040c75d0 2023-12-08T21:26:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.458+0000 7f170a434640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1704156440 con 0x7f17040c94b0 2023-12-08T21:26:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.458+0000 7f17089d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17041518f0 0x7f17041571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.458+0000 7f17089d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17041518f0 0x7f17041571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56370/0 (socket says 172.21.15.53:56370) 2023-12-08T21:26:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.458+0000 7f17089d1640 1 -- 172.21.15.53:0/2149924669 learned_addr learned my addr 172.21.15.53:0/2149924669 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:26:37.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.462+0000 7f1703fff640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17040c75d0 0x7f17041f0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.462+0000 7f17089d1640 1 -- 172.21.15.53:0/2149924669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17040c94b0 msgr2=0x7f170415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.462+0000 7f17089d1640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17040c94b0 0x7f170415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.462+0000 7f17089d1640 1 -- 172.21.15.53:0/2149924669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17040c75d0 msgr2=0x7f17041f0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.462+0000 7f17089d1640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17040c75d0 0x7f17041f0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.462+0000 7f17089d1640 1 -- 172.21.15.53:0/2149924669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f8009a70 con 0x7f17041518f0 2023-12-08T21:26:37.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.466+0000 7f17089d1640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17041518f0 0x7f17041571e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00e880 tx=0x7f16fc00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:26:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.474+0000 7f1700ff9640 1 -- 172.21.15.53:0/2149924669 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc00c940 con 0x7f17041518f0 2023-12-08T21:26:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.474+0000 7f1700ff9640 1 -- 172.21.15.53:0/2149924669 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc00caa0 con 0x7f17041518f0 2023-12-08T21:26:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.474+0000 7f170a434640 1 -- 172.21.15.53:0/2149924669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170415bd80 con 0x7f17041518f0 2023-12-08T21:26:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.474+0000 7f1700ff9640 1 -- 172.21.15.53:0/2149924669 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc00ce50 con 0x7f17041518f0 2023-12-08T21:26:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.474+0000 7f170a434640 1 -- 172.21.15.53:0/2149924669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1704156700 con 0x7f17041518f0 2023-12-08T21:26:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.478+0000 7f170a434640 1 -- 172.21.15.53:0/2149924669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1704074190 con 0x7f17041518f0 2023-12-08T21:26:37.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.798+0000 7f1700ff9640 1 -- 172.21.15.53:0/2149924669 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16fc013470 con 0x7f17041518f0 2023-12-08T21:26:37.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.798+0000 7f1700ff9640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f16f00664c0 0x7f16f0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:37.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.798+0000 7f1703fff640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f16f00664c0 0x7f16f0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:37.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.798+0000 7f1703fff640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f16f00664c0 0x7f16f0068980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f16f40015b0 tx=0x7f16f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:26:37.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.838+0000 7f1700ff9640 1 -- 172.21.15.53:0/2149924669 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f16fc0560c0 con 0x7f17041518f0 2023-12-08T21:26:37.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:37.838+0000 7f1700ff9640 1 -- 172.21.15.53:0/2149924669 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16fc051d00 con 0x7f17041518f0 2023-12-08T21:26:38.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.018+0000 7f170a434640 1 -- 172.21.15.53:0/2149924669 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17040b2230 con 0x7f16f00664c0 2023-12-08T21:26:38.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.034+0000 7f1700ff9640 1 -- 172.21.15.53:0/2149924669 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370900 (secure 0 0 0) 0x7f17040b2230 con 0x7f16f00664c0 2023-12-08T21:26:38.037 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:26:38.040 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-12-08T21:26:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.038+0000 7f170a434640 1 -- 172.21.15.53:0/2149924669 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f16f00664c0 msgr2=0x7f16f0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.038+0000 7f170a434640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f16f00664c0 0x7f16f0068980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f16f40015b0 tx=0x7f16f4009040 comp rx=0 tx=0).stop 2023-12-08T21:26:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.038+0000 7f170a434640 1 -- 172.21.15.53:0/2149924669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17041518f0 msgr2=0x7f17041571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.038+0000 7f170a434640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17041518f0 0x7f17041571e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00e880 tx=0x7f16fc00ed40 comp rx=0 tx=0).stop 2023-12-08T21:26:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.038+0000 7f170a434640 1 -- 172.21.15.53:0/2149924669 shutdown_connections 2023-12-08T21:26:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.038+0000 7f170a434640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f16f00664c0 0x7f16f0068980 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.038+0000 7f170a434640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17041518f0 0x7f17041571e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.038+0000 7f170a434640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17040c94b0 0x7f170415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.038+0000 7f170a434640 1 --2- 172.21.15.53:0/2149924669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17040c75d0 0x7f17041f0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.038+0000 7f170a434640 1 -- 172.21.15.53:0/2149924669 >> 172.21.15.53:0/2149924669 conn(0x7f17040c8990 msgr2=0x7f170406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:26:38.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.038+0000 7f170a434640 1 -- 172.21.15.53:0/2149924669 shutdown_connections 2023-12-08T21:26:38.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:38.038+0000 7f170a434640 1 -- 172.21.15.53:0/2149924669 wait complete. 2023-12-08T21:26:38.061 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":999,"stamp":"2023-12-08T21:26:36.068900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24448816,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":690,"num_read_kb":695,"num_write":8182,"num_write_kb":281588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9430,"ondisk_log_size":9430,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332312,"kb_used_data":34328,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754642408,"statfs":{"total":773094113280,"available":772753825792,"internally_reserved":0,"allocated":35151872,"data_stored":49947816,"data_compressed":4799006,"data_compressed_allocated":7397376,"data_compressed_original":23764992,"omap_allocated":12752,"internal_metadata":305057328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005480"},"pg_stats":[{"pgid":"2.1f","version":"30'723","reported_seq":768,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.005407+0000","last_change":"2023-12-08T21:26:04.005407+0000","last_active":"2023-12-08T21:26:04.005407+0000","last_peered":"2023-12-08T21:26:04.005407+0000","last_clean":"2023-12-08T21:26:04.005407+0000","last_became_active":"2023-12-08T20:54:54.982479+0000","last_became_peered":"2023-12-08T20:54:54.982479+0000","last_unstale":"2023-12-08T21:26:04.005407+0000","last_undegraded":"2023-12-08T21:26:04.005407+0000","last_fullsized":"2023-12-08T21:26:04.005407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'723","last_scrub_stamp":"2023-12-08T21:26:04.005126+0000","last_deep_scrub":"30'723","last_deep_scrub_stamp":"2023-12-08T21:26:04.005126+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.005126+0000","objects_scrubbed":3,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:15:19.024106+0000","scrub_duration":0.032565425000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":4491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.842692+0000","last_change":"2023-12-08T21:26:17.842746+0000","last_active":"2023-12-08T21:26:17.842692+0000","last_peered":"2023-12-08T21:26:17.842692+0000","last_clean":"2023-12-08T21:26:17.842692+0000","last_became_active":"2023-12-08T20:54:56.406245+0000","last_became_peered":"2023-12-08T20:54:56.406245+0000","last_unstale":"2023-12-08T21:26:17.842692+0000","last_undegraded":"2023-12-08T21:26:17.842692+0000","last_fullsized":"2023-12-08T21:26:17.842692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:26:17.842517+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:26:17.842517+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.842517+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:52:41.624179+0000","scrub_duration":0.0034622569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'66","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.354802+0000","last_change":"2023-12-08T21:26:13.354863+0000","last_active":"2023-12-08T21:26:13.354802+0000","last_peered":"2023-12-08T21:26:13.354802+0000","last_clean":"2023-12-08T21:26:13.354802+0000","last_became_active":"2023-12-08T20:55:04.458087+0000","last_became_peered":"2023-12-08T20:55:04.458087+0000","last_unstale":"2023-12-08T21:26:13.354802+0000","last_undegraded":"2023-12-08T21:26:13.354802+0000","last_fullsized":"2023-12-08T21:26:13.354802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'66","last_scrub_stamp":"2023-12-08T21:26:13.354616+0000","last_deep_scrub":"30'66","last_deep_scrub_stamp":"2023-12-08T21:26:13.354616+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.354616+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:22:11.785201+0000","scrub_duration":0.0069482959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'291","reported_seq":336,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:12.896378+0000","last_change":"2023-12-08T21:26:12.896418+0000","last_active":"2023-12-08T21:26:12.896378+0000","last_peered":"2023-12-08T21:26:12.896378+0000","last_clean":"2023-12-08T21:26:12.896378+0000","last_became_active":"2023-12-08T20:54:54.929391+0000","last_became_peered":"2023-12-08T20:54:54.929391+0000","last_unstale":"2023-12-08T21:26:12.896378+0000","last_undegraded":"2023-12-08T21:26:12.896378+0000","last_fullsized":"2023-12-08T21:26:12.896378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'291","last_scrub_stamp":"2023-12-08T21:26:12.896235+0000","last_deep_scrub":"30'291","last_deep_scrub_stamp":"2023-12-08T21:26:12.896235+0000","last_clean_scrub_stamp":"2023-12-08T21:26:12.896235+0000","objects_scrubbed":1,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:55:16.287502+0000","scrub_duration":0.026480232999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759983,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":2843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:05.915231+0000","last_change":"2023-12-08T21:26:05.915231+0000","last_active":"2023-12-08T21:26:05.915231+0000","last_peered":"2023-12-08T21:26:05.915231+0000","last_clean":"2023-12-08T21:26:05.915231+0000","last_became_active":"2023-12-08T20:54:56.408361+0000","last_became_peered":"2023-12-08T20:54:56.408361+0000","last_unstale":"2023-12-08T21:26:05.915231+0000","last_undegraded":"2023-12-08T21:26:05.915231+0000","last_fullsized":"2023-12-08T21:26:05.915231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:05.914915+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:05.914915+0000","last_clean_scrub_stamp":"2023-12-08T21:26:05.914915+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:55:04.773085+0000","scrub_duration":0.0057752130000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'74","reported_seq":103,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:50.896753+0000","last_change":"2023-12-08T20:55:04.529086+0000","last_active":"2023-12-08T21:25:50.896753+0000","last_peered":"2023-12-08T21:25:50.896753+0000","last_clean":"2023-12-08T21:25:50.896753+0000","last_became_active":"2023-12-08T20:55:04.528732+0000","last_became_peered":"2023-12-08T20:55:04.528732+0000","last_unstale":"2023-12-08T21:25:50.896753+0000","last_undegraded":"2023-12-08T21:25:50.896753+0000","last_fullsized":"2023-12-08T21:25:50.896753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'10","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.114439+0000","last_change":"2023-12-08T21:26:06.114494+0000","last_active":"2023-12-08T21:26:06.114439+0000","last_peered":"2023-12-08T21:26:06.114439+0000","last_clean":"2023-12-08T21:26:06.114439+0000","last_became_active":"2023-12-08T20:54:54.935620+0000","last_became_peered":"2023-12-08T20:54:54.935620+0000","last_unstale":"2023-12-08T21:26:06.114439+0000","last_undegraded":"2023-12-08T21:26:06.114439+0000","last_fullsized":"2023-12-08T21:26:06.114439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'10","last_scrub_stamp":"2023-12-08T21:26:06.114261+0000","last_deep_scrub":"30'10","last_deep_scrub_stamp":"2023-12-08T21:26:06.114261+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.114261+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:08:13.151028+0000","scrub_duration":0.0062390579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'23","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.720222+0000","last_change":"2023-12-08T21:25:55.720252+0000","last_active":"2023-12-08T21:25:55.720222+0000","last_peered":"2023-12-08T21:25:55.720222+0000","last_clean":"2023-12-08T21:25:55.720222+0000","last_became_active":"2023-12-08T20:54:56.380927+0000","last_became_peered":"2023-12-08T20:54:56.380927+0000","last_unstale":"2023-12-08T21:25:55.720222+0000","last_undegraded":"2023-12-08T21:25:55.720222+0000","last_fullsized":"2023-12-08T21:25:55.720222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-12-08T21:25:55.720096+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-12-08T21:25:55.720096+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.720096+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:07:37.367406+0000","scrub_duration":0.001780451,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'75","reported_seq":103,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:04.075186+0000","last_change":"2023-12-08T20:55:04.527024+0000","last_active":"2023-12-08T21:25:04.075186+0000","last_peered":"2023-12-08T21:25:04.075186+0000","last_clean":"2023-12-08T21:25:04.075186+0000","last_became_active":"2023-12-08T20:55:04.526605+0000","last_became_peered":"2023-12-08T20:55:04.526605+0000","last_unstale":"2023-12-08T21:25:04.075186+0000","last_undegraded":"2023-12-08T21:25:04.075186+0000","last_fullsized":"2023-12-08T21:25:04.075186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'4","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.138425+0000","last_change":"2023-12-08T21:25:59.138488+0000","last_active":"2023-12-08T21:25:59.138425+0000","last_peered":"2023-12-08T21:25:59.138425+0000","last_clean":"2023-12-08T21:25:59.138425+0000","last_became_active":"2023-12-08T20:54:54.926132+0000","last_became_peered":"2023-12-08T20:54:54.926132+0000","last_unstale":"2023-12-08T21:25:59.138425+0000","last_undegraded":"2023-12-08T21:25:59.138425+0000","last_fullsized":"2023-12-08T21:25:59.138425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:25:59.138233+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:25:59.138233+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.138233+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:45:09.492467+0000","scrub_duration":0.0063764290000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.270295+0000","last_change":"2023-12-08T21:25:53.270348+0000","last_active":"2023-12-08T21:25:53.270295+0000","last_peered":"2023-12-08T21:25:53.270295+0000","last_clean":"2023-12-08T21:25:53.270295+0000","last_became_active":"2023-12-08T20:54:56.387528+0000","last_became_peered":"2023-12-08T20:54:56.387528+0000","last_unstale":"2023-12-08T21:25:53.270295+0000","last_undegraded":"2023-12-08T21:25:53.270295+0000","last_fullsized":"2023-12-08T21:25:53.270295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-12-08T21:25:53.270101+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-12-08T21:25:53.270101+0000","last_clean_scrub_stamp":"2023-12-08T21:25:53.270101+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:05:32.821478+0000","scrub_duration":0.0031071860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'65","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:31.052896+0000","last_change":"2023-12-08T21:26:31.052951+0000","last_active":"2023-12-08T21:26:31.052896+0000","last_peered":"2023-12-08T21:26:31.052896+0000","last_clean":"2023-12-08T21:26:31.052896+0000","last_became_active":"2023-12-08T20:55:04.522777+0000","last_became_peered":"2023-12-08T20:55:04.522777+0000","last_unstale":"2023-12-08T21:26:31.052896+0000","last_undegraded":"2023-12-08T21:26:31.052896+0000","last_fullsized":"2023-12-08T21:26:31.052896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'65","last_scrub_stamp":"2023-12-08T21:26:31.052697+0000","last_deep_scrub":"30'65","last_deep_scrub_stamp":"2023-12-08T21:26:31.052697+0000","last_clean_scrub_stamp":"2023-12-08T21:26:31.052697+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:17:32.021452+0000","scrub_duration":0.0065787759999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'17","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:56.220369+0000","last_change":"2023-12-08T21:25:56.220422+0000","last_active":"2023-12-08T21:25:56.220369+0000","last_peered":"2023-12-08T21:25:56.220369+0000","last_clean":"2023-12-08T21:25:56.220369+0000","last_became_active":"2023-12-08T20:54:56.318855+0000","last_became_peered":"2023-12-08T20:54:56.318855+0000","last_unstale":"2023-12-08T21:25:56.220369+0000","last_undegraded":"2023-12-08T21:25:56.220369+0000","last_fullsized":"2023-12-08T21:25:56.220369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:25:56.220174+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:25:56.220174+0000","last_clean_scrub_stamp":"2023-12-08T21:25:56.220174+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:56:56.117995+0000","scrub_duration":0.0032244330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'724","reported_seq":768,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:20.319654+0000","last_change":"2023-12-08T21:26:20.319654+0000","last_active":"2023-12-08T21:26:20.319654+0000","last_peered":"2023-12-08T21:26:20.319654+0000","last_clean":"2023-12-08T21:26:20.319654+0000","last_became_active":"2023-12-08T20:54:54.928702+0000","last_became_peered":"2023-12-08T20:54:54.928702+0000","last_unstale":"2023-12-08T21:26:20.319654+0000","last_undegraded":"2023-12-08T21:26:20.319654+0000","last_fullsized":"2023-12-08T21:26:20.319654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'724","last_scrub_stamp":"2023-12-08T21:26:20.319380+0000","last_deep_scrub":"30'724","last_deep_scrub_stamp":"2023-12-08T21:26:20.319380+0000","last_clean_scrub_stamp":"2023-12-08T21:26:20.319380+0000","objects_scrubbed":2,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:20:37.962997+0000","scrub_duration":0.034444677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'78","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:51.796077+0000","last_change":"2023-12-08T20:55:04.535786+0000","last_active":"2023-12-08T21:25:51.796077+0000","last_peered":"2023-12-08T21:25:51.796077+0000","last_clean":"2023-12-08T21:25:51.796077+0000","last_became_active":"2023-12-08T20:55:04.535119+0000","last_became_peered":"2023-12-08T20:55:04.535119+0000","last_unstale":"2023-12-08T21:25:51.796077+0000","last_undegraded":"2023-12-08T21:25:51.796077+0000","last_fullsized":"2023-12-08T21:25:51.796077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":12383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.326859+0000","last_change":"2023-12-08T21:26:08.326859+0000","last_active":"2023-12-08T21:26:08.326859+0000","last_peered":"2023-12-08T21:26:08.326859+0000","last_clean":"2023-12-08T21:26:08.326859+0000","last_became_active":"2023-12-08T20:54:56.370044+0000","last_became_peered":"2023-12-08T20:54:56.370044+0000","last_unstale":"2023-12-08T21:26:08.326859+0000","last_undegraded":"2023-12-08T21:26:08.326859+0000","last_fullsized":"2023-12-08T21:26:08.326859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2023-12-08T21:26:08.326522+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2023-12-08T21:26:08.326522+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.326522+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:07:31.757565+0000","scrub_duration":0.0050124770000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'5","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:57.537252+0000","last_change":"2023-12-08T21:25:57.537304+0000","last_active":"2023-12-08T21:25:57.537252+0000","last_peered":"2023-12-08T21:25:57.537252+0000","last_clean":"2023-12-08T21:25:57.537252+0000","last_became_active":"2023-12-08T20:54:54.922960+0000","last_became_peered":"2023-12-08T20:54:54.922960+0000","last_unstale":"2023-12-08T21:25:57.537252+0000","last_undegraded":"2023-12-08T21:25:57.537252+0000","last_fullsized":"2023-12-08T21:25:57.537252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:25:57.537058+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:25:57.537058+0000","last_clean_scrub_stamp":"2023-12-08T21:25:57.537058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:59:00.836091+0000","scrub_duration":0.0026381299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'95","reported_seq":125,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:48.796375+0000","last_change":"2023-12-08T20:55:04.522655+0000","last_active":"2023-12-08T21:25:48.796375+0000","last_peered":"2023-12-08T21:25:48.796375+0000","last_clean":"2023-12-08T21:25:48.796375+0000","last_became_active":"2023-12-08T20:55:04.522172+0000","last_became_peered":"2023-12-08T20:55:04.522172+0000","last_unstale":"2023-12-08T21:25:48.796375+0000","last_undegraded":"2023-12-08T21:25:48.796375+0000","last_fullsized":"2023-12-08T21:25:48.796375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'24","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.988500+0000","last_change":"2023-12-08T21:26:06.988550+0000","last_active":"2023-12-08T21:26:06.988500+0000","last_peered":"2023-12-08T21:26:06.988500+0000","last_clean":"2023-12-08T21:26:06.988500+0000","last_became_active":"2023-12-08T20:54:56.365552+0000","last_became_peered":"2023-12-08T20:54:56.365552+0000","last_unstale":"2023-12-08T21:26:06.988500+0000","last_undegraded":"2023-12-08T21:26:06.988500+0000","last_fullsized":"2023-12-08T21:26:06.988500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:06.988314+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:06.988314+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.988314+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:03:51.063039+0000","scrub_duration":0.0036073989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'3","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.063454+0000","last_change":"2023-12-08T21:26:01.063563+0000","last_active":"2023-12-08T21:26:01.063454+0000","last_peered":"2023-12-08T21:26:01.063454+0000","last_clean":"2023-12-08T21:26:01.063454+0000","last_became_active":"2023-12-08T20:54:54.979668+0000","last_became_peered":"2023-12-08T20:54:54.979668+0000","last_unstale":"2023-12-08T21:26:01.063454+0000","last_undegraded":"2023-12-08T21:26:01.063454+0000","last_fullsized":"2023-12-08T21:26:01.063454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:26:01.063157+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:26:01.063157+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.063157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:35:10.066399+0000","scrub_duration":0.0036668270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'67","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:16.259777+0000","last_change":"2023-12-08T21:26:16.259836+0000","last_active":"2023-12-08T21:26:16.259777+0000","last_peered":"2023-12-08T21:26:16.259777+0000","last_clean":"2023-12-08T21:26:16.259777+0000","last_became_active":"2023-12-08T20:55:04.512549+0000","last_became_peered":"2023-12-08T20:55:04.512549+0000","last_unstale":"2023-12-08T21:26:16.259777+0000","last_undegraded":"2023-12-08T21:26:16.259777+0000","last_fullsized":"2023-12-08T21:26:16.259777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'67","last_scrub_stamp":"2023-12-08T21:26:16.259537+0000","last_deep_scrub":"30'67","last_deep_scrub_stamp":"2023-12-08T21:26:16.259537+0000","last_clean_scrub_stamp":"2023-12-08T21:26:16.259537+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:51:54.386694+0000","scrub_duration":0.005660259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:05.098379+0000","last_change":"2023-12-08T21:26:05.098498+0000","last_active":"2023-12-08T21:26:05.098379+0000","last_peered":"2023-12-08T21:26:05.098379+0000","last_clean":"2023-12-08T21:26:05.098379+0000","last_became_active":"2023-12-08T20:54:56.260355+0000","last_became_peered":"2023-12-08T20:54:56.260355+0000","last_unstale":"2023-12-08T21:26:05.098379+0000","last_undegraded":"2023-12-08T21:26:05.098379+0000","last_fullsized":"2023-12-08T21:26:05.098379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:05.098155+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:05.098155+0000","last_clean_scrub_stamp":"2023-12-08T21:26:05.098155+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:42:49.369328+0000","scrub_duration":0.0031917870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'6","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:00.129273+0000","last_change":"2023-12-08T21:26:00.129326+0000","last_active":"2023-12-08T21:26:00.129273+0000","last_peered":"2023-12-08T21:26:00.129273+0000","last_clean":"2023-12-08T21:26:00.129273+0000","last_became_active":"2023-12-08T20:54:54.925888+0000","last_became_peered":"2023-12-08T20:54:54.925888+0000","last_unstale":"2023-12-08T21:26:00.129273+0000","last_undegraded":"2023-12-08T21:26:00.129273+0000","last_fullsized":"2023-12-08T21:26:00.129273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:26:00.129079+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:26:00.129079+0000","last_clean_scrub_stamp":"2023-12-08T21:26:00.129079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:31:04.788470+0000","scrub_duration":0.002440752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'77","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:50.896730+0000","last_change":"2023-12-08T20:55:04.529041+0000","last_active":"2023-12-08T21:25:50.896730+0000","last_peered":"2023-12-08T21:25:50.896730+0000","last_clean":"2023-12-08T21:25:50.896730+0000","last_became_active":"2023-12-08T20:55:04.528640+0000","last_became_peered":"2023-12-08T20:55:04.528640+0000","last_unstale":"2023-12-08T21:25:50.896730+0000","last_undegraded":"2023-12-08T21:25:50.896730+0000","last_fullsized":"2023-12-08T21:25:50.896730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.094936+0000","last_change":"2023-12-08T21:25:55.094987+0000","last_active":"2023-12-08T21:25:55.094936+0000","last_peered":"2023-12-08T21:25:55.094936+0000","last_clean":"2023-12-08T21:25:55.094936+0000","last_became_active":"2023-12-08T20:54:56.364597+0000","last_became_peered":"2023-12-08T20:54:56.364597+0000","last_unstale":"2023-12-08T21:25:55.094936+0000","last_undegraded":"2023-12-08T21:25:55.094936+0000","last_fullsized":"2023-12-08T21:25:55.094936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-12-08T21:25:55.094713+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-12-08T21:25:55.094713+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.094713+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:04:47.008353+0000","scrub_duration":0.00344094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'6","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:29.259458+0000","last_change":"2023-12-08T21:26:29.259541+0000","last_active":"2023-12-08T21:26:29.259458+0000","last_peered":"2023-12-08T21:26:29.259458+0000","last_clean":"2023-12-08T21:26:29.259458+0000","last_became_active":"2023-12-08T20:54:54.927814+0000","last_became_peered":"2023-12-08T20:54:54.927814+0000","last_unstale":"2023-12-08T21:26:29.259458+0000","last_undegraded":"2023-12-08T21:26:29.259458+0000","last_fullsized":"2023-12-08T21:26:29.259458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:26:29.259239+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:26:29.259239+0000","last_clean_scrub_stamp":"2023-12-08T21:26:29.259239+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:15:48.929649+0000","scrub_duration":0.0064215950000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'64","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:50.896620+0000","last_change":"2023-12-08T20:55:04.523561+0000","last_active":"2023-12-08T21:25:50.896620+0000","last_peered":"2023-12-08T21:25:50.896620+0000","last_clean":"2023-12-08T21:25:50.896620+0000","last_became_active":"2023-12-08T20:55:04.522714+0000","last_became_peered":"2023-12-08T20:55:04.522714+0000","last_unstale":"2023-12-08T21:25:50.896620+0000","last_undegraded":"2023-12-08T21:25:50.896620+0000","last_fullsized":"2023-12-08T21:25:50.896620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":9451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.956170+0000","last_change":"2023-12-08T21:26:17.956227+0000","last_active":"2023-12-08T21:26:17.956170+0000","last_peered":"2023-12-08T21:26:17.956170+0000","last_clean":"2023-12-08T21:26:17.956170+0000","last_became_active":"2023-12-08T20:54:56.330508+0000","last_became_peered":"2023-12-08T20:54:56.330508+0000","last_unstale":"2023-12-08T21:26:17.956170+0000","last_undegraded":"2023-12-08T21:26:17.956170+0000","last_fullsized":"2023-12-08T21:26:17.956170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:17.955970+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:17.955970+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.955970+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:06:44.699142+0000","scrub_duration":0.0048835149999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'333","reported_seq":377,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:02.992564+0000","last_change":"2023-12-08T21:26:02.992617+0000","last_active":"2023-12-08T21:26:02.992564+0000","last_peered":"2023-12-08T21:26:02.992564+0000","last_clean":"2023-12-08T21:26:02.992564+0000","last_became_active":"2023-12-08T20:54:54.981168+0000","last_became_peered":"2023-12-08T20:54:54.981168+0000","last_unstale":"2023-12-08T21:26:02.992564+0000","last_undegraded":"2023-12-08T21:26:02.992564+0000","last_fullsized":"2023-12-08T21:26:02.992564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'333","last_scrub_stamp":"2023-12-08T21:26:02.992373+0000","last_deep_scrub":"30'333","last_deep_scrub_stamp":"2023-12-08T21:26:02.992373+0000","last_clean_scrub_stamp":"2023-12-08T21:26:02.992373+0000","objects_scrubbed":1,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:49:36.659212+0000","scrub_duration":0.013256799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'104","reported_seq":143,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:22.992858+0000","last_change":"2023-12-08T21:26:22.992885+0000","last_active":"2023-12-08T21:26:22.992858+0000","last_peered":"2023-12-08T21:26:22.992858+0000","last_clean":"2023-12-08T21:26:22.992858+0000","last_became_active":"2023-12-08T20:55:04.511032+0000","last_became_peered":"2023-12-08T20:55:04.511032+0000","last_unstale":"2023-12-08T21:26:22.992858+0000","last_undegraded":"2023-12-08T21:26:22.992858+0000","last_fullsized":"2023-12-08T21:26:22.992858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'104","last_scrub_stamp":"2023-12-08T21:26:22.992736+0000","last_deep_scrub":"30'104","last_deep_scrub_stamp":"2023-12-08T21:26:22.992736+0000","last_clean_scrub_stamp":"2023-12-08T21:26:22.992736+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:20:50.133005+0000","scrub_duration":0.0062269689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":14212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'22","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.466208+0000","last_change":"2023-12-08T21:26:06.466208+0000","last_active":"2023-12-08T21:26:06.466208+0000","last_peered":"2023-12-08T21:26:06.466208+0000","last_clean":"2023-12-08T21:26:06.466208+0000","last_became_active":"2023-12-08T20:54:56.409291+0000","last_became_peered":"2023-12-08T20:54:56.409291+0000","last_unstale":"2023-12-08T21:26:06.466208+0000","last_undegraded":"2023-12-08T21:26:06.466208+0000","last_fullsized":"2023-12-08T21:26:06.466208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:06.465949+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:06.465949+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.465949+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:01:20.008768+0000","scrub_duration":0.0028777999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'5","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:24.230287+0000","last_change":"2023-12-08T21:26:24.230339+0000","last_active":"2023-12-08T21:26:24.230287+0000","last_peered":"2023-12-08T21:26:24.230287+0000","last_clean":"2023-12-08T21:26:24.230287+0000","last_became_active":"2023-12-08T20:54:54.978416+0000","last_became_peered":"2023-12-08T20:54:54.978416+0000","last_unstale":"2023-12-08T21:26:24.230287+0000","last_undegraded":"2023-12-08T21:26:24.230287+0000","last_fullsized":"2023-12-08T21:26:24.230287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:24.230104+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:24.230104+0000","last_clean_scrub_stamp":"2023-12-08T21:26:24.230104+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:02:35.315437+0000","scrub_duration":0.0024408920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'75","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:25.600755+0000","last_change":"2023-12-08T21:26:25.600817+0000","last_active":"2023-12-08T21:26:25.600755+0000","last_peered":"2023-12-08T21:26:25.600755+0000","last_clean":"2023-12-08T21:26:25.600755+0000","last_became_active":"2023-12-08T20:55:04.507454+0000","last_became_peered":"2023-12-08T20:55:04.507454+0000","last_unstale":"2023-12-08T21:26:25.600755+0000","last_undegraded":"2023-12-08T21:26:25.600755+0000","last_fullsized":"2023-12-08T21:26:25.600755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'75","last_scrub_stamp":"2023-12-08T21:26:25.600621+0000","last_deep_scrub":"30'75","last_deep_scrub_stamp":"2023-12-08T21:26:25.600621+0000","last_clean_scrub_stamp":"2023-12-08T21:26:25.600621+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:30:14.904992+0000","scrub_duration":0.0057153899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'17","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.919895+0000","last_change":"2023-12-08T21:25:55.919895+0000","last_active":"2023-12-08T21:25:55.919895+0000","last_peered":"2023-12-08T21:25:55.919895+0000","last_clean":"2023-12-08T21:25:55.919895+0000","last_became_active":"2023-12-08T20:54:56.369974+0000","last_became_peered":"2023-12-08T20:54:56.369974+0000","last_unstale":"2023-12-08T21:25:55.919895+0000","last_undegraded":"2023-12-08T21:25:55.919895+0000","last_fullsized":"2023-12-08T21:25:55.919895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:25:55.919642+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:25:55.919642+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.919642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:26:40.855619+0000","scrub_duration":0.0027648270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'3","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.967650+0000","last_change":"2023-12-08T21:26:08.967650+0000","last_active":"2023-12-08T21:26:08.967650+0000","last_peered":"2023-12-08T21:26:08.967650+0000","last_clean":"2023-12-08T21:26:08.967650+0000","last_became_active":"2023-12-08T20:54:54.925022+0000","last_became_peered":"2023-12-08T20:54:54.925022+0000","last_unstale":"2023-12-08T21:26:08.967650+0000","last_undegraded":"2023-12-08T21:26:08.967650+0000","last_fullsized":"2023-12-08T21:26:08.967650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:26:08.967384+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:26:08.967384+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.967384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:00:44.981669+0000","scrub_duration":0.0030121089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'85","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:28.727979+0000","last_change":"2023-12-08T21:26:28.728039+0000","last_active":"2023-12-08T21:26:28.727979+0000","last_peered":"2023-12-08T21:26:28.727979+0000","last_clean":"2023-12-08T21:26:28.727979+0000","last_became_active":"2023-12-08T20:55:04.530774+0000","last_became_peered":"2023-12-08T20:55:04.530774+0000","last_unstale":"2023-12-08T21:26:28.727979+0000","last_undegraded":"2023-12-08T21:26:28.727979+0000","last_fullsized":"2023-12-08T21:26:28.727979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'85","last_scrub_stamp":"2023-12-08T21:26:28.727787+0000","last_deep_scrub":"30'85","last_deep_scrub_stamp":"2023-12-08T21:26:28.727787+0000","last_clean_scrub_stamp":"2023-12-08T21:26:28.727787+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:17:55.250169+0000","scrub_duration":0.0057543309999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:48.955617+0000","last_change":"2023-12-08T21:25:48.955617+0000","last_active":"2023-12-08T21:25:48.955617+0000","last_peered":"2023-12-08T21:25:48.955617+0000","last_clean":"2023-12-08T21:25:48.955617+0000","last_became_active":"2023-12-08T20:54:56.385090+0000","last_became_peered":"2023-12-08T20:54:56.385090+0000","last_unstale":"2023-12-08T21:25:48.955617+0000","last_undegraded":"2023-12-08T21:25:48.955617+0000","last_fullsized":"2023-12-08T21:25:48.955617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:25:48.955488+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:25:48.955488+0000","last_clean_scrub_stamp":"2023-12-08T21:25:48.955488+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:12:34.372718+0000","scrub_duration":0.001815419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'6","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:30.222450+0000","last_change":"2023-12-08T21:26:30.222503+0000","last_active":"2023-12-08T21:26:30.222450+0000","last_peered":"2023-12-08T21:26:30.222450+0000","last_clean":"2023-12-08T21:26:30.222450+0000","last_became_active":"2023-12-08T20:54:54.932121+0000","last_became_peered":"2023-12-08T20:54:54.932121+0000","last_unstale":"2023-12-08T21:26:30.222450+0000","last_undegraded":"2023-12-08T21:26:30.222450+0000","last_fullsized":"2023-12-08T21:26:30.222450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:26:30.222251+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:26:30.222251+0000","last_clean_scrub_stamp":"2023-12-08T21:26:30.222251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:37:07.100059+0000","scrub_duration":0.0031246490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'55","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:54.738342+0000","last_change":"2023-12-08T20:55:04.529911+0000","last_active":"2023-12-08T21:25:54.738342+0000","last_peered":"2023-12-08T21:25:54.738342+0000","last_clean":"2023-12-08T21:25:54.738342+0000","last_became_active":"2023-12-08T20:55:04.528698+0000","last_became_peered":"2023-12-08T20:55:04.528698+0000","last_unstale":"2023-12-08T21:25:54.738342+0000","last_undegraded":"2023-12-08T21:25:54.738342+0000","last_fullsized":"2023-12-08T21:25:54.738342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:33.929239+0000","last_change":"2023-12-08T21:26:33.929295+0000","last_active":"2023-12-08T21:26:33.929239+0000","last_peered":"2023-12-08T21:26:33.929239+0000","last_clean":"2023-12-08T21:26:33.929239+0000","last_became_active":"2023-12-08T20:54:56.412786+0000","last_became_peered":"2023-12-08T20:54:56.412786+0000","last_unstale":"2023-12-08T21:26:33.929239+0000","last_undegraded":"2023-12-08T21:26:33.929239+0000","last_fullsized":"2023-12-08T21:26:33.929239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:33.929031+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:33.929031+0000","last_clean_scrub_stamp":"2023-12-08T21:26:33.929031+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:39:06.696933+0000","scrub_duration":0.0034301499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'577","reported_seq":1196,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:05.340354+0000","last_change":"2023-12-08T21:26:05.340354+0000","last_active":"2023-12-08T21:26:05.340354+0000","last_peered":"2023-12-08T21:26:05.340354+0000","last_clean":"2023-12-08T21:26:05.340354+0000","last_became_active":"2023-12-08T20:54:54.922014+0000","last_became_peered":"2023-12-08T20:54:54.922014+0000","last_unstale":"2023-12-08T21:26:05.340354+0000","last_undegraded":"2023-12-08T21:26:05.340354+0000","last_fullsized":"2023-12-08T21:26:05.340354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'577","last_scrub_stamp":"2023-12-08T21:26:05.340116+0000","last_deep_scrub":"30'577","last_deep_scrub_stamp":"2023-12-08T21:26:05.340116+0000","last_clean_scrub_stamp":"2023-12-08T21:26:05.340116+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:25.924782+0000","scrub_duration":0.0067660819999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125475,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":574,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'71","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:32.720257+0000","last_change":"2023-12-08T21:26:32.720313+0000","last_active":"2023-12-08T21:26:32.720257+0000","last_peered":"2023-12-08T21:26:32.720257+0000","last_clean":"2023-12-08T21:26:32.720257+0000","last_became_active":"2023-12-08T20:55:04.508219+0000","last_became_peered":"2023-12-08T20:55:04.508219+0000","last_unstale":"2023-12-08T21:26:32.720257+0000","last_undegraded":"2023-12-08T21:26:32.720257+0000","last_fullsized":"2023-12-08T21:26:32.720257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'71","last_scrub_stamp":"2023-12-08T21:26:32.720060+0000","last_deep_scrub":"30'71","last_deep_scrub_stamp":"2023-12-08T21:26:32.720060+0000","last_clean_scrub_stamp":"2023-12-08T21:26:32.720060+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:08:42.229813+0000","scrub_duration":0.0047733469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'15","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.515080+0000","last_change":"2023-12-08T21:26:01.515080+0000","last_active":"2023-12-08T21:26:01.515080+0000","last_peered":"2023-12-08T21:26:01.515080+0000","last_clean":"2023-12-08T21:26:01.515080+0000","last_became_active":"2023-12-08T20:54:56.370121+0000","last_became_peered":"2023-12-08T20:54:56.370121+0000","last_unstale":"2023-12-08T21:26:01.515080+0000","last_undegraded":"2023-12-08T21:26:01.515080+0000","last_fullsized":"2023-12-08T21:26:01.515080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2023-12-08T21:26:01.514730+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2023-12-08T21:26:01.514730+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.514730+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:38:40.393317+0000","scrub_duration":0.0030279830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'5","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:19.277707+0000","last_change":"2023-12-08T21:26:19.277760+0000","last_active":"2023-12-08T21:26:19.277707+0000","last_peered":"2023-12-08T21:26:19.277707+0000","last_clean":"2023-12-08T21:26:19.277707+0000","last_became_active":"2023-12-08T20:54:54.927120+0000","last_became_peered":"2023-12-08T20:54:54.927120+0000","last_unstale":"2023-12-08T21:26:19.277707+0000","last_undegraded":"2023-12-08T21:26:19.277707+0000","last_fullsized":"2023-12-08T21:26:19.277707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:19.277517+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:19.277517+0000","last_clean_scrub_stamp":"2023-12-08T21:26:19.277517+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:23:11.851788+0000","scrub_duration":0.0053390110000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'100","reported_seq":130,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.118553+0000","last_change":"2023-12-08T20:55:04.546945+0000","last_active":"2023-12-08T21:25:24.118553+0000","last_peered":"2023-12-08T21:25:24.118553+0000","last_clean":"2023-12-08T21:25:24.118553+0000","last_became_active":"2023-12-08T20:55:04.546439+0000","last_became_peered":"2023-12-08T20:55:04.546439+0000","last_unstale":"2023-12-08T21:25:24.118553+0000","last_undegraded":"2023-12-08T21:25:24.118553+0000","last_fullsized":"2023-12-08T21:25:24.118553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'20","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.022881+0000","last_change":"2023-12-08T21:26:08.022881+0000","last_active":"2023-12-08T21:26:08.022881+0000","last_peered":"2023-12-08T21:26:08.022881+0000","last_clean":"2023-12-08T21:26:08.022881+0000","last_became_active":"2023-12-08T20:54:56.372205+0000","last_became_peered":"2023-12-08T20:54:56.372205+0000","last_unstale":"2023-12-08T21:26:08.022881+0000","last_undegraded":"2023-12-08T21:26:08.022881+0000","last_fullsized":"2023-12-08T21:26:08.022881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:08.022557+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:08.022557+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.022557+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:31:12.681949+0000","scrub_duration":0.0030864669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'2","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:22.310608+0000","last_change":"2023-12-08T21:26:22.310661+0000","last_active":"2023-12-08T21:26:22.310608+0000","last_peered":"2023-12-08T21:26:22.310608+0000","last_clean":"2023-12-08T21:26:22.310608+0000","last_became_active":"2023-12-08T20:54:54.929177+0000","last_became_peered":"2023-12-08T20:54:54.929177+0000","last_unstale":"2023-12-08T21:26:22.310608+0000","last_undegraded":"2023-12-08T21:26:22.310608+0000","last_fullsized":"2023-12-08T21:26:22.310608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-08T21:26:22.310416+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-08T21:26:22.310416+0000","last_clean_scrub_stamp":"2023-12-08T21:26:22.310416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:33:18.117971+0000","scrub_duration":0.0028091259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":200,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:50.676647+0000","last_change":"2023-12-08T21:25:50.676647+0000","last_active":"2023-12-08T21:25:50.676647+0000","last_peered":"2023-12-08T21:25:50.676647+0000","last_clean":"2023-12-08T21:25:50.676647+0000","last_became_active":"2023-12-08T20:54:16.147507+0000","last_became_peered":"2023-12-08T20:54:16.147507+0000","last_unstale":"2023-12-08T21:25:50.676647+0000","last_undegraded":"2023-12-08T21:25:50.676647+0000","last_fullsized":"2023-12-08T21:25:50.676647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-12-08T21:25:50.676240+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-12-08T21:25:50.676240+0000","last_clean_scrub_stamp":"2023-12-08T21:25:50.676240+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:06:52.271476+0000","scrub_duration":0.014230578000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'75","reported_seq":106,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:51.796017+0000","last_change":"2023-12-08T20:55:04.515531+0000","last_active":"2023-12-08T21:25:51.796017+0000","last_peered":"2023-12-08T21:25:51.796017+0000","last_clean":"2023-12-08T21:25:51.796017+0000","last_became_active":"2023-12-08T20:55:04.515200+0000","last_became_peered":"2023-12-08T20:55:04.515200+0000","last_unstale":"2023-12-08T21:25:51.796017+0000","last_undegraded":"2023-12-08T21:25:51.796017+0000","last_fullsized":"2023-12-08T21:25:51.796017+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'22","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:31.195729+0000","last_change":"2023-12-08T21:26:31.195849+0000","last_active":"2023-12-08T21:26:31.195729+0000","last_peered":"2023-12-08T21:26:31.195729+0000","last_clean":"2023-12-08T21:26:31.195729+0000","last_became_active":"2023-12-08T20:54:56.318408+0000","last_became_peered":"2023-12-08T20:54:56.318408+0000","last_unstale":"2023-12-08T21:26:31.195729+0000","last_undegraded":"2023-12-08T21:26:31.195729+0000","last_fullsized":"2023-12-08T21:26:31.195729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:31.195456+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:31.195456+0000","last_clean_scrub_stamp":"2023-12-08T21:26:31.195456+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:45:47.203860+0000","scrub_duration":0.0030641639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'4","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.531853+0000","last_change":"2023-12-08T21:25:59.531853+0000","last_active":"2023-12-08T21:25:59.531853+0000","last_peered":"2023-12-08T21:25:59.531853+0000","last_clean":"2023-12-08T21:25:59.531853+0000","last_became_active":"2023-12-08T20:54:54.925610+0000","last_became_peered":"2023-12-08T20:54:54.925610+0000","last_unstale":"2023-12-08T21:25:59.531853+0000","last_undegraded":"2023-12-08T21:25:59.531853+0000","last_fullsized":"2023-12-08T21:25:59.531853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:25:59.531609+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:25:59.531609+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.531609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:03:16.867575+0000","scrub_duration":0.0031837789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'78","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:34.080954+0000","last_change":"2023-12-08T20:55:04.523264+0000","last_active":"2023-12-08T21:25:34.080954+0000","last_peered":"2023-12-08T21:25:34.080954+0000","last_clean":"2023-12-08T21:25:34.080954+0000","last_became_active":"2023-12-08T20:55:04.522245+0000","last_became_peered":"2023-12-08T20:55:04.522245+0000","last_unstale":"2023-12-08T21:25:34.080954+0000","last_undegraded":"2023-12-08T21:25:34.080954+0000","last_fullsized":"2023-12-08T21:25:34.080954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:16.119078+0000","last_change":"2023-12-08T21:26:16.119078+0000","last_active":"2023-12-08T21:26:16.119078+0000","last_peered":"2023-12-08T21:26:16.119078+0000","last_clean":"2023-12-08T21:26:16.119078+0000","last_became_active":"2023-12-08T20:54:56.377762+0000","last_became_peered":"2023-12-08T20:54:56.377762+0000","last_unstale":"2023-12-08T21:26:16.119078+0000","last_undegraded":"2023-12-08T21:26:16.119078+0000","last_fullsized":"2023-12-08T21:26:16.119078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:16.118716+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:16.118716+0000","last_clean_scrub_stamp":"2023-12-08T21:26:16.118716+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:28:44.731995+0000","scrub_duration":0.0036787600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'5","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:11.909020+0000","last_change":"2023-12-08T21:26:11.909020+0000","last_active":"2023-12-08T21:26:11.909020+0000","last_peered":"2023-12-08T21:26:11.909020+0000","last_clean":"2023-12-08T21:26:11.909020+0000","last_became_active":"2023-12-08T20:54:54.935472+0000","last_became_peered":"2023-12-08T20:54:54.935472+0000","last_unstale":"2023-12-08T21:26:11.909020+0000","last_undegraded":"2023-12-08T21:26:11.909020+0000","last_fullsized":"2023-12-08T21:26:11.909020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:11.908761+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:11.908761+0000","last_clean_scrub_stamp":"2023-12-08T21:26:11.908761+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:47:38.208187+0000","scrub_duration":0.0077929649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'94","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.790957+0000","last_change":"2023-12-08T20:55:04.534674+0000","last_active":"2023-12-08T21:25:53.790957+0000","last_peered":"2023-12-08T21:25:53.790957+0000","last_clean":"2023-12-08T21:25:53.790957+0000","last_became_active":"2023-12-08T20:55:04.533305+0000","last_became_peered":"2023-12-08T20:55:04.533305+0000","last_unstale":"2023-12-08T21:25:53.790957+0000","last_undegraded":"2023-12-08T21:25:53.790957+0000","last_fullsized":"2023-12-08T21:25:53.790957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":6556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:52.008661+0000","last_change":"2023-12-08T21:25:52.008697+0000","last_active":"2023-12-08T21:25:52.008661+0000","last_peered":"2023-12-08T21:25:52.008661+0000","last_clean":"2023-12-08T21:25:52.008661+0000","last_became_active":"2023-12-08T20:54:56.379933+0000","last_became_peered":"2023-12-08T20:54:56.379933+0000","last_unstale":"2023-12-08T21:25:52.008661+0000","last_undegraded":"2023-12-08T21:25:52.008661+0000","last_fullsized":"2023-12-08T21:25:52.008661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:25:52.008566+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:25:52.008566+0000","last_clean_scrub_stamp":"2023-12-08T21:25:52.008566+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:27:19.773108+0000","scrub_duration":0.001762434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'5","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.012158+0000","last_change":"2023-12-08T21:26:06.012158+0000","last_active":"2023-12-08T21:26:06.012158+0000","last_peered":"2023-12-08T21:26:06.012158+0000","last_clean":"2023-12-08T21:26:06.012158+0000","last_became_active":"2023-12-08T20:54:54.982414+0000","last_became_peered":"2023-12-08T20:54:54.982414+0000","last_unstale":"2023-12-08T21:26:06.012158+0000","last_undegraded":"2023-12-08T21:26:06.012158+0000","last_fullsized":"2023-12-08T21:26:06.012158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:06.011895+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:06.011895+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.011895+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:09:55.169141+0000","scrub_duration":0.0062428880000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'68","reported_seq":98,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.088327+0000","last_change":"2023-12-08T20:55:04.515310+0000","last_active":"2023-12-08T21:25:24.088327+0000","last_peered":"2023-12-08T21:25:24.088327+0000","last_clean":"2023-12-08T21:25:24.088327+0000","last_became_active":"2023-12-08T20:55:04.514907+0000","last_became_peered":"2023-12-08T20:55:04.514907+0000","last_unstale":"2023-12-08T21:25:24.088327+0000","last_undegraded":"2023-12-08T21:25:24.088327+0000","last_fullsized":"2023-12-08T21:25:24.088327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.997391+0000","last_change":"2023-12-08T21:25:53.997391+0000","last_active":"2023-12-08T21:25:53.997391+0000","last_peered":"2023-12-08T21:25:53.997391+0000","last_clean":"2023-12-08T21:25:53.997391+0000","last_became_active":"2023-12-08T20:54:56.377430+0000","last_became_peered":"2023-12-08T20:54:56.377430+0000","last_unstale":"2023-12-08T21:25:53.997391+0000","last_undegraded":"2023-12-08T21:25:53.997391+0000","last_fullsized":"2023-12-08T21:25:53.997391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2023-12-08T21:25:53.997259+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2023-12-08T21:25:53.997259+0000","last_clean_scrub_stamp":"2023-12-08T21:25:53.997259+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:43:24.527309+0000","scrub_duration":0.0013451629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'4","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:02.148544+0000","last_change":"2023-12-08T21:26:02.148544+0000","last_active":"2023-12-08T21:26:02.148544+0000","last_peered":"2023-12-08T21:26:02.148544+0000","last_clean":"2023-12-08T21:26:02.148544+0000","last_became_active":"2023-12-08T20:54:54.926386+0000","last_became_peered":"2023-12-08T20:54:54.926386+0000","last_unstale":"2023-12-08T21:26:02.148544+0000","last_undegraded":"2023-12-08T21:26:02.148544+0000","last_fullsized":"2023-12-08T21:26:02.148544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:26:02.148292+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:26:02.148292+0000","last_clean_scrub_stamp":"2023-12-08T21:26:02.148292+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:05:49.099297+0000","scrub_duration":0.0069923229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'113","reported_seq":151,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:12.893870+0000","last_change":"2023-12-08T21:26:12.893986+0000","last_active":"2023-12-08T21:26:12.893870+0000","last_peered":"2023-12-08T21:26:12.893870+0000","last_clean":"2023-12-08T21:26:12.893870+0000","last_became_active":"2023-12-08T20:55:04.523074+0000","last_became_peered":"2023-12-08T20:55:04.523074+0000","last_unstale":"2023-12-08T21:26:12.893870+0000","last_undegraded":"2023-12-08T21:26:12.893870+0000","last_fullsized":"2023-12-08T21:26:12.893870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'113","last_scrub_stamp":"2023-12-08T21:26:12.893631+0000","last_deep_scrub":"30'113","last_deep_scrub_stamp":"2023-12-08T21:26:12.893631+0000","last_clean_scrub_stamp":"2023-12-08T21:26:12.893631+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:22:11.324216+0000","scrub_duration":0.0069858769999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":11577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:10.138076+0000","last_change":"2023-12-08T21:26:10.138136+0000","last_active":"2023-12-08T21:26:10.138076+0000","last_peered":"2023-12-08T21:26:10.138076+0000","last_clean":"2023-12-08T21:26:10.138076+0000","last_became_active":"2023-12-08T20:54:56.371132+0000","last_became_peered":"2023-12-08T20:54:56.371132+0000","last_unstale":"2023-12-08T21:26:10.138076+0000","last_undegraded":"2023-12-08T21:26:10.138076+0000","last_fullsized":"2023-12-08T21:26:10.138076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:10.137863+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:10.137863+0000","last_clean_scrub_stamp":"2023-12-08T21:26:10.137863+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:21.181423+0000","scrub_duration":0.0030374600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'18","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:58.116724+0000","last_change":"2023-12-08T21:25:58.116788+0000","last_active":"2023-12-08T21:25:58.116724+0000","last_peered":"2023-12-08T21:25:58.116724+0000","last_clean":"2023-12-08T21:25:58.116724+0000","last_became_active":"2023-12-08T20:54:54.984661+0000","last_became_peered":"2023-12-08T20:54:54.984661+0000","last_unstale":"2023-12-08T21:25:58.116724+0000","last_undegraded":"2023-12-08T21:25:58.116724+0000","last_fullsized":"2023-12-08T21:25:58.116724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:25:58.116543+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:25:58.116543+0000","last_clean_scrub_stamp":"2023-12-08T21:25:58.116543+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:16.122167+0000","scrub_duration":0.0098436089999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'88","reported_seq":117,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.791155+0000","last_change":"2023-12-08T20:55:04.543349+0000","last_active":"2023-12-08T21:25:53.791155+0000","last_peered":"2023-12-08T21:25:53.791155+0000","last_clean":"2023-12-08T21:25:53.791155+0000","last_became_active":"2023-12-08T20:55:04.541074+0000","last_became_peered":"2023-12-08T20:55:04.541074+0000","last_unstale":"2023-12-08T21:25:53.791155+0000","last_undegraded":"2023-12-08T21:25:53.791155+0000","last_fullsized":"2023-12-08T21:25:53.791155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'20","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.783826+0000","last_change":"2023-12-08T21:26:01.783879+0000","last_active":"2023-12-08T21:26:01.783826+0000","last_peered":"2023-12-08T21:26:01.783826+0000","last_clean":"2023-12-08T21:26:01.783826+0000","last_became_active":"2023-12-08T20:54:56.413023+0000","last_became_peered":"2023-12-08T20:54:56.413023+0000","last_unstale":"2023-12-08T21:26:01.783826+0000","last_undegraded":"2023-12-08T21:26:01.783826+0000","last_fullsized":"2023-12-08T21:26:01.783826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:01.783626+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:01.783626+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.783626+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:22.368293+0000","scrub_duration":0.0030916820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'1","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:09.105683+0000","last_change":"2023-12-08T21:26:09.105734+0000","last_active":"2023-12-08T21:26:09.105683+0000","last_peered":"2023-12-08T21:26:09.105683+0000","last_clean":"2023-12-08T21:26:09.105683+0000","last_became_active":"2023-12-08T20:54:54.928543+0000","last_became_peered":"2023-12-08T20:54:54.928543+0000","last_unstale":"2023-12-08T21:26:09.105683+0000","last_undegraded":"2023-12-08T21:26:09.105683+0000","last_fullsized":"2023-12-08T21:26:09.105683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-08T21:26:09.105497+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-08T21:26:09.105497+0000","last_clean_scrub_stamp":"2023-12-08T21:26:09.105497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:15:16.777211+0000","scrub_duration":0.0026113529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'85","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.791199+0000","last_change":"2023-12-08T20:55:04.540347+0000","last_active":"2023-12-08T21:25:53.791199+0000","last_peered":"2023-12-08T21:25:53.791199+0000","last_clean":"2023-12-08T21:25:53.791199+0000","last_became_active":"2023-12-08T20:55:04.535002+0000","last_became_peered":"2023-12-08T20:55:04.535002+0000","last_unstale":"2023-12-08T21:25:53.791199+0000","last_undegraded":"2023-12-08T21:25:53.791199+0000","last_fullsized":"2023-12-08T21:25:53.791199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'40","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526660+0000","last_change":"2023-12-08T20:56:00.382392+0000","last_active":"2023-12-08T21:25:37.526660+0000","last_peered":"2023-12-08T21:25:37.526660+0000","last_clean":"2023-12-08T21:25:37.526660+0000","last_became_active":"2023-12-08T20:56:00.381771+0000","last_became_peered":"2023-12-08T20:56:00.381771+0000","last_unstale":"2023-12-08T21:25:37.526660+0000","last_undegraded":"2023-12-08T21:25:37.526660+0000","last_fullsized":"2023-12-08T21:25:37.526660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'5","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:26.254290+0000","last_change":"2023-12-08T21:26:26.254343+0000","last_active":"2023-12-08T21:26:26.254290+0000","last_peered":"2023-12-08T21:26:26.254290+0000","last_clean":"2023-12-08T21:26:26.254290+0000","last_became_active":"2023-12-08T20:54:54.928065+0000","last_became_peered":"2023-12-08T20:54:54.928065+0000","last_unstale":"2023-12-08T21:26:26.254290+0000","last_undegraded":"2023-12-08T21:26:26.254290+0000","last_fullsized":"2023-12-08T21:26:26.254290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:26.254093+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:26.254093+0000","last_clean_scrub_stamp":"2023-12-08T21:26:26.254093+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:53:12.765582+0000","scrub_duration":0.0032426040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'59","reported_seq":88,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.834692+0000","last_change":"2023-12-08T20:55:04.520698+0000","last_active":"2023-12-08T21:25:37.834692+0000","last_peered":"2023-12-08T21:25:37.834692+0000","last_clean":"2023-12-08T21:25:37.834692+0000","last_became_active":"2023-12-08T20:55:04.516783+0000","last_became_peered":"2023-12-08T20:55:04.516783+0000","last_unstale":"2023-12-08T21:25:37.834692+0000","last_undegraded":"2023-12-08T21:25:37.834692+0000","last_fullsized":"2023-12-08T21:25:37.834692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:24.559076+0000","last_change":"2023-12-08T21:26:24.559130+0000","last_active":"2023-12-08T21:26:24.559076+0000","last_peered":"2023-12-08T21:26:24.559076+0000","last_clean":"2023-12-08T21:26:24.559076+0000","last_became_active":"2023-12-08T20:54:56.330346+0000","last_became_peered":"2023-12-08T20:54:56.330346+0000","last_unstale":"2023-12-08T21:26:24.559076+0000","last_undegraded":"2023-12-08T21:26:24.559076+0000","last_fullsized":"2023-12-08T21:26:24.559076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:24.558877+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:24.558877+0000","last_clean_scrub_stamp":"2023-12-08T21:26:24.558877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:01:23.818334+0000","scrub_duration":0.002404836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'6","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:58.290149+0000","last_change":"2023-12-08T21:25:58.290260+0000","last_active":"2023-12-08T21:25:58.290149+0000","last_peered":"2023-12-08T21:25:58.290149+0000","last_clean":"2023-12-08T21:25:58.290149+0000","last_became_active":"2023-12-08T20:54:54.926435+0000","last_became_peered":"2023-12-08T20:54:54.926435+0000","last_unstale":"2023-12-08T21:25:58.290149+0000","last_undegraded":"2023-12-08T21:25:58.290149+0000","last_fullsized":"2023-12-08T21:25:58.290149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:25:58.289922+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:25:58.289922+0000","last_clean_scrub_stamp":"2023-12-08T21:25:58.289922+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:28:27.891672+0000","scrub_duration":0.0072454040000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'79","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:51.796138+0000","last_change":"2023-12-08T20:55:04.534630+0000","last_active":"2023-12-08T21:25:51.796138+0000","last_peered":"2023-12-08T21:25:51.796138+0000","last_clean":"2023-12-08T21:25:51.796138+0000","last_became_active":"2023-12-08T20:55:04.534289+0000","last_became_peered":"2023-12-08T20:55:04.534289+0000","last_unstale":"2023-12-08T21:25:51.796138+0000","last_undegraded":"2023-12-08T21:25:51.796138+0000","last_fullsized":"2023-12-08T21:25:51.796138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.093643+0000","last_change":"2023-12-08T21:25:55.093643+0000","last_active":"2023-12-08T21:25:55.093643+0000","last_peered":"2023-12-08T21:25:55.093643+0000","last_clean":"2023-12-08T21:25:55.093643+0000","last_became_active":"2023-12-08T20:54:56.375922+0000","last_became_peered":"2023-12-08T20:54:56.375922+0000","last_unstale":"2023-12-08T21:25:55.093643+0000","last_undegraded":"2023-12-08T21:25:55.093643+0000","last_fullsized":"2023-12-08T21:25:55.093643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:25:55.093529+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:25:55.093529+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.093529+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:56:51.759799+0000","scrub_duration":0.0031557159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'893","reported_seq":936,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:52.042951+0000","last_change":"2023-12-08T21:25:52.042995+0000","last_active":"2023-12-08T21:25:52.042951+0000","last_peered":"2023-12-08T21:25:52.042951+0000","last_clean":"2023-12-08T21:25:52.042951+0000","last_became_active":"2023-12-08T20:54:54.977999+0000","last_became_peered":"2023-12-08T20:54:54.977999+0000","last_unstale":"2023-12-08T21:25:52.042951+0000","last_undegraded":"2023-12-08T21:25:52.042951+0000","last_fullsized":"2023-12-08T21:25:52.042951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'893","last_scrub_stamp":"2023-12-08T21:25:52.042834+0000","last_deep_scrub":"30'893","last_deep_scrub_stamp":"2023-12-08T21:25:52.042834+0000","last_clean_scrub_stamp":"2023-12-08T21:25:52.042834+0000","objects_scrubbed":4,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:13:57.138876+0000","scrub_duration":0.033957383000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":887,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'80","reported_seq":117,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:31.050828+0000","last_change":"2023-12-08T21:26:31.050884+0000","last_active":"2023-12-08T21:26:31.050828+0000","last_peered":"2023-12-08T21:26:31.050828+0000","last_clean":"2023-12-08T21:26:31.050828+0000","last_became_active":"2023-12-08T20:55:04.522190+0000","last_became_peered":"2023-12-08T20:55:04.522190+0000","last_unstale":"2023-12-08T21:26:31.050828+0000","last_undegraded":"2023-12-08T21:26:31.050828+0000","last_fullsized":"2023-12-08T21:26:31.050828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'80","last_scrub_stamp":"2023-12-08T21:26:31.050628+0000","last_deep_scrub":"30'80","last_deep_scrub_stamp":"2023-12-08T21:26:31.050628+0000","last_clean_scrub_stamp":"2023-12-08T21:26:31.050628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:24:13.040770+0000","scrub_duration":0.0071926489999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:11.108977+0000","last_change":"2023-12-08T21:26:11.109034+0000","last_active":"2023-12-08T21:26:11.108977+0000","last_peered":"2023-12-08T21:26:11.108977+0000","last_clean":"2023-12-08T21:26:11.108977+0000","last_became_active":"2023-12-08T20:54:56.383561+0000","last_became_peered":"2023-12-08T20:54:56.383561+0000","last_unstale":"2023-12-08T21:26:11.108977+0000","last_undegraded":"2023-12-08T21:26:11.108977+0000","last_fullsized":"2023-12-08T21:26:11.108977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:11.108774+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:11.108774+0000","last_clean_scrub_stamp":"2023-12-08T21:26:11.108774+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:26:31.478244+0000","scrub_duration":0.0032197039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'407","reported_seq":450,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.289869+0000","last_change":"2023-12-08T21:26:04.289869+0000","last_active":"2023-12-08T21:26:04.289869+0000","last_peered":"2023-12-08T21:26:04.289869+0000","last_clean":"2023-12-08T21:26:04.289869+0000","last_became_active":"2023-12-08T20:54:54.980023+0000","last_became_peered":"2023-12-08T20:54:54.980023+0000","last_unstale":"2023-12-08T21:26:04.289869+0000","last_undegraded":"2023-12-08T21:26:04.289869+0000","last_fullsized":"2023-12-08T21:26:04.289869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'407","last_scrub_stamp":"2023-12-08T21:26:04.289595+0000","last_deep_scrub":"30'407","last_deep_scrub_stamp":"2023-12-08T21:26:04.289595+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.289595+0000","objects_scrubbed":2,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:14:17.977538+0000","scrub_duration":0.006696993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'116","reported_seq":145,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.079548+0000","last_change":"2023-12-08T20:55:04.523658+0000","last_active":"2023-12-08T21:25:24.079548+0000","last_peered":"2023-12-08T21:25:24.079548+0000","last_clean":"2023-12-08T21:25:24.079548+0000","last_became_active":"2023-12-08T20:55:04.522325+0000","last_became_peered":"2023-12-08T20:55:04.522325+0000","last_unstale":"2023-12-08T21:25:24.079548+0000","last_undegraded":"2023-12-08T21:25:24.079548+0000","last_fullsized":"2023-12-08T21:25:24.079548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":12653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'29","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.923377+0000","last_change":"2023-12-08T21:25:59.923377+0000","last_active":"2023-12-08T21:25:59.923377+0000","last_peered":"2023-12-08T21:25:59.923377+0000","last_clean":"2023-12-08T21:25:59.923377+0000","last_became_active":"2023-12-08T20:54:56.409539+0000","last_became_peered":"2023-12-08T20:54:56.409539+0000","last_unstale":"2023-12-08T21:25:59.923377+0000","last_undegraded":"2023-12-08T21:25:59.923377+0000","last_fullsized":"2023-12-08T21:25:59.923377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-12-08T21:25:59.923139+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-12-08T21:25:59.923139+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.923139+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:20:00.596635+0000","scrub_duration":0.0048008690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'3","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.174774+0000","last_change":"2023-12-08T21:26:01.174774+0000","last_active":"2023-12-08T21:26:01.174774+0000","last_peered":"2023-12-08T21:26:01.174774+0000","last_clean":"2023-12-08T21:26:01.174774+0000","last_became_active":"2023-12-08T20:54:54.935889+0000","last_became_peered":"2023-12-08T20:54:54.935889+0000","last_unstale":"2023-12-08T21:26:01.174774+0000","last_undegraded":"2023-12-08T21:26:01.174774+0000","last_fullsized":"2023-12-08T21:26:01.174774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:26:01.174531+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:26:01.174531+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.174531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:17:02.143286+0000","scrub_duration":0.0027935500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'68","reported_seq":94,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:48.796389+0000","last_change":"2023-12-08T20:56:00.560908+0000","last_active":"2023-12-08T21:25:48.796389+0000","last_peered":"2023-12-08T21:25:48.796389+0000","last_clean":"2023-12-08T21:25:48.796389+0000","last_became_active":"2023-12-08T20:56:00.560282+0000","last_became_peered":"2023-12-08T20:56:00.560282+0000","last_unstale":"2023-12-08T21:25:48.796389+0000","last_undegraded":"2023-12-08T21:25:48.796389+0000","last_fullsized":"2023-12-08T21:25:48.796389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":7515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:18.920419+0000","last_change":"2023-12-08T21:26:18.920419+0000","last_active":"2023-12-08T21:26:18.920419+0000","last_peered":"2023-12-08T21:26:18.920419+0000","last_clean":"2023-12-08T21:26:18.920419+0000","last_became_active":"2023-12-08T20:54:56.369709+0000","last_became_peered":"2023-12-08T20:54:56.369709+0000","last_unstale":"2023-12-08T21:26:18.920419+0000","last_undegraded":"2023-12-08T21:26:18.920419+0000","last_fullsized":"2023-12-08T21:26:18.920419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:18.920028+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:18.920028+0000","last_clean_scrub_stamp":"2023-12-08T21:26:18.920028+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:27:46.684571+0000","scrub_duration":0.0029217309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'3","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:54.755396+0000","last_change":"2023-12-08T21:25:54.755396+0000","last_active":"2023-12-08T21:25:54.755396+0000","last_peered":"2023-12-08T21:25:54.755396+0000","last_clean":"2023-12-08T21:25:54.755396+0000","last_became_active":"2023-12-08T20:54:54.979751+0000","last_became_peered":"2023-12-08T20:54:54.979751+0000","last_unstale":"2023-12-08T21:25:54.755396+0000","last_undegraded":"2023-12-08T21:25:54.755396+0000","last_fullsized":"2023-12-08T21:25:54.755396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:25:54.755239+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:25:54.755239+0000","last_clean_scrub_stamp":"2023-12-08T21:25:54.755239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:03:48.852944+0000","scrub_duration":0.002413353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'79","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:27.046109+0000","last_change":"2023-12-08T20:55:04.513429+0000","last_active":"2023-12-08T21:25:27.046109+0000","last_peered":"2023-12-08T21:25:27.046109+0000","last_clean":"2023-12-08T21:25:27.046109+0000","last_became_active":"2023-12-08T20:55:04.511405+0000","last_became_peered":"2023-12-08T20:55:04.511405+0000","last_unstale":"2023-12-08T21:25:27.046109+0000","last_undegraded":"2023-12-08T21:25:27.046109+0000","last_fullsized":"2023-12-08T21:25:27.046109+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:24.006292+0000","last_change":"2023-12-08T21:26:24.006328+0000","last_active":"2023-12-08T21:26:24.006292+0000","last_peered":"2023-12-08T21:26:24.006292+0000","last_clean":"2023-12-08T21:26:24.006292+0000","last_became_active":"2023-12-08T20:55:04.536497+0000","last_became_peered":"2023-12-08T20:55:04.536497+0000","last_unstale":"2023-12-08T21:26:24.006292+0000","last_undegraded":"2023-12-08T21:26:24.006292+0000","last_fullsized":"2023-12-08T21:26:24.006292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'65","last_scrub_stamp":"2023-12-08T21:26:24.006179+0000","last_deep_scrub":"30'65","last_deep_scrub_stamp":"2023-12-08T21:26:24.006179+0000","last_clean_scrub_stamp":"2023-12-08T21:26:24.006179+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:37:20.579091+0000","scrub_duration":0.0039742140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:18.981955+0000","last_change":"2023-12-08T21:26:18.981955+0000","last_active":"2023-12-08T21:26:18.981955+0000","last_peered":"2023-12-08T21:26:18.981955+0000","last_clean":"2023-12-08T21:26:18.981955+0000","last_became_active":"2023-12-08T20:54:56.317895+0000","last_became_peered":"2023-12-08T20:54:56.317895+0000","last_unstale":"2023-12-08T21:26:18.981955+0000","last_undegraded":"2023-12-08T21:26:18.981955+0000","last_fullsized":"2023-12-08T21:26:18.981955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:18.981665+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:18.981665+0000","last_clean_scrub_stamp":"2023-12-08T21:26:18.981665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:15:26.653378+0000","scrub_duration":0.0031400199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'4","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.214946+0000","last_change":"2023-12-08T21:26:17.214946+0000","last_active":"2023-12-08T21:26:17.214946+0000","last_peered":"2023-12-08T21:26:17.214946+0000","last_clean":"2023-12-08T21:26:17.214946+0000","last_became_active":"2023-12-08T20:54:54.935578+0000","last_became_peered":"2023-12-08T20:54:54.935578+0000","last_unstale":"2023-12-08T21:26:17.214946+0000","last_undegraded":"2023-12-08T21:26:17.214946+0000","last_fullsized":"2023-12-08T21:26:17.214946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:26:17.214737+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:26:17.214737+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.214737+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:14:28.047119+0000","scrub_duration":0.0019532619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'80","reported_seq":111,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:51.796206+0000","last_change":"2023-12-08T20:55:04.535940+0000","last_active":"2023-12-08T21:25:51.796206+0000","last_peered":"2023-12-08T21:25:51.796206+0000","last_clean":"2023-12-08T21:25:51.796206+0000","last_became_active":"2023-12-08T20:55:04.535525+0000","last_became_peered":"2023-12-08T20:55:04.535525+0000","last_unstale":"2023-12-08T21:25:51.796206+0000","last_undegraded":"2023-12-08T21:25:51.796206+0000","last_fullsized":"2023-12-08T21:25:51.796206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":11364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:30.927893+0000","last_change":"2023-12-08T21:26:30.927947+0000","last_active":"2023-12-08T21:26:30.927893+0000","last_peered":"2023-12-08T21:26:30.927893+0000","last_clean":"2023-12-08T21:26:30.927893+0000","last_became_active":"2023-12-08T20:54:56.412133+0000","last_became_peered":"2023-12-08T20:54:56.412133+0000","last_unstale":"2023-12-08T21:26:30.927893+0000","last_undegraded":"2023-12-08T21:26:30.927893+0000","last_fullsized":"2023-12-08T21:26:30.927893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:30.927680+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:30.927680+0000","last_clean_scrub_stamp":"2023-12-08T21:26:30.927680+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:10:28.638287+0000","scrub_duration":0.003176187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'3","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:58.532461+0000","last_change":"2023-12-08T21:25:58.532461+0000","last_active":"2023-12-08T21:25:58.532461+0000","last_peered":"2023-12-08T21:25:58.532461+0000","last_clean":"2023-12-08T21:25:58.532461+0000","last_became_active":"2023-12-08T20:54:54.926804+0000","last_became_peered":"2023-12-08T20:54:54.926804+0000","last_unstale":"2023-12-08T21:25:58.532461+0000","last_undegraded":"2023-12-08T21:25:58.532461+0000","last_fullsized":"2023-12-08T21:25:58.532461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:25:58.532282+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:25:58.532282+0000","last_clean_scrub_stamp":"2023-12-08T21:25:58.532282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:57:27.213154+0000","scrub_duration":0.0026443899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'616","reported_seq":658,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:16.216138+0000","last_change":"2023-12-08T21:26:16.216200+0000","last_active":"2023-12-08T21:26:16.216138+0000","last_peered":"2023-12-08T21:26:16.216138+0000","last_clean":"2023-12-08T21:26:16.216138+0000","last_became_active":"2023-12-08T20:54:54.930324+0000","last_became_peered":"2023-12-08T20:54:54.930324+0000","last_unstale":"2023-12-08T21:26:16.216138+0000","last_undegraded":"2023-12-08T21:26:16.216138+0000","last_fullsized":"2023-12-08T21:26:16.216138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'616","last_scrub_stamp":"2023-12-08T21:26:16.215928+0000","last_deep_scrub":"30'616","last_deep_scrub_stamp":"2023-12-08T21:26:16.215928+0000","last_clean_scrub_stamp":"2023-12-08T21:26:16.215928+0000","objects_scrubbed":1,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:45:43.919045+0000","scrub_duration":0.033128956000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.998145+0000","last_change":"2023-12-08T21:26:08.998185+0000","last_active":"2023-12-08T21:26:08.998145+0000","last_peered":"2023-12-08T21:26:08.998145+0000","last_clean":"2023-12-08T21:26:08.998145+0000","last_became_active":"2023-12-08T20:54:56.383467+0000","last_became_peered":"2023-12-08T20:54:56.383467+0000","last_unstale":"2023-12-08T21:26:08.998145+0000","last_undegraded":"2023-12-08T21:26:08.998145+0000","last_fullsized":"2023-12-08T21:26:08.998145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:08.998020+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:08.998020+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.998020+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:43:06.448077+0000","scrub_duration":0.0029810240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'50","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:07.041841+0000","last_change":"2023-12-08T20:55:04.541743+0000","last_active":"2023-12-08T21:25:07.041841+0000","last_peered":"2023-12-08T21:25:07.041841+0000","last_clean":"2023-12-08T21:25:07.041841+0000","last_became_active":"2023-12-08T20:55:04.536537+0000","last_became_peered":"2023-12-08T20:55:04.536537+0000","last_unstale":"2023-12-08T21:25:07.041841+0000","last_undegraded":"2023-12-08T21:25:07.041841+0000","last_fullsized":"2023-12-08T21:25:07.041841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'554","reported_seq":596,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:10.943632+0000","last_change":"2023-12-08T21:26:10.943758+0000","last_active":"2023-12-08T21:26:10.943632+0000","last_peered":"2023-12-08T21:26:10.943632+0000","last_clean":"2023-12-08T21:26:10.943632+0000","last_became_active":"2023-12-08T20:54:54.925229+0000","last_became_peered":"2023-12-08T20:54:54.925229+0000","last_unstale":"2023-12-08T21:26:10.943632+0000","last_undegraded":"2023-12-08T21:26:10.943632+0000","last_fullsized":"2023-12-08T21:26:10.943632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'554","last_scrub_stamp":"2023-12-08T21:26:10.943330+0000","last_deep_scrub":"30'554","last_deep_scrub_stamp":"2023-12-08T21:26:10.943330+0000","last_clean_scrub_stamp":"2023-12-08T21:26:10.943330+0000","objects_scrubbed":1,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:10:30.749700+0000","scrub_duration":0.033797185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'20","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:00.754130+0000","last_change":"2023-12-08T21:26:00.754182+0000","last_active":"2023-12-08T21:26:00.754130+0000","last_peered":"2023-12-08T21:26:00.754130+0000","last_clean":"2023-12-08T21:26:00.754130+0000","last_became_active":"2023-12-08T20:54:56.403996+0000","last_became_peered":"2023-12-08T20:54:56.403996+0000","last_unstale":"2023-12-08T21:26:00.754130+0000","last_undegraded":"2023-12-08T21:26:00.754130+0000","last_fullsized":"2023-12-08T21:26:00.754130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:00.753925+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:00.753925+0000","last_clean_scrub_stamp":"2023-12-08T21:26:00.753925+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:14:14.441869+0000","scrub_duration":0.003347722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'97","reported_seq":133,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.316666+0000","last_change":"2023-12-08T21:26:14.316722+0000","last_active":"2023-12-08T21:26:14.316666+0000","last_peered":"2023-12-08T21:26:14.316666+0000","last_clean":"2023-12-08T21:26:14.316666+0000","last_became_active":"2023-12-08T20:55:04.523137+0000","last_became_peered":"2023-12-08T20:55:04.523137+0000","last_unstale":"2023-12-08T21:26:14.316666+0000","last_undegraded":"2023-12-08T21:26:14.316666+0000","last_fullsized":"2023-12-08T21:26:14.316666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'97","last_scrub_stamp":"2023-12-08T21:26:14.316453+0000","last_deep_scrub":"30'97","last_deep_scrub_stamp":"2023-12-08T21:26:14.316453+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.316453+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:34:50.101165+0000","scrub_duration":0.0078096950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"30'37","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.876227+0000","last_change":"2023-12-08T21:26:08.876227+0000","last_active":"2023-12-08T21:26:08.876227+0000","last_peered":"2023-12-08T21:26:08.876227+0000","last_clean":"2023-12-08T21:26:08.876227+0000","last_became_active":"2023-12-08T20:54:56.373080+0000","last_became_peered":"2023-12-08T20:54:56.373080+0000","last_unstale":"2023-12-08T21:26:08.876227+0000","last_undegraded":"2023-12-08T21:26:08.876227+0000","last_fullsized":"2023-12-08T21:26:08.876227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'37","last_scrub_stamp":"2023-12-08T21:26:08.875831+0000","last_deep_scrub":"30'37","last_deep_scrub_stamp":"2023-12-08T21:26:08.875831+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.875831+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:35:17.879073+0000","scrub_duration":0.003168078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'27","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:07.352563+0000","last_change":"2023-12-08T21:26:07.352563+0000","last_active":"2023-12-08T21:26:07.352563+0000","last_peered":"2023-12-08T21:26:07.352563+0000","last_clean":"2023-12-08T21:26:07.352563+0000","last_became_active":"2023-12-08T20:54:56.378154+0000","last_became_peered":"2023-12-08T20:54:56.378154+0000","last_unstale":"2023-12-08T21:26:07.352563+0000","last_undegraded":"2023-12-08T21:26:07.352563+0000","last_fullsized":"2023-12-08T21:26:07.352563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-12-08T21:26:07.352305+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-12-08T21:26:07.352305+0000","last_clean_scrub_stamp":"2023-12-08T21:26:07.352305+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:43:19.113869+0000","scrub_duration":0.0029496069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'26","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:02.075761+0000","last_change":"2023-12-08T21:26:02.075761+0000","last_active":"2023-12-08T21:26:02.075761+0000","last_peered":"2023-12-08T21:26:02.075761+0000","last_clean":"2023-12-08T21:26:02.075761+0000","last_became_active":"2023-12-08T20:54:56.409863+0000","last_became_peered":"2023-12-08T20:54:56.409863+0000","last_unstale":"2023-12-08T21:26:02.075761+0000","last_undegraded":"2023-12-08T21:26:02.075761+0000","last_fullsized":"2023-12-08T21:26:02.075761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:02.075490+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:02.075490+0000","last_clean_scrub_stamp":"2023-12-08T21:26:02.075490+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:56:07.407825+0000","scrub_duration":0.0028810989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:19.853547+0000","last_change":"2023-12-08T21:26:19.853599+0000","last_active":"2023-12-08T21:26:19.853547+0000","last_peered":"2023-12-08T21:26:19.853547+0000","last_clean":"2023-12-08T21:26:19.853547+0000","last_became_active":"2023-12-08T20:54:56.408205+0000","last_became_peered":"2023-12-08T20:54:56.408205+0000","last_unstale":"2023-12-08T21:26:19.853547+0000","last_undegraded":"2023-12-08T21:26:19.853547+0000","last_fullsized":"2023-12-08T21:26:19.853547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-12-08T21:26:19.853354+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-12-08T21:26:19.853354+0000","last_clean_scrub_stamp":"2023-12-08T21:26:19.853354+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:40.279876+0000","scrub_duration":0.0040195689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'16","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.448817+0000","last_change":"2023-12-08T21:26:17.448848+0000","last_active":"2023-12-08T21:26:17.448817+0000","last_peered":"2023-12-08T21:26:17.448817+0000","last_clean":"2023-12-08T21:26:17.448817+0000","last_became_active":"2023-12-08T20:54:56.386344+0000","last_became_peered":"2023-12-08T20:54:56.386344+0000","last_unstale":"2023-12-08T21:26:17.448817+0000","last_undegraded":"2023-12-08T21:26:17.448817+0000","last_fullsized":"2023-12-08T21:26:17.448817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-12-08T21:26:17.448692+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-12-08T21:26:17.448692+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.448692+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:27:35.548731+0000","scrub_duration":0.0025673380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.337483+0000","last_change":"2023-12-08T21:26:14.337534+0000","last_active":"2023-12-08T21:26:14.337483+0000","last_peered":"2023-12-08T21:26:14.337483+0000","last_clean":"2023-12-08T21:26:14.337483+0000","last_became_active":"2023-12-08T20:54:56.366967+0000","last_became_peered":"2023-12-08T20:54:56.366967+0000","last_unstale":"2023-12-08T21:26:14.337483+0000","last_undegraded":"2023-12-08T21:26:14.337483+0000","last_fullsized":"2023-12-08T21:26:14.337483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:14.337293+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:14.337293+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.337293+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:11:34.657650+0000","scrub_duration":0.0035456820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'32","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:23.915395+0000","last_change":"2023-12-08T21:26:23.915503+0000","last_active":"2023-12-08T21:26:23.915395+0000","last_peered":"2023-12-08T21:26:23.915395+0000","last_clean":"2023-12-08T21:26:23.915395+0000","last_became_active":"2023-12-08T20:54:56.371954+0000","last_became_peered":"2023-12-08T20:54:56.371954+0000","last_unstale":"2023-12-08T21:26:23.915395+0000","last_undegraded":"2023-12-08T21:26:23.915395+0000","last_fullsized":"2023-12-08T21:26:23.915395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:23.915162+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:23.915162+0000","last_clean_scrub_stamp":"2023-12-08T21:26:23.915162+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:45:34.269396+0000","scrub_duration":0.0022833179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:03.870345+0000","last_change":"2023-12-08T21:26:03.870397+0000","last_active":"2023-12-08T21:26:03.870345+0000","last_peered":"2023-12-08T21:26:03.870345+0000","last_clean":"2023-12-08T21:26:03.870345+0000","last_became_active":"2023-12-08T20:54:56.409462+0000","last_became_peered":"2023-12-08T20:54:56.409462+0000","last_unstale":"2023-12-08T21:26:03.870345+0000","last_undegraded":"2023-12-08T21:26:03.870345+0000","last_fullsized":"2023-12-08T21:26:03.870345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:03.870148+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:03.870148+0000","last_clean_scrub_stamp":"2023-12-08T21:26:03.870148+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:04:32.166396+0000","scrub_duration":0.0033986340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'18","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.202058+0000","last_change":"2023-12-08T21:25:59.202112+0000","last_active":"2023-12-08T21:25:59.202058+0000","last_peered":"2023-12-08T21:25:59.202058+0000","last_clean":"2023-12-08T21:25:59.202058+0000","last_became_active":"2023-12-08T20:54:56.415176+0000","last_became_peered":"2023-12-08T20:54:56.415176+0000","last_unstale":"2023-12-08T21:25:59.202058+0000","last_undegraded":"2023-12-08T21:25:59.202058+0000","last_fullsized":"2023-12-08T21:25:59.202058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:25:59.201838+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:25:59.201838+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.201838+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:55:02.593105+0000","scrub_duration":0.0031189780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'31","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.841528+0000","last_change":"2023-12-08T21:26:13.841528+0000","last_active":"2023-12-08T21:26:13.841528+0000","last_peered":"2023-12-08T21:26:13.841528+0000","last_clean":"2023-12-08T21:26:13.841528+0000","last_became_active":"2023-12-08T20:54:56.400980+0000","last_became_peered":"2023-12-08T20:54:56.400980+0000","last_unstale":"2023-12-08T21:26:13.841528+0000","last_undegraded":"2023-12-08T21:26:13.841528+0000","last_fullsized":"2023-12-08T21:26:13.841528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-12-08T21:26:13.841252+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-12-08T21:26:13.841252+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.841252+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:55:29.119051+0000","scrub_duration":0.0036066679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:03.827576+0000","last_change":"2023-12-08T21:26:03.827576+0000","last_active":"2023-12-08T21:26:03.827576+0000","last_peered":"2023-12-08T21:26:03.827576+0000","last_clean":"2023-12-08T21:26:03.827576+0000","last_became_active":"2023-12-08T20:54:56.386413+0000","last_became_peered":"2023-12-08T20:54:56.386413+0000","last_unstale":"2023-12-08T21:26:03.827576+0000","last_undegraded":"2023-12-08T21:26:03.827576+0000","last_fullsized":"2023-12-08T21:26:03.827576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:03.827291+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:03.827291+0000","last_clean_scrub_stamp":"2023-12-08T21:26:03.827291+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:43:15.588855+0000","scrub_duration":0.003078543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.895627+0000","last_change":"2023-12-08T21:26:14.895627+0000","last_active":"2023-12-08T21:26:14.895627+0000","last_peered":"2023-12-08T21:26:14.895627+0000","last_clean":"2023-12-08T21:26:14.895627+0000","last_became_active":"2023-12-08T20:54:56.371456+0000","last_became_peered":"2023-12-08T20:54:56.371456+0000","last_unstale":"2023-12-08T21:26:14.895627+0000","last_undegraded":"2023-12-08T21:26:14.895627+0000","last_fullsized":"2023-12-08T21:26:14.895627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-12-08T21:26:14.895388+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-12-08T21:26:14.895388+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.895388+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:06:01.846393+0000","scrub_duration":0.0052799700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.144715+0000","last_change":"2023-12-08T21:26:17.144715+0000","last_active":"2023-12-08T21:26:17.144715+0000","last_peered":"2023-12-08T21:26:17.144715+0000","last_clean":"2023-12-08T21:26:17.144715+0000","last_became_active":"2023-12-08T20:54:56.380860+0000","last_became_peered":"2023-12-08T20:54:56.380860+0000","last_unstale":"2023-12-08T21:26:17.144715+0000","last_undegraded":"2023-12-08T21:26:17.144715+0000","last_fullsized":"2023-12-08T21:26:17.144715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:17.144561+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:17.144561+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.144561+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:10.819952+0000","scrub_duration":0.001893371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:32.244480+0000","last_change":"2023-12-08T21:26:32.244590+0000","last_active":"2023-12-08T21:26:32.244480+0000","last_peered":"2023-12-08T21:26:32.244480+0000","last_clean":"2023-12-08T21:26:32.244480+0000","last_became_active":"2023-12-08T20:54:56.260387+0000","last_became_peered":"2023-12-08T20:54:56.260387+0000","last_unstale":"2023-12-08T21:26:32.244480+0000","last_undegraded":"2023-12-08T21:26:32.244480+0000","last_fullsized":"2023-12-08T21:26:32.244480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:32.244249+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:32.244249+0000","last_clean_scrub_stamp":"2023-12-08T21:26:32.244249+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:14:23.949815+0000","scrub_duration":0.003446494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'32","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:10.301571+0000","last_change":"2023-12-08T21:26:10.301625+0000","last_active":"2023-12-08T21:26:10.301571+0000","last_peered":"2023-12-08T21:26:10.301571+0000","last_clean":"2023-12-08T21:26:10.301571+0000","last_became_active":"2023-12-08T20:54:56.387774+0000","last_became_peered":"2023-12-08T20:54:56.387774+0000","last_unstale":"2023-12-08T21:26:10.301571+0000","last_undegraded":"2023-12-08T21:26:10.301571+0000","last_fullsized":"2023-12-08T21:26:10.301571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:10.301372+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:10.301372+0000","last_clean_scrub_stamp":"2023-12-08T21:26:10.301372+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:19:37.645203+0000","scrub_duration":0.0036295450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:15.151085+0000","last_change":"2023-12-08T21:26:15.151138+0000","last_active":"2023-12-08T21:26:15.151085+0000","last_peered":"2023-12-08T21:26:15.151085+0000","last_clean":"2023-12-08T21:26:15.151085+0000","last_became_active":"2023-12-08T20:54:56.377029+0000","last_became_peered":"2023-12-08T20:54:56.377029+0000","last_unstale":"2023-12-08T21:26:15.151085+0000","last_undegraded":"2023-12-08T21:26:15.151085+0000","last_fullsized":"2023-12-08T21:26:15.151085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:15.150889+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:15.150889+0000","last_clean_scrub_stamp":"2023-12-08T21:26:15.150889+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:59:04.490083+0000","scrub_duration":0.006416382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.145181+0000","last_change":"2023-12-08T21:26:13.145289+0000","last_active":"2023-12-08T21:26:13.145181+0000","last_peered":"2023-12-08T21:26:13.145181+0000","last_clean":"2023-12-08T21:26:13.145181+0000","last_became_active":"2023-12-08T20:54:56.370707+0000","last_became_peered":"2023-12-08T20:54:56.370707+0000","last_unstale":"2023-12-08T21:26:13.145181+0000","last_undegraded":"2023-12-08T21:26:13.145181+0000","last_fullsized":"2023-12-08T21:26:13.145181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:13.144948+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:13.144948+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.144948+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:29:20.754089+0000","scrub_duration":0.0029542679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'29","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:15.785466+0000","last_change":"2023-12-08T21:26:15.785519+0000","last_active":"2023-12-08T21:26:15.785466+0000","last_peered":"2023-12-08T21:26:15.785466+0000","last_clean":"2023-12-08T21:26:15.785466+0000","last_became_active":"2023-12-08T20:54:56.401544+0000","last_became_peered":"2023-12-08T20:54:56.401544+0000","last_unstale":"2023-12-08T21:26:15.785466+0000","last_undegraded":"2023-12-08T21:26:15.785466+0000","last_fullsized":"2023-12-08T21:26:15.785466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-12-08T21:26:15.785268+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-12-08T21:26:15.785268+0000","last_clean_scrub_stamp":"2023-12-08T21:26:15.785268+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:56:21.117603+0000","scrub_duration":0.0032307500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.497763+0000","last_change":"2023-12-08T21:26:04.497882+0000","last_active":"2023-12-08T21:26:04.497763+0000","last_peered":"2023-12-08T21:26:04.497763+0000","last_clean":"2023-12-08T21:26:04.497763+0000","last_became_active":"2023-12-08T20:54:56.365432+0000","last_became_peered":"2023-12-08T20:54:56.365432+0000","last_unstale":"2023-12-08T21:26:04.497763+0000","last_undegraded":"2023-12-08T21:26:04.497763+0000","last_fullsized":"2023-12-08T21:26:04.497763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:04.497467+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:04.497467+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.497467+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:58:46.607618+0000","scrub_duration":0.0033388139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'32","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:03.491249+0000","last_change":"2023-12-08T21:26:03.491249+0000","last_active":"2023-12-08T21:26:03.491249+0000","last_peered":"2023-12-08T21:26:03.491249+0000","last_clean":"2023-12-08T21:26:03.491249+0000","last_became_active":"2023-12-08T20:54:56.392408+0000","last_became_peered":"2023-12-08T20:54:56.392408+0000","last_unstale":"2023-12-08T21:26:03.491249+0000","last_undegraded":"2023-12-08T21:26:03.491249+0000","last_fullsized":"2023-12-08T21:26:03.491249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:03.490973+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:03.490973+0000","last_clean_scrub_stamp":"2023-12-08T21:26:03.490973+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:48.345009+0000","scrub_duration":0.0042798330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:22.184387+0000","last_change":"2023-12-08T21:26:22.184387+0000","last_active":"2023-12-08T21:26:22.184387+0000","last_peered":"2023-12-08T21:26:22.184387+0000","last_clean":"2023-12-08T21:26:22.184387+0000","last_became_active":"2023-12-08T20:54:56.380137+0000","last_became_peered":"2023-12-08T20:54:56.380137+0000","last_unstale":"2023-12-08T21:26:22.184387+0000","last_undegraded":"2023-12-08T21:26:22.184387+0000","last_fullsized":"2023-12-08T21:26:22.184387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:26:22.183980+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:26:22.183980+0000","last_clean_scrub_stamp":"2023-12-08T21:26:22.183980+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:46:57.233922+0000","scrub_duration":0.0028384159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:48.796250+0000","last_change":"2023-12-08T20:54:56.392997+0000","last_active":"2023-12-08T21:25:48.796250+0000","last_peered":"2023-12-08T21:25:48.796250+0000","last_clean":"2023-12-08T21:25:48.796250+0000","last_became_active":"2023-12-08T20:54:56.391299+0000","last_became_peered":"2023-12-08T20:54:56.391299+0000","last_unstale":"2023-12-08T21:25:48.796250+0000","last_undegraded":"2023-12-08T21:25:48.796250+0000","last_fullsized":"2023-12-08T21:25:48.796250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'32","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.100437+0000","last_change":"2023-12-08T21:26:14.100437+0000","last_active":"2023-12-08T21:26:14.100437+0000","last_peered":"2023-12-08T21:26:14.100437+0000","last_clean":"2023-12-08T21:26:14.100437+0000","last_became_active":"2023-12-08T20:54:56.392708+0000","last_became_peered":"2023-12-08T20:54:56.392708+0000","last_unstale":"2023-12-08T21:26:14.100437+0000","last_undegraded":"2023-12-08T21:26:14.100437+0000","last_fullsized":"2023-12-08T21:26:14.100437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:14.100007+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:14.100007+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.100007+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:23:56.090149+0000","scrub_duration":0.0033906460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'30","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:07.865013+0000","last_change":"2023-12-08T21:26:07.865013+0000","last_active":"2023-12-08T21:26:07.865013+0000","last_peered":"2023-12-08T21:26:07.865013+0000","last_clean":"2023-12-08T21:26:07.865013+0000","last_became_active":"2023-12-08T20:54:56.318400+0000","last_became_peered":"2023-12-08T20:54:56.318400+0000","last_unstale":"2023-12-08T21:26:07.865013+0000","last_undegraded":"2023-12-08T21:26:07.865013+0000","last_fullsized":"2023-12-08T21:26:07.865013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-12-08T21:26:07.864752+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-12-08T21:26:07.864752+0000","last_clean_scrub_stamp":"2023-12-08T21:26:07.864752+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:43:38.394802+0000","scrub_duration":0.0055178909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.552551+0000","last_change":"2023-12-08T20:54:56.414028+0000","last_active":"2023-12-08T21:25:37.552551+0000","last_peered":"2023-12-08T21:25:37.552551+0000","last_clean":"2023-12-08T21:25:37.552551+0000","last_became_active":"2023-12-08T20:54:56.413220+0000","last_became_peered":"2023-12-08T20:54:56.413220+0000","last_unstale":"2023-12-08T21:25:37.552551+0000","last_undegraded":"2023-12-08T21:25:37.552551+0000","last_fullsized":"2023-12-08T21:25:37.552551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:11.113585+0000","last_change":"2023-12-08T21:26:11.113697+0000","last_active":"2023-12-08T21:26:11.113585+0000","last_peered":"2023-12-08T21:26:11.113585+0000","last_clean":"2023-12-08T21:26:11.113585+0000","last_became_active":"2023-12-08T20:54:56.365448+0000","last_became_peered":"2023-12-08T20:54:56.365448+0000","last_unstale":"2023-12-08T21:26:11.113585+0000","last_undegraded":"2023-12-08T21:26:11.113585+0000","last_fullsized":"2023-12-08T21:26:11.113585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:26:11.113287+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:26:11.113287+0000","last_clean_scrub_stamp":"2023-12-08T21:26:11.113287+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:21:06.223582+0000","scrub_duration":0.0035769590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'25","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.890733+0000","last_change":"2023-12-08T21:26:06.890777+0000","last_active":"2023-12-08T21:26:06.890733+0000","last_peered":"2023-12-08T21:26:06.890733+0000","last_clean":"2023-12-08T21:26:06.890733+0000","last_became_active":"2023-12-08T20:54:56.369574+0000","last_became_peered":"2023-12-08T20:54:56.369574+0000","last_unstale":"2023-12-08T21:26:06.890733+0000","last_undegraded":"2023-12-08T21:26:06.890733+0000","last_fullsized":"2023-12-08T21:26:06.890733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-12-08T21:26:06.890558+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-12-08T21:26:06.890558+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.890558+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:42:36.323222+0000","scrub_duration":0.0032420529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'21","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.103052+0000","last_change":"2023-12-08T21:26:13.103090+0000","last_active":"2023-12-08T21:26:13.103052+0000","last_peered":"2023-12-08T21:26:13.103052+0000","last_clean":"2023-12-08T21:26:13.103052+0000","last_became_active":"2023-12-08T20:54:56.411339+0000","last_became_peered":"2023-12-08T20:54:56.411339+0000","last_unstale":"2023-12-08T21:26:13.103052+0000","last_undegraded":"2023-12-08T21:26:13.103052+0000","last_fullsized":"2023-12-08T21:26:13.103052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:13.102896+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:13.102896+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.102896+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:37:09.675808+0000","scrub_duration":0.0030662670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'17","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:21.921172+0000","last_change":"2023-12-08T21:26:21.921229+0000","last_active":"2023-12-08T21:26:21.921172+0000","last_peered":"2023-12-08T21:26:21.921172+0000","last_clean":"2023-12-08T21:26:21.921172+0000","last_became_active":"2023-12-08T20:54:56.369650+0000","last_became_peered":"2023-12-08T20:54:56.369650+0000","last_unstale":"2023-12-08T21:26:21.921172+0000","last_undegraded":"2023-12-08T21:26:21.921172+0000","last_fullsized":"2023-12-08T21:26:21.921172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:26:21.920971+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:26:21.920971+0000","last_clean_scrub_stamp":"2023-12-08T21:26:21.920971+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:04:45.090796+0000","scrub_duration":0.0034163510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.876732+0000","last_change":"2023-12-08T21:26:04.876732+0000","last_active":"2023-12-08T21:26:04.876732+0000","last_peered":"2023-12-08T21:26:04.876732+0000","last_clean":"2023-12-08T21:26:04.876732+0000","last_became_active":"2023-12-08T20:54:56.408861+0000","last_became_peered":"2023-12-08T20:54:56.408861+0000","last_unstale":"2023-12-08T21:26:04.876732+0000","last_undegraded":"2023-12-08T21:26:04.876732+0000","last_fullsized":"2023-12-08T21:26:04.876732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:04.876470+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:04.876470+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.876470+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:42:10.809218+0000","scrub_duration":0.0033527380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'19","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:18.882384+0000","last_change":"2023-12-08T21:26:18.882418+0000","last_active":"2023-12-08T21:26:18.882384+0000","last_peered":"2023-12-08T21:26:18.882384+0000","last_clean":"2023-12-08T21:26:18.882384+0000","last_became_active":"2023-12-08T20:54:56.404697+0000","last_became_peered":"2023-12-08T20:54:56.404697+0000","last_unstale":"2023-12-08T21:26:18.882384+0000","last_undegraded":"2023-12-08T21:26:18.882384+0000","last_fullsized":"2023-12-08T21:26:18.882384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2023-12-08T21:26:18.882300+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2023-12-08T21:26:18.882300+0000","last_clean_scrub_stamp":"2023-12-08T21:26:18.882300+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:47:36.089699+0000","scrub_duration":0.0021163979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:15.123472+0000","last_change":"2023-12-08T21:26:15.123540+0000","last_active":"2023-12-08T21:26:15.123472+0000","last_peered":"2023-12-08T21:26:15.123472+0000","last_clean":"2023-12-08T21:26:15.123472+0000","last_became_active":"2023-12-08T20:54:56.377835+0000","last_became_peered":"2023-12-08T20:54:56.377835+0000","last_unstale":"2023-12-08T21:26:15.123472+0000","last_undegraded":"2023-12-08T21:26:15.123472+0000","last_fullsized":"2023-12-08T21:26:15.123472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:15.123273+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:15.123273+0000","last_clean_scrub_stamp":"2023-12-08T21:26:15.123273+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:25:29.875062+0000","scrub_duration":0.0058249160000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2350,"num_write_kb":252630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2525,"ondisk_log_size":2525,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1552,"ondisk_log_size":1552,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23858448,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":5673,"num_write_kb":26542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32464896,"data_stored":47716896,"data_compressed":4732252,"data_compressed_allocated":7307264,"data_compressed_original":22618112,"omap_allocated":0,"internal_metadata":0},"log_size":5234,"ondisk_log_size":5234,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509832,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":4588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":4698112,"data_stored":7801495,"data_compressed":855543,"data_compressed_allocated":1261568,"data_compressed_original":4567040,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.90900000000000003,"15min":0.88700000000000001},"min":{"1min":0.58499999999999996,"5min":0.57299999999999995,"15min":0.371},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92200000000000004,"15min":0.93899999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.262,"5min":1.4710000000000001,"15min":1.6479999999999999},"last":1.1040000000000001}]},{"osd":1,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.97199999999999998,"15min":0.93300000000000005},"min":{"1min":0.68799999999999994,"5min":0.52000000000000002,"15min":0.44400000000000001},"max":{"1min":1.2869999999999999,"5min":1.3640000000000001,"15min":1.405},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.91500000000000004,"15min":0.93400000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.48599999999999999},"max":{"1min":1.1659999999999999,"5min":1.3500000000000001,"15min":1.504},"last":1.04}]},{"osd":2,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96199999999999997,"15min":0.92100000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.95699999999999996,"15min":0.98299999999999998},"min":{"1min":0.63,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":1.1919999999999999,"5min":1.3109999999999999,"15min":1.776},"last":1.0780000000000001}]},{"osd":3,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.99099999999999999,"15min":1.0029999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.46700000000000003},"max":{"1min":1.089,"5min":1.363,"15min":2.0840000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0549999999999999,"15min":1.0760000000000001},"min":{"1min":0.78900000000000003,"5min":0.61399999999999999,"15min":0.44800000000000001},"max":{"1min":1.387,"5min":1.427,"15min":2.181},"last":1.137}]},{"osd":4,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.89600000000000002,"15min":0.91800000000000004},"min":{"1min":0.69199999999999995,"5min":0.35699999999999998,"15min":0.30199999999999999},"max":{"1min":1.25,"5min":1.444,"15min":1.972},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.02,"15min":1.0329999999999999},"min":{"1min":0.69499999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.587,"5min":1.587,"15min":1.8149999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":0.999,"15min":1.026},"min":{"1min":0.73399999999999999,"5min":0.48199999999999998,"15min":0.41799999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":2.3069999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.0489999999999999,"15min":1.069},"min":{"1min":0.80900000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.8959999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.109,"15min":1.1100000000000001},"min":{"1min":0.74099999999999999,"5min":0.65100000000000002,"15min":0.56999999999999995},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1599999999999999,"15min":1.1719999999999999},"min":{"1min":0.92300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5529999999999999,"5min":1.7110000000000001,"15min":1.8600000000000001},"last":1.016}]}]},{"osd":3,"up_from":15,"seq":64424509832,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62188,"kb_used_data":8804,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309652,"statfs":{"total":96636764160,"available":96573083648,"internally_reserved":0,"allocated":9015296,"data_stored":12714767,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.27800000000000002},"max":{"1min":1.0700000000000001,"5min":1.3700000000000001,"15min":1.655},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.79200000000000004,"15min":0.77500000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.34699999999999998},"max":{"1min":1.0649999999999999,"5min":1.504,"15min":1.7809999999999999},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.30399999999999999},"max":{"1min":1.016,"5min":1.5189999999999999,"15min":1.5329999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.91600000000000004,"15min":0.92500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.26900000000000002},"max":{"1min":1.1910000000000001,"5min":1.4490000000000001,"15min":2.036},"last":0.70699999999999996}]},{"osd":2,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.92700000000000005,"15min":0.92400000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0669999999999999,"5min":1.585,"15min":1.9470000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.96999999999999997,"15min":0.98199999999999998},"min":{"1min":0.442,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1699999999999999,"5min":1.4450000000000001,"15min":1.786},"last":1.099}]},{"osd":4,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0640000000000001,"15min":1.079},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.52000000000000002},"max":{"1min":1.718,"5min":1.73,"15min":1.73},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.056,"5min":1.147,"15min":1.137},"min":{"1min":0.622,"5min":0.622,"15min":0.53700000000000003},"max":{"1min":1.4990000000000001,"5min":1.875,"15min":2.3039999999999998},"last":0.755}]},{"osd":5,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.177,"15min":1.165},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.65700000000000003},"max":{"1min":1.635,"5min":2.0619999999999998,"15min":2.2999999999999998},"last":1.133},{"interface":"front","average":{"1min":1.196,"5min":1.228,"15min":1.2649999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.55000000000000004},"max":{"1min":1.681,"5min":2.0129999999999999,"15min":2.9319999999999999},"last":1.0009999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.258,"15min":1.284},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.587,"5min":1.9199999999999999,"15min":2.5510000000000002},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2150000000000001,"15min":1.2170000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.621},"max":{"1min":1.55,"5min":1.8460000000000001,"15min":1.9059999999999999},"last":1.0680000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.258,"15min":1.2589999999999999},"min":{"1min":0.78400000000000003,"5min":0.72099999999999997,"15min":0.58899999999999997},"max":{"1min":1.611,"5min":1.849,"15min":1.849},"last":1.163},{"interface":"front","average":{"1min":1.206,"5min":1.3149999999999999,"15min":1.2969999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.58499999999999996},"max":{"1min":1.8620000000000001,"5min":1.966,"15min":2.1640000000000001},"last":1.1899999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509831,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37588,"kb_used_data":6412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334252,"statfs":{"total":96636764160,"available":96598274048,"internally_reserved":0,"allocated":6565888,"data_stored":8520553,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74399999999999999,"15min":0.747},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.4670000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.80300000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.316},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.89100000000000001}]},{"osd":1,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.87,"15min":0.872},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.38900000000000001},"max":{"1min":1.202,"5min":1.466,"15min":1.6599999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.91700000000000004,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":4.5620000000000003},"last":0.69899999999999995}]},{"osd":3,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.86699999999999999,"15min":0.84999999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.39300000000000002},"max":{"1min":1.0509999999999999,"5min":1.704,"15min":1.704},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.008},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4330000000000001,"5min":1.643,"15min":1.661},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.111,"15min":1.0960000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.51200000000000001},"max":{"1min":1.3169999999999999,"5min":1.647,"15min":1.726},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0589999999999999,"15min":1.0409999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2589999999999999,"5min":1.6060000000000001,"15min":1.6240000000000001},"last":0.94799999999999995}]},{"osd":5,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.208,"15min":1.1970000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5800000000000001,"5min":1.7649999999999999,"15min":1.8009999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.196,"15min":1.1910000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.61099999999999999},"max":{"1min":1.667,"5min":1.7470000000000001,"15min":1.855},"last":1.077}]},{"osd":6,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.133,"15min":1.131},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.7270000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.54700000000000004},"max":{"1min":1.8100000000000001,"5min":1.907,"15min":2.0150000000000001},"last":0.92300000000000004}]},{"osd":7,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.284,"15min":1.272},"min":{"1min":0.81399999999999995,"5min":0.76200000000000001,"15min":0.56999999999999995},"max":{"1min":1.7729999999999999,"5min":1.8400000000000001,"15min":1.9810000000000001},"last":1.147},{"interface":"front","average":{"1min":1.147,"5min":1.2370000000000001,"15min":1.2130000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.68500000000000005},"max":{"1min":1.74,"5min":1.7869999999999999,"15min":1.8240000000000001},"last":1.2190000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509833,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":721711,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72399999999999998,"15min":0.73899999999999999},"min":{"1min":0.32800000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.1890000000000001,"5min":1.2569999999999999,"15min":1.7689999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.84999999999999998,"15min":0.79800000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1319999999999999,"5min":1.556,"15min":1.556},"last":1.0609999999999999}]},{"osd":2,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.748,"15min":0.748},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.179,"5min":1.3899999999999999,"15min":1.4510000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.93600000000000005,"15min":0.90800000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.33500000000000002},"max":{"1min":1.1890000000000001,"5min":1.5069999999999999,"15min":2.0019999999999998},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.96999999999999997,"15min":0.94899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.32400000000000001},"max":{"1min":1.431,"5min":1.639,"15min":1.948},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.96499999999999997,"15min":0.93700000000000006},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.35199999999999998},"max":{"1min":1.109,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.1000000000000001,"15min":1.079},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.57299999999999995},"max":{"1min":1.3560000000000001,"5min":1.879,"15min":1.879},"last":1.099},{"interface":"front","average":{"1min":1.095,"5min":1.169,"15min":1.1599999999999999},"min":{"1min":0.79400000000000004,"5min":0.66900000000000004,"15min":0.626},"max":{"1min":1.518,"5min":1.7470000000000001,"15min":1.841},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.2070000000000001,"15min":1.163},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.60199999999999998},"max":{"1min":1.3600000000000001,"5min":1.6899999999999999,"15min":1.9179999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1910000000000001,"15min":1.1639999999999999},"min":{"1min":0.67100000000000004,"5min":0.65300000000000002,"15min":0.64600000000000002},"max":{"1min":1.5649999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.2430000000000001,"15min":1.2350000000000001},"min":{"1min":0.64800000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.456,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.254,"15min":1.2310000000000001},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.482,"5min":1.7529999999999999,"15min":2.0259999999999998},"last":1.1359999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.3069999999999999,"15min":1.274},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.6220000000000001,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.27,"15min":1.2430000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.67300000000000004},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.22}]}]},{"osd":0,"up_from":15,"seq":64424509832,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46668,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94325172,"statfs":{"total":96636764160,"available":96588976128,"internally_reserved":0,"allocated":3084288,"data_stored":4325633,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1319999999999999,"5min":1.3819999999999999,"15min":1.698},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81000000000000005,"15min":0.80000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1990000000000001,"5min":1.788,"15min":1.907},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.34100000000000003},"max":{"1min":1.2989999999999999,"5min":1.633,"15min":1.633},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91500000000000004,"15min":0.875},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.639,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.81799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.657},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0289999999999999,"15min":1.016},"min":{"1min":0.48399999999999999,"5min":0.40999999999999998,"15min":0.38400000000000001},"max":{"1min":1.4890000000000001,"5min":1.694,"15min":2.2850000000000001},"last":1.032}]},{"osd":4,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.1000000000000001},"last":0.996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.081,"15min":1.1160000000000001},"min":{"1min":0.68500000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":14.787000000000001},"last":1.083}]},{"osd":5,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1890000000000001,"15min":1.1839999999999999},"min":{"1min":0.76700000000000002,"5min":0.68000000000000005,"15min":0.61699999999999999},"max":{"1min":1.726,"5min":1.726,"15min":2.218},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.226,"15min":1.2010000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.66900000000000004},"max":{"1min":1.8009999999999999,"5min":1.8740000000000001,"15min":2.2309999999999999},"last":1.0609999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1499999999999999,"15min":1.1419999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.3380000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2929999999999999,"15min":1.28},"min":{"1min":0.80900000000000005,"5min":0.747,"15min":0.68500000000000005},"max":{"1min":1.927,"5min":1.927,"15min":2.1480000000000001},"last":1.5900000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.2729999999999999,"15min":1.266},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.60199999999999998},"max":{"1min":1.9730000000000001,"5min":2.0059999999999998,"15min":2.3300000000000001},"last":1.202},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2250000000000001,"15min":1.218},"min":{"1min":0.73999999999999999,"5min":0.67000000000000004,"15min":0.58099999999999996},"max":{"1min":2.024,"5min":2.024,"15min":2.4319999999999999},"last":1.321}]}]},{"osd":7,"up_from":14,"seq":60129542535,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29016,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342824,"statfs":{"total":96636764160,"available":96607051776,"internally_reserved":0,"allocated":2048000,"data_stored":3016855,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.92600000000000005,"15min":0.91200000000000003},"min":{"1min":0.63400000000000001,"5min":0.55200000000000005,"15min":0.38100000000000001},"max":{"1min":1.2669999999999999,"5min":1.8069999999999999,"15min":1.8939999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.208,"5min":1.948,"15min":1.948},"last":0.78600000000000003}]},{"osd":1,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.96899999999999997,"15min":0.93700000000000006},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.244,"5min":3.246,"15min":3.246},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95299999999999996,"15min":0.94599999999999995},"min":{"1min":0.72299999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.282,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":0.98299999999999998}]},{"osd":2,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97999999999999998,"15min":0.97499999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.712,"15min":1.9399999999999999},"last":1.075},{"interface":"front","average":{"1min":1.018,"5min":0.97499999999999998,"15min":0.97899999999999998},"min":{"1min":0.79000000000000004,"5min":0.50700000000000001,"15min":0.47799999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.8280000000000001},"last":0.82099999999999995}]},{"osd":3,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0509999999999999,"15min":1.036},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.55300000000000005},"max":{"1min":1.3400000000000001,"5min":1.528,"15min":1.528},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.002,"5min":1.024,"15min":1.0109999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.359,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.1619999999999999}]},{"osd":4,"last update":"Fri Dec 8 21:26:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.627,"5min":0.58099999999999996,"15min":0.55300000000000005},"max":{"1min":1.302,"5min":1.3859999999999999,"15min":1.45},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.92500000000000004,"15min":0.99399999999999999},"min":{"1min":0.55000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.389,"5min":1.389,"15min":1.5680000000000001},"last":1.101}]},{"osd":5,"last update":"Fri Dec 8 21:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92800000000000005,"15min":0.98099999999999998},"min":{"1min":0.63800000000000001,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.2270000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.085,"5min":1.0920000000000001,"15min":1.127},"min":{"1min":0.67800000000000005,"5min":0.66200000000000003,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.6419999999999999,"15min":1.857},"last":1.036}]},{"osd":6,"last update":"Fri Dec 8 21:26:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0109999999999999,"15min":1.0800000000000001},"min":{"1min":0.78500000000000003,"5min":0.68799999999999994,"15min":0.66400000000000003},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.948},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.24,"5min":1.198,"15min":1.216},"min":{"1min":0.995,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":2.0019999999999998},"last":1.1919999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542536,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42332,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329508,"statfs":{"total":96636764160,"available":96593416192,"internally_reserved":0,"allocated":2904064,"data_stored":4325577,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94699999999999995,"15min":0.89900000000000002},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48799999999999999},"max":{"1min":1.2390000000000001,"5min":1.395,"15min":1.4430000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.96699999999999997,"15min":0.90800000000000003},"min":{"1min":0.66800000000000004,"5min":0.56599999999999995,"15min":0.44900000000000001},"max":{"1min":1.3200000000000001,"5min":1.3979999999999999,"15min":1.4790000000000001},"last":1.3029999999999999}]},{"osd":1,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.98699999999999999,"15min":0.93999999999999995},"min":{"1min":0.59099999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.92700000000000005,"15min":0.91900000000000004},"min":{"1min":0.78500000000000003,"5min":0.53600000000000003,"15min":0.48699999999999999},"max":{"1min":1.304,"5min":1.4159999999999999,"15min":1.512},"last":0.81399999999999995}]},{"osd":2,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.96999999999999997,"15min":0.93700000000000006},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.53800000000000003},"max":{"1min":1.2729999999999999,"5min":1.357,"15min":1.421},"last":1.163},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0429999999999999,"15min":0.999},"min":{"1min":0.80000000000000004,"5min":0.59099999999999997,"15min":0.51300000000000001},"max":{"1min":1.4690000000000001,"5min":1.546,"15min":1.546},"last":1.1180000000000001}]},{"osd":3,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.032,"15min":1.0229999999999999},"min":{"1min":0.69299999999999995,"5min":0.621,"15min":0.56000000000000005},"max":{"1min":1.3700000000000001,"5min":1.5529999999999999,"15min":1.708},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1559999999999999,"15min":1.1259999999999999},"min":{"1min":0.77400000000000002,"5min":0.72499999999999998,"15min":0.54700000000000004},"max":{"1min":1.3959999999999999,"5min":1.542,"15min":1.7},"last":1.0189999999999999}]},{"osd":4,"last update":"Fri Dec 8 21:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.96399999999999997,"15min":0.97299999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.50900000000000001},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.016,"15min":1.0009999999999999},"min":{"1min":0.71899999999999997,"5min":0.64000000000000001,"15min":0.57899999999999996},"max":{"1min":1.3169999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.3819999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.69099999999999995,"5min":0.56499999999999995,"15min":0.53100000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.79},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1200000000000001,"15min":1.113},"min":{"1min":0.90400000000000003,"5min":0.69399999999999995,"15min":0.432},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":1.3420000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:26:03 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.0600000000000001,"15min":1.0620000000000001},"min":{"1min":0.70399999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5820000000000001,"5min":1.732,"15min":1.732},"last":1.232},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.198,"15min":1.198},"min":{"1min":0.79900000000000004,"5min":0.75900000000000001,"15min":0.47299999999999998},"max":{"1min":1.6859999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.2549999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542534,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55520,"kb_used_data":6296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316320,"statfs":{"total":96636764160,"available":96579911680,"internally_reserved":0,"allocated":6447104,"data_stored":8521225,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.501,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":1.238,"5min":1.381,"15min":1.6000000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91800000000000004,"15min":0.90700000000000003},"min":{"1min":0.58399999999999996,"5min":0.51000000000000001,"15min":0.41399999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.391},"last":0.78600000000000003}]},{"osd":1,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.94399999999999995,"15min":0.91400000000000003},"min":{"1min":0.63600000000000001,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":1.3140000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.03,"15min":0.998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.46100000000000002},"max":{"1min":1.304,"5min":1.4530000000000001,"15min":1.4570000000000001},"last":1.27}]},{"osd":2,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.004,"15min":1.0129999999999999},"min":{"1min":0.59399999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4079999999999999,"5min":1.4710000000000001,"15min":1.681},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95099999999999996,"15min":0.94799999999999995},"min":{"1min":0.68600000000000005,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.2250000000000001,"5min":1.385,"15min":1.52},"last":1.0900000000000001}]},{"osd":3,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98999999999999999,"15min":0.98899999999999999},"min":{"1min":0.73999999999999999,"5min":0.63100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2629999999999999,"5min":1.927,"15min":1.927},"last":1.127},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.139,"15min":1.1140000000000001},"min":{"1min":0.75900000000000001,"5min":0.64100000000000001,"15min":0.433},"max":{"1min":1.377,"5min":1.6519999999999999,"15min":1.7549999999999999},"last":0.85399999999999998}]},{"osd":5,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89400000000000002,"15min":0.92100000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.206,"5min":1.28,"15min":1.504},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.026,"15min":1.0049999999999999},"min":{"1min":0.61499999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.409,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.026}]},{"osd":6,"last update":"Fri Dec 8 21:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0469999999999999,"15min":1.0589999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.0740000000000001,"15min":1.0600000000000001},"min":{"1min":0.71199999999999997,"5min":0.69899999999999995,"15min":0.52900000000000003},"max":{"1min":1.4970000000000001,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.202}]},{"osd":7,"last update":"Fri Dec 8 21:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.181,"15min":1.1619999999999999},"min":{"1min":0.65600000000000003,"5min":0.65500000000000003,"15min":0.39400000000000002},"max":{"1min":1.806,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.171},{"interface":"front","average":{"1min":1.077,"5min":1.0920000000000001,"15min":1.0980000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45400000000000001},"max":{"1min":1.4650000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.1499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":4194360,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6246400,"data_stored":8389280,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8695808,"data_stored":12583494,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":8389952,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4313088,"data_stored":7079854,"data_compressed":822166,"data_compressed_allocated":1216512,"data_compressed_original":3993600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":4194304,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1728512,"data_stored":2885582,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T21:26:38.068 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.068 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.069 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.069 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.069 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.069 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.069 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.070 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.070 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.070 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.070 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.070 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.070 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.071 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.071 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.071 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.071 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.071 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.071 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.071 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.072 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.072 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.072 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.072 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:38.072 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-08T21:26:58.074 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T21:26:58.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.214+0000 7efd0780b640 1 Processor -- start 2023-12-08T21:26:58.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.214+0000 7efd0780b640 1 -- start start 2023-12-08T21:26:58.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.214+0000 7efd0780b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efd000cb290 0x7efd0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:58.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.214+0000 7efd0780b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 0x7efd0006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:58.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.214+0000 7efd0780b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd000c7870 con 0x7efd001502a0 2023-12-08T21:26:58.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.214+0000 7efd0780b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd000c7b50 con 0x7efd000cb290 2023-12-08T21:26:58.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.214+0000 7efd0780b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd000c7e30 con 0x7efd00156ec0 2023-12-08T21:26:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.214+0000 7efd05da8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 0x7efd0006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.218+0000 7efd04da6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efd000cb290 0x7efd0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:58.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.218+0000 7efd05da8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 0x7efd0006d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:38128/0 (socket says 172.21.15.53:38128) 2023-12-08T21:26:58.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.218+0000 7efd05da8640 1 -- 172.21.15.53:0/3549184813 learned_addr learned my addr 172.21.15.53:0/3549184813 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:26:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.222+0000 7efd05da8640 1 -- 172.21.15.53:0/3549184813 >> v2:172.21.15.146:3300/0 conn(0x7efd000cb290 msgr2=0x7efd0006edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:26:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.222+0000 7efd05da8640 1 --2- 172.21.15.53:0/3549184813 >> v2:172.21.15.146:3300/0 conn(0x7efd000cb290 0x7efd0006edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.222+0000 7efd05da8640 1 -- 172.21.15.53:0/3549184813 >> v1:172.21.15.53:6789/0 conn(0x7efd001502a0 legacy=0x7efd000c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:26:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.222+0000 7efd05da8640 1 -- 172.21.15.53:0/3549184813 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd001563e0 con 0x7efd00156ec0 2023-12-08T21:26:58.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.226+0000 7efd05da8640 1 --2- 172.21.15.53:0/3549184813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 0x7efd0006d070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009e50 tx=0x7efcf801c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55e24d6121045fbb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:26:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efcf7fff640 1 -- 172.21.15.53:0/3549184813 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf80a5760 con 0x7efd00156ec0 2023-12-08T21:26:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efcf7fff640 1 -- 172.21.15.53:0/3549184813 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf80a58c0 con 0x7efd00156ec0 2023-12-08T21:26:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efcf7fff640 1 -- 172.21.15.53:0/3549184813 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf80a5c50 con 0x7efd00156ec0 2023-12-08T21:26:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efd0780b640 1 -- 172.21.15.53:0/3549184813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 msgr2=0x7efd0006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efd0780b640 1 --2- 172.21.15.53:0/3549184813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 0x7efd0006d070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009e50 tx=0x7efcf801c9d0 comp rx=0 tx=0).stop 2023-12-08T21:26:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efd0780b640 1 -- 172.21.15.53:0/3549184813 shutdown_connections 2023-12-08T21:26:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efd0780b640 1 --2- 172.21.15.53:0/3549184813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 0x7efd0006d070 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:58.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efd0780b640 1 --2- 172.21.15.53:0/3549184813 >> v2:172.21.15.146:3300/0 conn(0x7efd000cb290 0x7efd0006edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:58.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efd0780b640 1 -- 172.21.15.53:0/3549184813 >> 172.21.15.53:0/3549184813 conn(0x7efd00071320 msgr2=0x7efd00071730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:26:58.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efd0780b640 1 -- 172.21.15.53:0/3549184813 shutdown_connections 2023-12-08T21:26:58.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efd0780b640 1 -- 172.21.15.53:0/3549184813 wait complete. 2023-12-08T21:26:58.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efd0780b640 1 Processor -- start 2023-12-08T21:26:58.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.238+0000 7efd0780b640 1 -- start start 2023-12-08T21:26:58.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.242+0000 7efd0780b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd000cb290 0x7efd001f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:58.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.242+0000 7efd0780b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd001502a0 0x7efd00148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:58.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.242+0000 7efd0780b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 0x7efd001455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:58.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.242+0000 7efd0780b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd001f44e0 con 0x7efd001502a0 2023-12-08T21:26:58.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.242+0000 7efd0780b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd00147730 con 0x7efd000cb290 2023-12-08T21:26:58.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.242+0000 7efd0780b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd001479d0 con 0x7efd00156ec0 2023-12-08T21:26:58.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.242+0000 7efd05da8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 0x7efd001455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:58.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.242+0000 7efd055a7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd000cb290 0x7efd001f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:58.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.242+0000 7efd05da8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 0x7efd001455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:38138/0 (socket says 172.21.15.53:38138) 2023-12-08T21:26:58.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.242+0000 7efd05da8640 1 -- 172.21.15.53:0/288111709 learned_addr learned my addr 172.21.15.53:0/288111709 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:26:58.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.254+0000 7efd05da8640 1 -- 172.21.15.53:0/288111709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd000cb290 msgr2=0x7efd001f3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:58.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.254+0000 7efd05da8640 1 --2- 172.21.15.53:0/288111709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd000cb290 0x7efd001f3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:58.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.254+0000 7efd05da8640 1 -- 172.21.15.53:0/288111709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd001502a0 msgr2=0x7efd00148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:58.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.254+0000 7efd05da8640 1 --2- 172.21.15.53:0/288111709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd001502a0 0x7efd00148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:58.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.254+0000 7efd05da8640 1 -- 172.21.15.53:0/288111709 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8009b30 con 0x7efd00156ec0 2023-12-08T21:26:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.258+0000 7efd05da8640 1 --2- 172.21.15.53:0/288111709 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 0x7efd001455f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efcf801b080 tx=0x7efcf8019770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:26:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.270+0000 7efcf5ffb640 1 -- 172.21.15.53:0/288111709 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf80a5760 con 0x7efd00156ec0 2023-12-08T21:26:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.270+0000 7efcf5ffb640 1 -- 172.21.15.53:0/288111709 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf80b8640 con 0x7efd00156ec0 2023-12-08T21:26:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.270+0000 7efcf5ffb640 1 -- 172.21.15.53:0/288111709 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf80b89f0 con 0x7efd00156ec0 2023-12-08T21:26:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.270+0000 7efd0780b640 1 -- 172.21.15.53:0/288111709 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0014ad90 con 0x7efd00156ec0 2023-12-08T21:26:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.270+0000 7efd0780b640 1 -- 172.21.15.53:0/288111709 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0014b350 con 0x7efd00156ec0 2023-12-08T21:26:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.270+0000 7efd0780b640 1 -- 172.21.15.53:0/288111709 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0014abf0 con 0x7efd00156ec0 2023-12-08T21:26:58.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.578+0000 7efcf5ffb640 1 -- 172.21.15.53:0/288111709 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efcf80b8b50 con 0x7efd00156ec0 2023-12-08T21:26:58.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.578+0000 7efcf5ffb640 1 --2- 172.21.15.53:0/288111709 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efce4066470 0x7efce4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:26:58.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.578+0000 7efd055a7640 1 --2- 172.21.15.53:0/288111709 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efce4066470 0x7efce4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:26:58.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.582+0000 7efd055a7640 1 --2- 172.21.15.53:0/288111709 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efce4066470 0x7efce4068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efcfc007fd0 tx=0x7efcfc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:26:58.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.590+0000 7efcf5ffb640 1 -- 172.21.15.53:0/288111709 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7efcf80f1040 con 0x7efd00156ec0 2023-12-08T21:26:58.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.614+0000 7efcf5ffb640 1 -- 172.21.15.53:0/288111709 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efcf80ecc80 con 0x7efd00156ec0 2023-12-08T21:26:58.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.774+0000 7efd0780b640 1 -- 172.21.15.53:0/288111709 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd00163470 con 0x7efce4066470 2023-12-08T21:26:58.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.802+0000 7efcf5ffb640 1 -- 172.21.15.53:0/288111709 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371854 (secure 0 0 0) 0x7efcfc001490 con 0x7efce4066470 2023-12-08T21:26:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:26:58.809 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-12-08T21:26:58.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.806+0000 7efd0780b640 1 -- 172.21.15.53:0/288111709 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efce4066470 msgr2=0x7efce4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.806+0000 7efd0780b640 1 --2- 172.21.15.53:0/288111709 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efce4066470 0x7efce4068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efcfc007fd0 tx=0x7efcfc009040 comp rx=0 tx=0).stop 2023-12-08T21:26:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.806+0000 7efd0780b640 1 -- 172.21.15.53:0/288111709 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 msgr2=0x7efd001455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:26:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.806+0000 7efd0780b640 1 --2- 172.21.15.53:0/288111709 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 0x7efd001455f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efcf801b080 tx=0x7efcf8019770 comp rx=0 tx=0).stop 2023-12-08T21:26:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.806+0000 7efd0780b640 1 -- 172.21.15.53:0/288111709 shutdown_connections 2023-12-08T21:26:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.806+0000 7efd0780b640 1 --2- 172.21.15.53:0/288111709 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efce4066470 0x7efce4068930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.806+0000 7efd0780b640 1 --2- 172.21.15.53:0/288111709 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd00156ec0 0x7efd001455f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.806+0000 7efd0780b640 1 --2- 172.21.15.53:0/288111709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd001502a0 0x7efd00148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.806+0000 7efd0780b640 1 --2- 172.21.15.53:0/288111709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd000cb290 0x7efd001f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:26:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.806+0000 7efd0780b640 1 -- 172.21.15.53:0/288111709 >> 172.21.15.53:0/288111709 conn(0x7efd00071320 msgr2=0x7efd0014a150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:26:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.806+0000 7efd0780b640 1 -- 172.21.15.53:0/288111709 shutdown_connections 2023-12-08T21:26:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:26:58.806+0000 7efd0780b640 1 -- 172.21.15.53:0/288111709 wait complete. 2023-12-08T21:26:58.829 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":1010,"stamp":"2023-12-08T21:26:58.079299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24448816,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":690,"num_read_kb":695,"num_write":8182,"num_write_kb":281588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9430,"ondisk_log_size":9430,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332312,"kb_used_data":34328,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754642408,"statfs":{"total":773094113280,"available":772753825792,"internally_reserved":0,"allocated":35151872,"data_stored":49947816,"data_compressed":4799006,"data_compressed_allocated":7397376,"data_compressed_original":23764992,"omap_allocated":12752,"internal_metadata":305057328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005467"},"pg_stats":[{"pgid":"2.1f","version":"30'723","reported_seq":768,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.005407+0000","last_change":"2023-12-08T21:26:04.005407+0000","last_active":"2023-12-08T21:26:04.005407+0000","last_peered":"2023-12-08T21:26:04.005407+0000","last_clean":"2023-12-08T21:26:04.005407+0000","last_became_active":"2023-12-08T20:54:54.982479+0000","last_became_peered":"2023-12-08T20:54:54.982479+0000","last_unstale":"2023-12-08T21:26:04.005407+0000","last_undegraded":"2023-12-08T21:26:04.005407+0000","last_fullsized":"2023-12-08T21:26:04.005407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'723","last_scrub_stamp":"2023-12-08T21:26:04.005126+0000","last_deep_scrub":"30'723","last_deep_scrub_stamp":"2023-12-08T21:26:04.005126+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.005126+0000","objects_scrubbed":3,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:15:19.024106+0000","scrub_duration":0.032565425000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":4491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.842692+0000","last_change":"2023-12-08T21:26:17.842746+0000","last_active":"2023-12-08T21:26:17.842692+0000","last_peered":"2023-12-08T21:26:17.842692+0000","last_clean":"2023-12-08T21:26:17.842692+0000","last_became_active":"2023-12-08T20:54:56.406245+0000","last_became_peered":"2023-12-08T20:54:56.406245+0000","last_unstale":"2023-12-08T21:26:17.842692+0000","last_undegraded":"2023-12-08T21:26:17.842692+0000","last_fullsized":"2023-12-08T21:26:17.842692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:26:17.842517+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:26:17.842517+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.842517+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:52:41.624179+0000","scrub_duration":0.0034622569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'66","reported_seq":103,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.354863+0000","last_change":"2023-12-08T21:26:13.354863+0000","last_active":"2023-12-08T21:26:13.354863+0000","last_peered":"2023-12-08T21:26:13.354863+0000","last_clean":"2023-12-08T21:26:13.354863+0000","last_became_active":"2023-12-08T20:55:04.458087+0000","last_became_peered":"2023-12-08T20:55:04.458087+0000","last_unstale":"2023-12-08T21:26:13.354863+0000","last_undegraded":"2023-12-08T21:26:13.354863+0000","last_fullsized":"2023-12-08T21:26:13.354863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'66","last_scrub_stamp":"2023-12-08T21:26:13.354616+0000","last_deep_scrub":"30'66","last_deep_scrub_stamp":"2023-12-08T21:26:13.354616+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.354616+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:22:11.785201+0000","scrub_duration":0.0069482959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'291","reported_seq":336,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:12.896378+0000","last_change":"2023-12-08T21:26:12.896418+0000","last_active":"2023-12-08T21:26:12.896378+0000","last_peered":"2023-12-08T21:26:12.896378+0000","last_clean":"2023-12-08T21:26:12.896378+0000","last_became_active":"2023-12-08T20:54:54.929391+0000","last_became_peered":"2023-12-08T20:54:54.929391+0000","last_unstale":"2023-12-08T21:26:12.896378+0000","last_undegraded":"2023-12-08T21:26:12.896378+0000","last_fullsized":"2023-12-08T21:26:12.896378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'291","last_scrub_stamp":"2023-12-08T21:26:12.896235+0000","last_deep_scrub":"30'291","last_deep_scrub_stamp":"2023-12-08T21:26:12.896235+0000","last_clean_scrub_stamp":"2023-12-08T21:26:12.896235+0000","objects_scrubbed":1,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:55:16.287502+0000","scrub_duration":0.026480232999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759983,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":2843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:05.915231+0000","last_change":"2023-12-08T21:26:05.915231+0000","last_active":"2023-12-08T21:26:05.915231+0000","last_peered":"2023-12-08T21:26:05.915231+0000","last_clean":"2023-12-08T21:26:05.915231+0000","last_became_active":"2023-12-08T20:54:56.408361+0000","last_became_peered":"2023-12-08T20:54:56.408361+0000","last_unstale":"2023-12-08T21:26:05.915231+0000","last_undegraded":"2023-12-08T21:26:05.915231+0000","last_fullsized":"2023-12-08T21:26:05.915231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:05.914915+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:05.914915+0000","last_clean_scrub_stamp":"2023-12-08T21:26:05.914915+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:55:04.773085+0000","scrub_duration":0.0057752130000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'74","reported_seq":111,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:45.105789+0000","last_change":"2023-12-08T21:26:45.105850+0000","last_active":"2023-12-08T21:26:45.105789+0000","last_peered":"2023-12-08T21:26:45.105789+0000","last_clean":"2023-12-08T21:26:45.105789+0000","last_became_active":"2023-12-08T20:55:04.528732+0000","last_became_peered":"2023-12-08T20:55:04.528732+0000","last_unstale":"2023-12-08T21:26:45.105789+0000","last_undegraded":"2023-12-08T21:26:45.105789+0000","last_fullsized":"2023-12-08T21:26:45.105789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'74","last_scrub_stamp":"2023-12-08T21:26:45.105581+0000","last_deep_scrub":"30'74","last_deep_scrub_stamp":"2023-12-08T21:26:45.105581+0000","last_clean_scrub_stamp":"2023-12-08T21:26:45.105581+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:21:40.215877+0000","scrub_duration":0.007506693,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'10","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.114439+0000","last_change":"2023-12-08T21:26:06.114494+0000","last_active":"2023-12-08T21:26:06.114439+0000","last_peered":"2023-12-08T21:26:06.114439+0000","last_clean":"2023-12-08T21:26:06.114439+0000","last_became_active":"2023-12-08T20:54:54.935620+0000","last_became_peered":"2023-12-08T20:54:54.935620+0000","last_unstale":"2023-12-08T21:26:06.114439+0000","last_undegraded":"2023-12-08T21:26:06.114439+0000","last_fullsized":"2023-12-08T21:26:06.114439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'10","last_scrub_stamp":"2023-12-08T21:26:06.114261+0000","last_deep_scrub":"30'10","last_deep_scrub_stamp":"2023-12-08T21:26:06.114261+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.114261+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:08:13.151028+0000","scrub_duration":0.0062390579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'23","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.720222+0000","last_change":"2023-12-08T21:25:55.720252+0000","last_active":"2023-12-08T21:25:55.720222+0000","last_peered":"2023-12-08T21:25:55.720222+0000","last_clean":"2023-12-08T21:25:55.720222+0000","last_became_active":"2023-12-08T20:54:56.380927+0000","last_became_peered":"2023-12-08T20:54:56.380927+0000","last_unstale":"2023-12-08T21:25:55.720222+0000","last_undegraded":"2023-12-08T21:25:55.720222+0000","last_fullsized":"2023-12-08T21:25:55.720222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-12-08T21:25:55.720096+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-12-08T21:25:55.720096+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.720096+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:07:37.367406+0000","scrub_duration":0.001780451,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'75","reported_seq":111,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:36.073394+0000","last_change":"2023-12-08T21:26:36.073452+0000","last_active":"2023-12-08T21:26:36.073394+0000","last_peered":"2023-12-08T21:26:36.073394+0000","last_clean":"2023-12-08T21:26:36.073394+0000","last_became_active":"2023-12-08T20:55:04.526605+0000","last_became_peered":"2023-12-08T20:55:04.526605+0000","last_unstale":"2023-12-08T21:26:36.073394+0000","last_undegraded":"2023-12-08T21:26:36.073394+0000","last_fullsized":"2023-12-08T21:26:36.073394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'75","last_scrub_stamp":"2023-12-08T21:26:36.073188+0000","last_deep_scrub":"30'75","last_deep_scrub_stamp":"2023-12-08T21:26:36.073188+0000","last_clean_scrub_stamp":"2023-12-08T21:26:36.073188+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:11:04.385755+0000","scrub_duration":0.0062326710000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'4","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.138425+0000","last_change":"2023-12-08T21:25:59.138488+0000","last_active":"2023-12-08T21:25:59.138425+0000","last_peered":"2023-12-08T21:25:59.138425+0000","last_clean":"2023-12-08T21:25:59.138425+0000","last_became_active":"2023-12-08T20:54:54.926132+0000","last_became_peered":"2023-12-08T20:54:54.926132+0000","last_unstale":"2023-12-08T21:25:59.138425+0000","last_undegraded":"2023-12-08T21:25:59.138425+0000","last_fullsized":"2023-12-08T21:25:59.138425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:25:59.138233+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:25:59.138233+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.138233+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:45:09.492467+0000","scrub_duration":0.0063764290000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.270295+0000","last_change":"2023-12-08T21:25:53.270348+0000","last_active":"2023-12-08T21:25:53.270295+0000","last_peered":"2023-12-08T21:25:53.270295+0000","last_clean":"2023-12-08T21:25:53.270295+0000","last_became_active":"2023-12-08T20:54:56.387528+0000","last_became_peered":"2023-12-08T20:54:56.387528+0000","last_unstale":"2023-12-08T21:25:53.270295+0000","last_undegraded":"2023-12-08T21:25:53.270295+0000","last_fullsized":"2023-12-08T21:25:53.270295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-12-08T21:25:53.270101+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-12-08T21:25:53.270101+0000","last_clean_scrub_stamp":"2023-12-08T21:25:53.270101+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:05:32.821478+0000","scrub_duration":0.0031071860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'65","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:31.052896+0000","last_change":"2023-12-08T21:26:31.052951+0000","last_active":"2023-12-08T21:26:31.052896+0000","last_peered":"2023-12-08T21:26:31.052896+0000","last_clean":"2023-12-08T21:26:31.052896+0000","last_became_active":"2023-12-08T20:55:04.522777+0000","last_became_peered":"2023-12-08T20:55:04.522777+0000","last_unstale":"2023-12-08T21:26:31.052896+0000","last_undegraded":"2023-12-08T21:26:31.052896+0000","last_fullsized":"2023-12-08T21:26:31.052896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'65","last_scrub_stamp":"2023-12-08T21:26:31.052697+0000","last_deep_scrub":"30'65","last_deep_scrub_stamp":"2023-12-08T21:26:31.052697+0000","last_clean_scrub_stamp":"2023-12-08T21:26:31.052697+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:17:32.021452+0000","scrub_duration":0.0065787759999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'17","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:56.220369+0000","last_change":"2023-12-08T21:25:56.220422+0000","last_active":"2023-12-08T21:25:56.220369+0000","last_peered":"2023-12-08T21:25:56.220369+0000","last_clean":"2023-12-08T21:25:56.220369+0000","last_became_active":"2023-12-08T20:54:56.318855+0000","last_became_peered":"2023-12-08T20:54:56.318855+0000","last_unstale":"2023-12-08T21:25:56.220369+0000","last_undegraded":"2023-12-08T21:25:56.220369+0000","last_fullsized":"2023-12-08T21:25:56.220369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:25:56.220174+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:25:56.220174+0000","last_clean_scrub_stamp":"2023-12-08T21:25:56.220174+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:56:56.117995+0000","scrub_duration":0.0032244330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'724","reported_seq":768,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:20.319654+0000","last_change":"2023-12-08T21:26:20.319654+0000","last_active":"2023-12-08T21:26:20.319654+0000","last_peered":"2023-12-08T21:26:20.319654+0000","last_clean":"2023-12-08T21:26:20.319654+0000","last_became_active":"2023-12-08T20:54:54.928702+0000","last_became_peered":"2023-12-08T20:54:54.928702+0000","last_unstale":"2023-12-08T21:26:20.319654+0000","last_undegraded":"2023-12-08T21:26:20.319654+0000","last_fullsized":"2023-12-08T21:26:20.319654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'724","last_scrub_stamp":"2023-12-08T21:26:20.319380+0000","last_deep_scrub":"30'724","last_deep_scrub_stamp":"2023-12-08T21:26:20.319380+0000","last_clean_scrub_stamp":"2023-12-08T21:26:20.319380+0000","objects_scrubbed":2,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:20:37.962997+0000","scrub_duration":0.034444677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'78","reported_seq":116,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:49.452408+0000","last_change":"2023-12-08T21:26:49.452432+0000","last_active":"2023-12-08T21:26:49.452408+0000","last_peered":"2023-12-08T21:26:49.452408+0000","last_clean":"2023-12-08T21:26:49.452408+0000","last_became_active":"2023-12-08T20:55:04.535119+0000","last_became_peered":"2023-12-08T20:55:04.535119+0000","last_unstale":"2023-12-08T21:26:49.452408+0000","last_undegraded":"2023-12-08T21:26:49.452408+0000","last_fullsized":"2023-12-08T21:26:49.452408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'78","last_scrub_stamp":"2023-12-08T21:26:49.452315+0000","last_deep_scrub":"30'78","last_deep_scrub_stamp":"2023-12-08T21:26:49.452315+0000","last_clean_scrub_stamp":"2023-12-08T21:26:49.452315+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:46:22.898222+0000","scrub_duration":0.0048583580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":12383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.326859+0000","last_change":"2023-12-08T21:26:08.326859+0000","last_active":"2023-12-08T21:26:08.326859+0000","last_peered":"2023-12-08T21:26:08.326859+0000","last_clean":"2023-12-08T21:26:08.326859+0000","last_became_active":"2023-12-08T20:54:56.370044+0000","last_became_peered":"2023-12-08T20:54:56.370044+0000","last_unstale":"2023-12-08T21:26:08.326859+0000","last_undegraded":"2023-12-08T21:26:08.326859+0000","last_fullsized":"2023-12-08T21:26:08.326859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2023-12-08T21:26:08.326522+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2023-12-08T21:26:08.326522+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.326522+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:07:31.757565+0000","scrub_duration":0.0050124770000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'5","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:57.537252+0000","last_change":"2023-12-08T21:25:57.537304+0000","last_active":"2023-12-08T21:25:57.537252+0000","last_peered":"2023-12-08T21:25:57.537252+0000","last_clean":"2023-12-08T21:25:57.537252+0000","last_became_active":"2023-12-08T20:54:54.922960+0000","last_became_peered":"2023-12-08T20:54:54.922960+0000","last_unstale":"2023-12-08T21:25:57.537252+0000","last_undegraded":"2023-12-08T21:25:57.537252+0000","last_fullsized":"2023-12-08T21:25:57.537252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:25:57.537058+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:25:57.537058+0000","last_clean_scrub_stamp":"2023-12-08T21:25:57.537058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:59:00.836091+0000","scrub_duration":0.0026381299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'95","reported_seq":133,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:36.246599+0000","last_change":"2023-12-08T21:26:36.246655+0000","last_active":"2023-12-08T21:26:36.246599+0000","last_peered":"2023-12-08T21:26:36.246599+0000","last_clean":"2023-12-08T21:26:36.246599+0000","last_became_active":"2023-12-08T20:55:04.522172+0000","last_became_peered":"2023-12-08T20:55:04.522172+0000","last_unstale":"2023-12-08T21:26:36.246599+0000","last_undegraded":"2023-12-08T21:26:36.246599+0000","last_fullsized":"2023-12-08T21:26:36.246599+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'95","last_scrub_stamp":"2023-12-08T21:26:36.246395+0000","last_deep_scrub":"30'95","last_deep_scrub_stamp":"2023-12-08T21:26:36.246395+0000","last_clean_scrub_stamp":"2023-12-08T21:26:36.246395+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:44:36.664221+0000","scrub_duration":0.0059448610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'24","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.988500+0000","last_change":"2023-12-08T21:26:06.988550+0000","last_active":"2023-12-08T21:26:06.988500+0000","last_peered":"2023-12-08T21:26:06.988500+0000","last_clean":"2023-12-08T21:26:06.988500+0000","last_became_active":"2023-12-08T20:54:56.365552+0000","last_became_peered":"2023-12-08T20:54:56.365552+0000","last_unstale":"2023-12-08T21:26:06.988500+0000","last_undegraded":"2023-12-08T21:26:06.988500+0000","last_fullsized":"2023-12-08T21:26:06.988500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:06.988314+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:06.988314+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.988314+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:03:51.063039+0000","scrub_duration":0.0036073989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'3","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.063454+0000","last_change":"2023-12-08T21:26:01.063563+0000","last_active":"2023-12-08T21:26:01.063454+0000","last_peered":"2023-12-08T21:26:01.063454+0000","last_clean":"2023-12-08T21:26:01.063454+0000","last_became_active":"2023-12-08T20:54:54.979668+0000","last_became_peered":"2023-12-08T20:54:54.979668+0000","last_unstale":"2023-12-08T21:26:01.063454+0000","last_undegraded":"2023-12-08T21:26:01.063454+0000","last_fullsized":"2023-12-08T21:26:01.063454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:26:01.063157+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:26:01.063157+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.063157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:35:10.066399+0000","scrub_duration":0.0036668270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'67","reported_seq":105,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:16.259836+0000","last_change":"2023-12-08T21:26:16.259836+0000","last_active":"2023-12-08T21:26:16.259836+0000","last_peered":"2023-12-08T21:26:16.259836+0000","last_clean":"2023-12-08T21:26:16.259836+0000","last_became_active":"2023-12-08T20:55:04.512549+0000","last_became_peered":"2023-12-08T20:55:04.512549+0000","last_unstale":"2023-12-08T21:26:16.259836+0000","last_undegraded":"2023-12-08T21:26:16.259836+0000","last_fullsized":"2023-12-08T21:26:16.259836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'67","last_scrub_stamp":"2023-12-08T21:26:16.259537+0000","last_deep_scrub":"30'67","last_deep_scrub_stamp":"2023-12-08T21:26:16.259537+0000","last_clean_scrub_stamp":"2023-12-08T21:26:16.259537+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:51:54.386694+0000","scrub_duration":0.005660259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:05.098379+0000","last_change":"2023-12-08T21:26:05.098498+0000","last_active":"2023-12-08T21:26:05.098379+0000","last_peered":"2023-12-08T21:26:05.098379+0000","last_clean":"2023-12-08T21:26:05.098379+0000","last_became_active":"2023-12-08T20:54:56.260355+0000","last_became_peered":"2023-12-08T20:54:56.260355+0000","last_unstale":"2023-12-08T21:26:05.098379+0000","last_undegraded":"2023-12-08T21:26:05.098379+0000","last_fullsized":"2023-12-08T21:26:05.098379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:05.098155+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:05.098155+0000","last_clean_scrub_stamp":"2023-12-08T21:26:05.098155+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:42:49.369328+0000","scrub_duration":0.0031917870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'6","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:00.129273+0000","last_change":"2023-12-08T21:26:00.129326+0000","last_active":"2023-12-08T21:26:00.129273+0000","last_peered":"2023-12-08T21:26:00.129273+0000","last_clean":"2023-12-08T21:26:00.129273+0000","last_became_active":"2023-12-08T20:54:54.925888+0000","last_became_peered":"2023-12-08T20:54:54.925888+0000","last_unstale":"2023-12-08T21:26:00.129273+0000","last_undegraded":"2023-12-08T21:26:00.129273+0000","last_fullsized":"2023-12-08T21:26:00.129273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:26:00.129079+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:26:00.129079+0000","last_clean_scrub_stamp":"2023-12-08T21:26:00.129079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:31:04.788470+0000","scrub_duration":0.002440752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'77","reported_seq":115,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:41.100928+0000","last_change":"2023-12-08T21:26:41.100990+0000","last_active":"2023-12-08T21:26:41.100928+0000","last_peered":"2023-12-08T21:26:41.100928+0000","last_clean":"2023-12-08T21:26:41.100928+0000","last_became_active":"2023-12-08T20:55:04.528640+0000","last_became_peered":"2023-12-08T20:55:04.528640+0000","last_unstale":"2023-12-08T21:26:41.100928+0000","last_undegraded":"2023-12-08T21:26:41.100928+0000","last_fullsized":"2023-12-08T21:26:41.100928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'77","last_scrub_stamp":"2023-12-08T21:26:41.100713+0000","last_deep_scrub":"30'77","last_deep_scrub_stamp":"2023-12-08T21:26:41.100713+0000","last_clean_scrub_stamp":"2023-12-08T21:26:41.100713+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:55:30.113824+0000","scrub_duration":0.0074332440000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.094936+0000","last_change":"2023-12-08T21:25:55.094987+0000","last_active":"2023-12-08T21:25:55.094936+0000","last_peered":"2023-12-08T21:25:55.094936+0000","last_clean":"2023-12-08T21:25:55.094936+0000","last_became_active":"2023-12-08T20:54:56.364597+0000","last_became_peered":"2023-12-08T20:54:56.364597+0000","last_unstale":"2023-12-08T21:25:55.094936+0000","last_undegraded":"2023-12-08T21:25:55.094936+0000","last_fullsized":"2023-12-08T21:25:55.094936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-12-08T21:25:55.094713+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-12-08T21:25:55.094713+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.094713+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:04:47.008353+0000","scrub_duration":0.00344094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'6","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:29.259458+0000","last_change":"2023-12-08T21:26:29.259541+0000","last_active":"2023-12-08T21:26:29.259458+0000","last_peered":"2023-12-08T21:26:29.259458+0000","last_clean":"2023-12-08T21:26:29.259458+0000","last_became_active":"2023-12-08T20:54:54.927814+0000","last_became_peered":"2023-12-08T20:54:54.927814+0000","last_unstale":"2023-12-08T21:26:29.259458+0000","last_undegraded":"2023-12-08T21:26:29.259458+0000","last_fullsized":"2023-12-08T21:26:29.259458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:26:29.259239+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:26:29.259239+0000","last_clean_scrub_stamp":"2023-12-08T21:26:29.259239+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:15:48.929649+0000","scrub_duration":0.0064215950000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'64","reported_seq":103,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:49.086323+0000","last_change":"2023-12-08T21:26:49.086441+0000","last_active":"2023-12-08T21:26:49.086323+0000","last_peered":"2023-12-08T21:26:49.086323+0000","last_clean":"2023-12-08T21:26:49.086323+0000","last_became_active":"2023-12-08T20:55:04.522714+0000","last_became_peered":"2023-12-08T20:55:04.522714+0000","last_unstale":"2023-12-08T21:26:49.086323+0000","last_undegraded":"2023-12-08T21:26:49.086323+0000","last_fullsized":"2023-12-08T21:26:49.086323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'64","last_scrub_stamp":"2023-12-08T21:26:49.085974+0000","last_deep_scrub":"30'64","last_deep_scrub_stamp":"2023-12-08T21:26:49.085974+0000","last_clean_scrub_stamp":"2023-12-08T21:26:49.085974+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:04:16.267852+0000","scrub_duration":0.0075080989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":9451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.956170+0000","last_change":"2023-12-08T21:26:17.956227+0000","last_active":"2023-12-08T21:26:17.956170+0000","last_peered":"2023-12-08T21:26:17.956170+0000","last_clean":"2023-12-08T21:26:17.956170+0000","last_became_active":"2023-12-08T20:54:56.330508+0000","last_became_peered":"2023-12-08T20:54:56.330508+0000","last_unstale":"2023-12-08T21:26:17.956170+0000","last_undegraded":"2023-12-08T21:26:17.956170+0000","last_fullsized":"2023-12-08T21:26:17.956170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:17.955970+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:17.955970+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.955970+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:06:44.699142+0000","scrub_duration":0.0048835149999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'333","reported_seq":377,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:02.992564+0000","last_change":"2023-12-08T21:26:02.992617+0000","last_active":"2023-12-08T21:26:02.992564+0000","last_peered":"2023-12-08T21:26:02.992564+0000","last_clean":"2023-12-08T21:26:02.992564+0000","last_became_active":"2023-12-08T20:54:54.981168+0000","last_became_peered":"2023-12-08T20:54:54.981168+0000","last_unstale":"2023-12-08T21:26:02.992564+0000","last_undegraded":"2023-12-08T21:26:02.992564+0000","last_fullsized":"2023-12-08T21:26:02.992564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'333","last_scrub_stamp":"2023-12-08T21:26:02.992373+0000","last_deep_scrub":"30'333","last_deep_scrub_stamp":"2023-12-08T21:26:02.992373+0000","last_clean_scrub_stamp":"2023-12-08T21:26:02.992373+0000","objects_scrubbed":1,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:49:36.659212+0000","scrub_duration":0.013256799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'104","reported_seq":143,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:22.992858+0000","last_change":"2023-12-08T21:26:22.992885+0000","last_active":"2023-12-08T21:26:22.992858+0000","last_peered":"2023-12-08T21:26:22.992858+0000","last_clean":"2023-12-08T21:26:22.992858+0000","last_became_active":"2023-12-08T20:55:04.511032+0000","last_became_peered":"2023-12-08T20:55:04.511032+0000","last_unstale":"2023-12-08T21:26:22.992858+0000","last_undegraded":"2023-12-08T21:26:22.992858+0000","last_fullsized":"2023-12-08T21:26:22.992858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'104","last_scrub_stamp":"2023-12-08T21:26:22.992736+0000","last_deep_scrub":"30'104","last_deep_scrub_stamp":"2023-12-08T21:26:22.992736+0000","last_clean_scrub_stamp":"2023-12-08T21:26:22.992736+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:20:50.133005+0000","scrub_duration":0.0062269689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":14212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'22","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.466208+0000","last_change":"2023-12-08T21:26:06.466208+0000","last_active":"2023-12-08T21:26:06.466208+0000","last_peered":"2023-12-08T21:26:06.466208+0000","last_clean":"2023-12-08T21:26:06.466208+0000","last_became_active":"2023-12-08T20:54:56.409291+0000","last_became_peered":"2023-12-08T20:54:56.409291+0000","last_unstale":"2023-12-08T21:26:06.466208+0000","last_undegraded":"2023-12-08T21:26:06.466208+0000","last_fullsized":"2023-12-08T21:26:06.466208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:06.465949+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:06.465949+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.465949+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:01:20.008768+0000","scrub_duration":0.0028777999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'5","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:24.230287+0000","last_change":"2023-12-08T21:26:24.230339+0000","last_active":"2023-12-08T21:26:24.230287+0000","last_peered":"2023-12-08T21:26:24.230287+0000","last_clean":"2023-12-08T21:26:24.230287+0000","last_became_active":"2023-12-08T20:54:54.978416+0000","last_became_peered":"2023-12-08T20:54:54.978416+0000","last_unstale":"2023-12-08T21:26:24.230287+0000","last_undegraded":"2023-12-08T21:26:24.230287+0000","last_fullsized":"2023-12-08T21:26:24.230287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:24.230104+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:24.230104+0000","last_clean_scrub_stamp":"2023-12-08T21:26:24.230104+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:02:35.315437+0000","scrub_duration":0.0024408920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'75","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:25.600755+0000","last_change":"2023-12-08T21:26:25.600817+0000","last_active":"2023-12-08T21:26:25.600755+0000","last_peered":"2023-12-08T21:26:25.600755+0000","last_clean":"2023-12-08T21:26:25.600755+0000","last_became_active":"2023-12-08T20:55:04.507454+0000","last_became_peered":"2023-12-08T20:55:04.507454+0000","last_unstale":"2023-12-08T21:26:25.600755+0000","last_undegraded":"2023-12-08T21:26:25.600755+0000","last_fullsized":"2023-12-08T21:26:25.600755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'75","last_scrub_stamp":"2023-12-08T21:26:25.600621+0000","last_deep_scrub":"30'75","last_deep_scrub_stamp":"2023-12-08T21:26:25.600621+0000","last_clean_scrub_stamp":"2023-12-08T21:26:25.600621+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:30:14.904992+0000","scrub_duration":0.0057153899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'17","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.919895+0000","last_change":"2023-12-08T21:25:55.919895+0000","last_active":"2023-12-08T21:25:55.919895+0000","last_peered":"2023-12-08T21:25:55.919895+0000","last_clean":"2023-12-08T21:25:55.919895+0000","last_became_active":"2023-12-08T20:54:56.369974+0000","last_became_peered":"2023-12-08T20:54:56.369974+0000","last_unstale":"2023-12-08T21:25:55.919895+0000","last_undegraded":"2023-12-08T21:25:55.919895+0000","last_fullsized":"2023-12-08T21:25:55.919895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:25:55.919642+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:25:55.919642+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.919642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:26:40.855619+0000","scrub_duration":0.0027648270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'3","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.967650+0000","last_change":"2023-12-08T21:26:08.967650+0000","last_active":"2023-12-08T21:26:08.967650+0000","last_peered":"2023-12-08T21:26:08.967650+0000","last_clean":"2023-12-08T21:26:08.967650+0000","last_became_active":"2023-12-08T20:54:54.925022+0000","last_became_peered":"2023-12-08T20:54:54.925022+0000","last_unstale":"2023-12-08T21:26:08.967650+0000","last_undegraded":"2023-12-08T21:26:08.967650+0000","last_fullsized":"2023-12-08T21:26:08.967650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:26:08.967384+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:26:08.967384+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.967384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:00:44.981669+0000","scrub_duration":0.0030121089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'85","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:28.727979+0000","last_change":"2023-12-08T21:26:28.728039+0000","last_active":"2023-12-08T21:26:28.727979+0000","last_peered":"2023-12-08T21:26:28.727979+0000","last_clean":"2023-12-08T21:26:28.727979+0000","last_became_active":"2023-12-08T20:55:04.530774+0000","last_became_peered":"2023-12-08T20:55:04.530774+0000","last_unstale":"2023-12-08T21:26:28.727979+0000","last_undegraded":"2023-12-08T21:26:28.727979+0000","last_fullsized":"2023-12-08T21:26:28.727979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'85","last_scrub_stamp":"2023-12-08T21:26:28.727787+0000","last_deep_scrub":"30'85","last_deep_scrub_stamp":"2023-12-08T21:26:28.727787+0000","last_clean_scrub_stamp":"2023-12-08T21:26:28.727787+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:17:55.250169+0000","scrub_duration":0.0057543309999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:48.955617+0000","last_change":"2023-12-08T21:25:48.955617+0000","last_active":"2023-12-08T21:25:48.955617+0000","last_peered":"2023-12-08T21:25:48.955617+0000","last_clean":"2023-12-08T21:25:48.955617+0000","last_became_active":"2023-12-08T20:54:56.385090+0000","last_became_peered":"2023-12-08T20:54:56.385090+0000","last_unstale":"2023-12-08T21:25:48.955617+0000","last_undegraded":"2023-12-08T21:25:48.955617+0000","last_fullsized":"2023-12-08T21:25:48.955617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:25:48.955488+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:25:48.955488+0000","last_clean_scrub_stamp":"2023-12-08T21:25:48.955488+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:12:34.372718+0000","scrub_duration":0.001815419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'6","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:30.222450+0000","last_change":"2023-12-08T21:26:30.222503+0000","last_active":"2023-12-08T21:26:30.222450+0000","last_peered":"2023-12-08T21:26:30.222450+0000","last_clean":"2023-12-08T21:26:30.222450+0000","last_became_active":"2023-12-08T20:54:54.932121+0000","last_became_peered":"2023-12-08T20:54:54.932121+0000","last_unstale":"2023-12-08T21:26:30.222450+0000","last_undegraded":"2023-12-08T21:26:30.222450+0000","last_fullsized":"2023-12-08T21:26:30.222450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:26:30.222251+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:26:30.222251+0000","last_clean_scrub_stamp":"2023-12-08T21:26:30.222251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:37:07.100059+0000","scrub_duration":0.0031246490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'55","reported_seq":94,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:33.736029+0000","last_change":"2023-12-08T21:26:33.736089+0000","last_active":"2023-12-08T21:26:33.736029+0000","last_peered":"2023-12-08T21:26:33.736029+0000","last_clean":"2023-12-08T21:26:33.736029+0000","last_became_active":"2023-12-08T20:55:04.528698+0000","last_became_peered":"2023-12-08T20:55:04.528698+0000","last_unstale":"2023-12-08T21:26:33.736029+0000","last_undegraded":"2023-12-08T21:26:33.736029+0000","last_fullsized":"2023-12-08T21:26:33.736029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'55","last_scrub_stamp":"2023-12-08T21:26:33.735880+0000","last_deep_scrub":"30'55","last_deep_scrub_stamp":"2023-12-08T21:26:33.735880+0000","last_clean_scrub_stamp":"2023-12-08T21:26:33.735880+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:51:26.467490+0000","scrub_duration":0.0055649899999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:33.929239+0000","last_change":"2023-12-08T21:26:33.929295+0000","last_active":"2023-12-08T21:26:33.929239+0000","last_peered":"2023-12-08T21:26:33.929239+0000","last_clean":"2023-12-08T21:26:33.929239+0000","last_became_active":"2023-12-08T20:54:56.412786+0000","last_became_peered":"2023-12-08T20:54:56.412786+0000","last_unstale":"2023-12-08T21:26:33.929239+0000","last_undegraded":"2023-12-08T21:26:33.929239+0000","last_fullsized":"2023-12-08T21:26:33.929239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:33.929031+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:33.929031+0000","last_clean_scrub_stamp":"2023-12-08T21:26:33.929031+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:39:06.696933+0000","scrub_duration":0.0034301499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'577","reported_seq":1196,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:05.340354+0000","last_change":"2023-12-08T21:26:05.340354+0000","last_active":"2023-12-08T21:26:05.340354+0000","last_peered":"2023-12-08T21:26:05.340354+0000","last_clean":"2023-12-08T21:26:05.340354+0000","last_became_active":"2023-12-08T20:54:54.922014+0000","last_became_peered":"2023-12-08T20:54:54.922014+0000","last_unstale":"2023-12-08T21:26:05.340354+0000","last_undegraded":"2023-12-08T21:26:05.340354+0000","last_fullsized":"2023-12-08T21:26:05.340354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'577","last_scrub_stamp":"2023-12-08T21:26:05.340116+0000","last_deep_scrub":"30'577","last_deep_scrub_stamp":"2023-12-08T21:26:05.340116+0000","last_clean_scrub_stamp":"2023-12-08T21:26:05.340116+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:25.924782+0000","scrub_duration":0.0067660819999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125475,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":574,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'71","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:32.720257+0000","last_change":"2023-12-08T21:26:32.720313+0000","last_active":"2023-12-08T21:26:32.720257+0000","last_peered":"2023-12-08T21:26:32.720257+0000","last_clean":"2023-12-08T21:26:32.720257+0000","last_became_active":"2023-12-08T20:55:04.508219+0000","last_became_peered":"2023-12-08T20:55:04.508219+0000","last_unstale":"2023-12-08T21:26:32.720257+0000","last_undegraded":"2023-12-08T21:26:32.720257+0000","last_fullsized":"2023-12-08T21:26:32.720257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'71","last_scrub_stamp":"2023-12-08T21:26:32.720060+0000","last_deep_scrub":"30'71","last_deep_scrub_stamp":"2023-12-08T21:26:32.720060+0000","last_clean_scrub_stamp":"2023-12-08T21:26:32.720060+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:08:42.229813+0000","scrub_duration":0.0047733469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'15","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.515080+0000","last_change":"2023-12-08T21:26:01.515080+0000","last_active":"2023-12-08T21:26:01.515080+0000","last_peered":"2023-12-08T21:26:01.515080+0000","last_clean":"2023-12-08T21:26:01.515080+0000","last_became_active":"2023-12-08T20:54:56.370121+0000","last_became_peered":"2023-12-08T20:54:56.370121+0000","last_unstale":"2023-12-08T21:26:01.515080+0000","last_undegraded":"2023-12-08T21:26:01.515080+0000","last_fullsized":"2023-12-08T21:26:01.515080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2023-12-08T21:26:01.514730+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2023-12-08T21:26:01.514730+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.514730+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:38:40.393317+0000","scrub_duration":0.0030279830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'5","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:19.277707+0000","last_change":"2023-12-08T21:26:19.277760+0000","last_active":"2023-12-08T21:26:19.277707+0000","last_peered":"2023-12-08T21:26:19.277707+0000","last_clean":"2023-12-08T21:26:19.277707+0000","last_became_active":"2023-12-08T20:54:54.927120+0000","last_became_peered":"2023-12-08T20:54:54.927120+0000","last_unstale":"2023-12-08T21:26:19.277707+0000","last_undegraded":"2023-12-08T21:26:19.277707+0000","last_fullsized":"2023-12-08T21:26:19.277707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:19.277517+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:19.277517+0000","last_clean_scrub_stamp":"2023-12-08T21:26:19.277517+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:23:11.851788+0000","scrub_duration":0.0053390110000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'100","reported_seq":130,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:24.118553+0000","last_change":"2023-12-08T20:55:04.546945+0000","last_active":"2023-12-08T21:25:24.118553+0000","last_peered":"2023-12-08T21:25:24.118553+0000","last_clean":"2023-12-08T21:25:24.118553+0000","last_became_active":"2023-12-08T20:55:04.546439+0000","last_became_peered":"2023-12-08T20:55:04.546439+0000","last_unstale":"2023-12-08T21:25:24.118553+0000","last_undegraded":"2023-12-08T21:25:24.118553+0000","last_fullsized":"2023-12-08T21:25:24.118553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'20","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.022881+0000","last_change":"2023-12-08T21:26:08.022881+0000","last_active":"2023-12-08T21:26:08.022881+0000","last_peered":"2023-12-08T21:26:08.022881+0000","last_clean":"2023-12-08T21:26:08.022881+0000","last_became_active":"2023-12-08T20:54:56.372205+0000","last_became_peered":"2023-12-08T20:54:56.372205+0000","last_unstale":"2023-12-08T21:26:08.022881+0000","last_undegraded":"2023-12-08T21:26:08.022881+0000","last_fullsized":"2023-12-08T21:26:08.022881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:08.022557+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:08.022557+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.022557+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:31:12.681949+0000","scrub_duration":0.0030864669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'2","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:22.310608+0000","last_change":"2023-12-08T21:26:22.310661+0000","last_active":"2023-12-08T21:26:22.310608+0000","last_peered":"2023-12-08T21:26:22.310608+0000","last_clean":"2023-12-08T21:26:22.310608+0000","last_became_active":"2023-12-08T20:54:54.929177+0000","last_became_peered":"2023-12-08T20:54:54.929177+0000","last_unstale":"2023-12-08T21:26:22.310608+0000","last_undegraded":"2023-12-08T21:26:22.310608+0000","last_fullsized":"2023-12-08T21:26:22.310608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-08T21:26:22.310416+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-08T21:26:22.310416+0000","last_clean_scrub_stamp":"2023-12-08T21:26:22.310416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:33:18.117971+0000","scrub_duration":0.0028091259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":200,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:50.676647+0000","last_change":"2023-12-08T21:25:50.676647+0000","last_active":"2023-12-08T21:25:50.676647+0000","last_peered":"2023-12-08T21:25:50.676647+0000","last_clean":"2023-12-08T21:25:50.676647+0000","last_became_active":"2023-12-08T20:54:16.147507+0000","last_became_peered":"2023-12-08T20:54:16.147507+0000","last_unstale":"2023-12-08T21:25:50.676647+0000","last_undegraded":"2023-12-08T21:25:50.676647+0000","last_fullsized":"2023-12-08T21:25:50.676647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-12-08T21:25:50.676240+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-12-08T21:25:50.676240+0000","last_clean_scrub_stamp":"2023-12-08T21:25:50.676240+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:06:52.271476+0000","scrub_duration":0.014230578000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'75","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:38.381119+0000","last_change":"2023-12-08T21:26:38.381184+0000","last_active":"2023-12-08T21:26:38.381119+0000","last_peered":"2023-12-08T21:26:38.381119+0000","last_clean":"2023-12-08T21:26:38.381119+0000","last_became_active":"2023-12-08T20:55:04.515200+0000","last_became_peered":"2023-12-08T20:55:04.515200+0000","last_unstale":"2023-12-08T21:26:38.381119+0000","last_undegraded":"2023-12-08T21:26:38.381119+0000","last_fullsized":"2023-12-08T21:26:38.381119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'75","last_scrub_stamp":"2023-12-08T21:26:38.380934+0000","last_deep_scrub":"30'75","last_deep_scrub_stamp":"2023-12-08T21:26:38.380934+0000","last_clean_scrub_stamp":"2023-12-08T21:26:38.380934+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:35:52.967123+0000","scrub_duration":0.0095457140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'22","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:31.195729+0000","last_change":"2023-12-08T21:26:31.195849+0000","last_active":"2023-12-08T21:26:31.195729+0000","last_peered":"2023-12-08T21:26:31.195729+0000","last_clean":"2023-12-08T21:26:31.195729+0000","last_became_active":"2023-12-08T20:54:56.318408+0000","last_became_peered":"2023-12-08T20:54:56.318408+0000","last_unstale":"2023-12-08T21:26:31.195729+0000","last_undegraded":"2023-12-08T21:26:31.195729+0000","last_fullsized":"2023-12-08T21:26:31.195729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:31.195456+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:31.195456+0000","last_clean_scrub_stamp":"2023-12-08T21:26:31.195456+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:45:47.203860+0000","scrub_duration":0.0030641639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'4","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.531853+0000","last_change":"2023-12-08T21:25:59.531853+0000","last_active":"2023-12-08T21:25:59.531853+0000","last_peered":"2023-12-08T21:25:59.531853+0000","last_clean":"2023-12-08T21:25:59.531853+0000","last_became_active":"2023-12-08T20:54:54.925610+0000","last_became_peered":"2023-12-08T20:54:54.925610+0000","last_unstale":"2023-12-08T21:25:59.531853+0000","last_undegraded":"2023-12-08T21:25:59.531853+0000","last_fullsized":"2023-12-08T21:25:59.531853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:25:59.531609+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:25:59.531609+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.531609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:03:16.867575+0000","scrub_duration":0.0031837789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'78","reported_seq":116,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:50.996636+0000","last_change":"2023-12-08T21:26:50.996692+0000","last_active":"2023-12-08T21:26:50.996636+0000","last_peered":"2023-12-08T21:26:50.996636+0000","last_clean":"2023-12-08T21:26:50.996636+0000","last_became_active":"2023-12-08T20:55:04.522245+0000","last_became_peered":"2023-12-08T20:55:04.522245+0000","last_unstale":"2023-12-08T21:26:50.996636+0000","last_undegraded":"2023-12-08T21:26:50.996636+0000","last_fullsized":"2023-12-08T21:26:50.996636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'78","last_scrub_stamp":"2023-12-08T21:26:50.996424+0000","last_deep_scrub":"30'78","last_deep_scrub_stamp":"2023-12-08T21:26:50.996424+0000","last_clean_scrub_stamp":"2023-12-08T21:26:50.996424+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:27:51.845140+0000","scrub_duration":0.0068877979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:16.119078+0000","last_change":"2023-12-08T21:26:16.119078+0000","last_active":"2023-12-08T21:26:16.119078+0000","last_peered":"2023-12-08T21:26:16.119078+0000","last_clean":"2023-12-08T21:26:16.119078+0000","last_became_active":"2023-12-08T20:54:56.377762+0000","last_became_peered":"2023-12-08T20:54:56.377762+0000","last_unstale":"2023-12-08T21:26:16.119078+0000","last_undegraded":"2023-12-08T21:26:16.119078+0000","last_fullsized":"2023-12-08T21:26:16.119078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:16.118716+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:16.118716+0000","last_clean_scrub_stamp":"2023-12-08T21:26:16.118716+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:28:44.731995+0000","scrub_duration":0.0036787600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'5","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:11.909020+0000","last_change":"2023-12-08T21:26:11.909020+0000","last_active":"2023-12-08T21:26:11.909020+0000","last_peered":"2023-12-08T21:26:11.909020+0000","last_clean":"2023-12-08T21:26:11.909020+0000","last_became_active":"2023-12-08T20:54:54.935472+0000","last_became_peered":"2023-12-08T20:54:54.935472+0000","last_unstale":"2023-12-08T21:26:11.909020+0000","last_undegraded":"2023-12-08T21:26:11.909020+0000","last_fullsized":"2023-12-08T21:26:11.909020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:11.908761+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:11.908761+0000","last_clean_scrub_stamp":"2023-12-08T21:26:11.908761+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:47:38.208187+0000","scrub_duration":0.0077929649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'94","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.790957+0000","last_change":"2023-12-08T20:55:04.534674+0000","last_active":"2023-12-08T21:25:53.790957+0000","last_peered":"2023-12-08T21:25:53.790957+0000","last_clean":"2023-12-08T21:25:53.790957+0000","last_became_active":"2023-12-08T20:55:04.533305+0000","last_became_peered":"2023-12-08T20:55:04.533305+0000","last_unstale":"2023-12-08T21:25:53.790957+0000","last_undegraded":"2023-12-08T21:25:53.790957+0000","last_fullsized":"2023-12-08T21:25:53.790957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":6556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'24","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:52.008697+0000","last_change":"2023-12-08T21:25:52.008697+0000","last_active":"2023-12-08T21:25:52.008697+0000","last_peered":"2023-12-08T21:25:52.008697+0000","last_clean":"2023-12-08T21:25:52.008697+0000","last_became_active":"2023-12-08T20:54:56.379933+0000","last_became_peered":"2023-12-08T20:54:56.379933+0000","last_unstale":"2023-12-08T21:25:52.008697+0000","last_undegraded":"2023-12-08T21:25:52.008697+0000","last_fullsized":"2023-12-08T21:25:52.008697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:25:52.008566+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:25:52.008566+0000","last_clean_scrub_stamp":"2023-12-08T21:25:52.008566+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:27:19.773108+0000","scrub_duration":0.001762434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'5","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.012158+0000","last_change":"2023-12-08T21:26:06.012158+0000","last_active":"2023-12-08T21:26:06.012158+0000","last_peered":"2023-12-08T21:26:06.012158+0000","last_clean":"2023-12-08T21:26:06.012158+0000","last_became_active":"2023-12-08T20:54:54.982414+0000","last_became_peered":"2023-12-08T20:54:54.982414+0000","last_unstale":"2023-12-08T21:26:06.012158+0000","last_undegraded":"2023-12-08T21:26:06.012158+0000","last_fullsized":"2023-12-08T21:26:06.012158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:06.011895+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:06.011895+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.011895+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:09:55.169141+0000","scrub_duration":0.0062428880000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'68","reported_seq":106,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:48.483476+0000","last_change":"2023-12-08T21:26:48.483617+0000","last_active":"2023-12-08T21:26:48.483476+0000","last_peered":"2023-12-08T21:26:48.483476+0000","last_clean":"2023-12-08T21:26:48.483476+0000","last_became_active":"2023-12-08T20:55:04.514907+0000","last_became_peered":"2023-12-08T20:55:04.514907+0000","last_unstale":"2023-12-08T21:26:48.483476+0000","last_undegraded":"2023-12-08T21:26:48.483476+0000","last_fullsized":"2023-12-08T21:26:48.483476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'68","last_scrub_stamp":"2023-12-08T21:26:48.483236+0000","last_deep_scrub":"30'68","last_deep_scrub_stamp":"2023-12-08T21:26:48.483236+0000","last_clean_scrub_stamp":"2023-12-08T21:26:48.483236+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:14:24.424288+0000","scrub_duration":0.0086099469999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.997391+0000","last_change":"2023-12-08T21:25:53.997391+0000","last_active":"2023-12-08T21:25:53.997391+0000","last_peered":"2023-12-08T21:25:53.997391+0000","last_clean":"2023-12-08T21:25:53.997391+0000","last_became_active":"2023-12-08T20:54:56.377430+0000","last_became_peered":"2023-12-08T20:54:56.377430+0000","last_unstale":"2023-12-08T21:25:53.997391+0000","last_undegraded":"2023-12-08T21:25:53.997391+0000","last_fullsized":"2023-12-08T21:25:53.997391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2023-12-08T21:25:53.997259+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2023-12-08T21:25:53.997259+0000","last_clean_scrub_stamp":"2023-12-08T21:25:53.997259+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:43:24.527309+0000","scrub_duration":0.0013451629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'4","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:02.148544+0000","last_change":"2023-12-08T21:26:02.148544+0000","last_active":"2023-12-08T21:26:02.148544+0000","last_peered":"2023-12-08T21:26:02.148544+0000","last_clean":"2023-12-08T21:26:02.148544+0000","last_became_active":"2023-12-08T20:54:54.926386+0000","last_became_peered":"2023-12-08T20:54:54.926386+0000","last_unstale":"2023-12-08T21:26:02.148544+0000","last_undegraded":"2023-12-08T21:26:02.148544+0000","last_fullsized":"2023-12-08T21:26:02.148544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:26:02.148292+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:26:02.148292+0000","last_clean_scrub_stamp":"2023-12-08T21:26:02.148292+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:05:49.099297+0000","scrub_duration":0.0069923229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'113","reported_seq":151,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:12.893870+0000","last_change":"2023-12-08T21:26:12.893986+0000","last_active":"2023-12-08T21:26:12.893870+0000","last_peered":"2023-12-08T21:26:12.893870+0000","last_clean":"2023-12-08T21:26:12.893870+0000","last_became_active":"2023-12-08T20:55:04.523074+0000","last_became_peered":"2023-12-08T20:55:04.523074+0000","last_unstale":"2023-12-08T21:26:12.893870+0000","last_undegraded":"2023-12-08T21:26:12.893870+0000","last_fullsized":"2023-12-08T21:26:12.893870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'113","last_scrub_stamp":"2023-12-08T21:26:12.893631+0000","last_deep_scrub":"30'113","last_deep_scrub_stamp":"2023-12-08T21:26:12.893631+0000","last_clean_scrub_stamp":"2023-12-08T21:26:12.893631+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:22:11.324216+0000","scrub_duration":0.0069858769999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":11577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:10.138076+0000","last_change":"2023-12-08T21:26:10.138136+0000","last_active":"2023-12-08T21:26:10.138076+0000","last_peered":"2023-12-08T21:26:10.138076+0000","last_clean":"2023-12-08T21:26:10.138076+0000","last_became_active":"2023-12-08T20:54:56.371132+0000","last_became_peered":"2023-12-08T20:54:56.371132+0000","last_unstale":"2023-12-08T21:26:10.138076+0000","last_undegraded":"2023-12-08T21:26:10.138076+0000","last_fullsized":"2023-12-08T21:26:10.138076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:10.137863+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:10.137863+0000","last_clean_scrub_stamp":"2023-12-08T21:26:10.137863+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:21.181423+0000","scrub_duration":0.0030374600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'18","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:58.116724+0000","last_change":"2023-12-08T21:25:58.116788+0000","last_active":"2023-12-08T21:25:58.116724+0000","last_peered":"2023-12-08T21:25:58.116724+0000","last_clean":"2023-12-08T21:25:58.116724+0000","last_became_active":"2023-12-08T20:54:54.984661+0000","last_became_peered":"2023-12-08T20:54:54.984661+0000","last_unstale":"2023-12-08T21:25:58.116724+0000","last_undegraded":"2023-12-08T21:25:58.116724+0000","last_fullsized":"2023-12-08T21:25:58.116724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:25:58.116543+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:25:58.116543+0000","last_clean_scrub_stamp":"2023-12-08T21:25:58.116543+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:16.122167+0000","scrub_duration":0.0098436089999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'88","reported_seq":125,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:38.912940+0000","last_change":"2023-12-08T21:26:38.912999+0000","last_active":"2023-12-08T21:26:38.912940+0000","last_peered":"2023-12-08T21:26:38.912940+0000","last_clean":"2023-12-08T21:26:38.912940+0000","last_became_active":"2023-12-08T20:55:04.541074+0000","last_became_peered":"2023-12-08T20:55:04.541074+0000","last_unstale":"2023-12-08T21:26:38.912940+0000","last_undegraded":"2023-12-08T21:26:38.912940+0000","last_fullsized":"2023-12-08T21:26:38.912940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'88","last_scrub_stamp":"2023-12-08T21:26:38.912733+0000","last_deep_scrub":"30'88","last_deep_scrub_stamp":"2023-12-08T21:26:38.912733+0000","last_clean_scrub_stamp":"2023-12-08T21:26:38.912733+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:44:57.786431+0000","scrub_duration":0.0074736400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'20","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.783826+0000","last_change":"2023-12-08T21:26:01.783879+0000","last_active":"2023-12-08T21:26:01.783826+0000","last_peered":"2023-12-08T21:26:01.783826+0000","last_clean":"2023-12-08T21:26:01.783826+0000","last_became_active":"2023-12-08T20:54:56.413023+0000","last_became_peered":"2023-12-08T20:54:56.413023+0000","last_unstale":"2023-12-08T21:26:01.783826+0000","last_undegraded":"2023-12-08T21:26:01.783826+0000","last_fullsized":"2023-12-08T21:26:01.783826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:01.783626+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:01.783626+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.783626+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:22.368293+0000","scrub_duration":0.0030916820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'1","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:09.105683+0000","last_change":"2023-12-08T21:26:09.105734+0000","last_active":"2023-12-08T21:26:09.105683+0000","last_peered":"2023-12-08T21:26:09.105683+0000","last_clean":"2023-12-08T21:26:09.105683+0000","last_became_active":"2023-12-08T20:54:54.928543+0000","last_became_peered":"2023-12-08T20:54:54.928543+0000","last_unstale":"2023-12-08T21:26:09.105683+0000","last_undegraded":"2023-12-08T21:26:09.105683+0000","last_fullsized":"2023-12-08T21:26:09.105683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-08T21:26:09.105497+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-08T21:26:09.105497+0000","last_clean_scrub_stamp":"2023-12-08T21:26:09.105497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:15:16.777211+0000","scrub_duration":0.0026113529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'85","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.791199+0000","last_change":"2023-12-08T20:55:04.540347+0000","last_active":"2023-12-08T21:25:53.791199+0000","last_peered":"2023-12-08T21:25:53.791199+0000","last_clean":"2023-12-08T21:25:53.791199+0000","last_became_active":"2023-12-08T20:55:04.535002+0000","last_became_peered":"2023-12-08T20:55:04.535002+0000","last_unstale":"2023-12-08T21:25:53.791199+0000","last_undegraded":"2023-12-08T21:25:53.791199+0000","last_fullsized":"2023-12-08T21:25:53.791199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'40","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:37.526660+0000","last_change":"2023-12-08T20:56:00.382392+0000","last_active":"2023-12-08T21:25:37.526660+0000","last_peered":"2023-12-08T21:25:37.526660+0000","last_clean":"2023-12-08T21:25:37.526660+0000","last_became_active":"2023-12-08T20:56:00.381771+0000","last_became_peered":"2023-12-08T20:56:00.381771+0000","last_unstale":"2023-12-08T21:25:37.526660+0000","last_undegraded":"2023-12-08T21:25:37.526660+0000","last_fullsized":"2023-12-08T21:25:37.526660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:54:54.559919+0000","last_clean_scrub_stamp":"2023-12-08T20:54:54.559919+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'5","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:26.254290+0000","last_change":"2023-12-08T21:26:26.254343+0000","last_active":"2023-12-08T21:26:26.254290+0000","last_peered":"2023-12-08T21:26:26.254290+0000","last_clean":"2023-12-08T21:26:26.254290+0000","last_became_active":"2023-12-08T20:54:54.928065+0000","last_became_peered":"2023-12-08T20:54:54.928065+0000","last_unstale":"2023-12-08T21:26:26.254290+0000","last_undegraded":"2023-12-08T21:26:26.254290+0000","last_fullsized":"2023-12-08T21:26:26.254290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:26.254093+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:26.254093+0000","last_clean_scrub_stamp":"2023-12-08T21:26:26.254093+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:53:12.765582+0000","scrub_duration":0.0032426040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'59","reported_seq":96,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:36.762487+0000","last_change":"2023-12-08T21:26:36.762546+0000","last_active":"2023-12-08T21:26:36.762487+0000","last_peered":"2023-12-08T21:26:36.762487+0000","last_clean":"2023-12-08T21:26:36.762487+0000","last_became_active":"2023-12-08T20:55:04.516783+0000","last_became_peered":"2023-12-08T20:55:04.516783+0000","last_unstale":"2023-12-08T21:26:36.762487+0000","last_undegraded":"2023-12-08T21:26:36.762487+0000","last_fullsized":"2023-12-08T21:26:36.762487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'59","last_scrub_stamp":"2023-12-08T21:26:36.762262+0000","last_deep_scrub":"30'59","last_deep_scrub_stamp":"2023-12-08T21:26:36.762262+0000","last_clean_scrub_stamp":"2023-12-08T21:26:36.762262+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:45:57.057694+0000","scrub_duration":0.005678425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:24.559076+0000","last_change":"2023-12-08T21:26:24.559130+0000","last_active":"2023-12-08T21:26:24.559076+0000","last_peered":"2023-12-08T21:26:24.559076+0000","last_clean":"2023-12-08T21:26:24.559076+0000","last_became_active":"2023-12-08T20:54:56.330346+0000","last_became_peered":"2023-12-08T20:54:56.330346+0000","last_unstale":"2023-12-08T21:26:24.559076+0000","last_undegraded":"2023-12-08T21:26:24.559076+0000","last_fullsized":"2023-12-08T21:26:24.559076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:24.558877+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:24.558877+0000","last_clean_scrub_stamp":"2023-12-08T21:26:24.558877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:01:23.818334+0000","scrub_duration":0.002404836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'6","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:58.290149+0000","last_change":"2023-12-08T21:25:58.290260+0000","last_active":"2023-12-08T21:25:58.290149+0000","last_peered":"2023-12-08T21:25:58.290149+0000","last_clean":"2023-12-08T21:25:58.290149+0000","last_became_active":"2023-12-08T20:54:54.926435+0000","last_became_peered":"2023-12-08T20:54:54.926435+0000","last_unstale":"2023-12-08T21:25:58.290149+0000","last_undegraded":"2023-12-08T21:25:58.290149+0000","last_fullsized":"2023-12-08T21:25:58.290149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:25:58.289922+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:25:58.289922+0000","last_clean_scrub_stamp":"2023-12-08T21:25:58.289922+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:28:27.891672+0000","scrub_duration":0.0072454040000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'79","reported_seq":116,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:46.539241+0000","last_change":"2023-12-08T21:26:46.539384+0000","last_active":"2023-12-08T21:26:46.539241+0000","last_peered":"2023-12-08T21:26:46.539241+0000","last_clean":"2023-12-08T21:26:46.539241+0000","last_became_active":"2023-12-08T20:55:04.534289+0000","last_became_peered":"2023-12-08T20:55:04.534289+0000","last_unstale":"2023-12-08T21:26:46.539241+0000","last_undegraded":"2023-12-08T21:26:46.539241+0000","last_fullsized":"2023-12-08T21:26:46.539241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'79","last_scrub_stamp":"2023-12-08T21:26:46.539004+0000","last_deep_scrub":"30'79","last_deep_scrub_stamp":"2023-12-08T21:26:46.539004+0000","last_clean_scrub_stamp":"2023-12-08T21:26:46.539004+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:33:37.018995+0000","scrub_duration":0.0071002449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.093643+0000","last_change":"2023-12-08T21:25:55.093643+0000","last_active":"2023-12-08T21:25:55.093643+0000","last_peered":"2023-12-08T21:25:55.093643+0000","last_clean":"2023-12-08T21:25:55.093643+0000","last_became_active":"2023-12-08T20:54:56.375922+0000","last_became_peered":"2023-12-08T20:54:56.375922+0000","last_unstale":"2023-12-08T21:25:55.093643+0000","last_undegraded":"2023-12-08T21:25:55.093643+0000","last_fullsized":"2023-12-08T21:25:55.093643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:25:55.093529+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:25:55.093529+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.093529+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:56:51.759799+0000","scrub_duration":0.0031557159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'893","reported_seq":936,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:52.042951+0000","last_change":"2023-12-08T21:25:52.042995+0000","last_active":"2023-12-08T21:25:52.042951+0000","last_peered":"2023-12-08T21:25:52.042951+0000","last_clean":"2023-12-08T21:25:52.042951+0000","last_became_active":"2023-12-08T20:54:54.977999+0000","last_became_peered":"2023-12-08T20:54:54.977999+0000","last_unstale":"2023-12-08T21:25:52.042951+0000","last_undegraded":"2023-12-08T21:25:52.042951+0000","last_fullsized":"2023-12-08T21:25:52.042951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'893","last_scrub_stamp":"2023-12-08T21:25:52.042834+0000","last_deep_scrub":"30'893","last_deep_scrub_stamp":"2023-12-08T21:25:52.042834+0000","last_clean_scrub_stamp":"2023-12-08T21:25:52.042834+0000","objects_scrubbed":4,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:13:57.138876+0000","scrub_duration":0.033957383000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":887,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'80","reported_seq":117,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:31.050828+0000","last_change":"2023-12-08T21:26:31.050884+0000","last_active":"2023-12-08T21:26:31.050828+0000","last_peered":"2023-12-08T21:26:31.050828+0000","last_clean":"2023-12-08T21:26:31.050828+0000","last_became_active":"2023-12-08T20:55:04.522190+0000","last_became_peered":"2023-12-08T20:55:04.522190+0000","last_unstale":"2023-12-08T21:26:31.050828+0000","last_undegraded":"2023-12-08T21:26:31.050828+0000","last_fullsized":"2023-12-08T21:26:31.050828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'80","last_scrub_stamp":"2023-12-08T21:26:31.050628+0000","last_deep_scrub":"30'80","last_deep_scrub_stamp":"2023-12-08T21:26:31.050628+0000","last_clean_scrub_stamp":"2023-12-08T21:26:31.050628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:24:13.040770+0000","scrub_duration":0.0071926489999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:11.108977+0000","last_change":"2023-12-08T21:26:11.109034+0000","last_active":"2023-12-08T21:26:11.108977+0000","last_peered":"2023-12-08T21:26:11.108977+0000","last_clean":"2023-12-08T21:26:11.108977+0000","last_became_active":"2023-12-08T20:54:56.383561+0000","last_became_peered":"2023-12-08T20:54:56.383561+0000","last_unstale":"2023-12-08T21:26:11.108977+0000","last_undegraded":"2023-12-08T21:26:11.108977+0000","last_fullsized":"2023-12-08T21:26:11.108977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:11.108774+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:11.108774+0000","last_clean_scrub_stamp":"2023-12-08T21:26:11.108774+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:26:31.478244+0000","scrub_duration":0.0032197039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'407","reported_seq":450,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.289869+0000","last_change":"2023-12-08T21:26:04.289869+0000","last_active":"2023-12-08T21:26:04.289869+0000","last_peered":"2023-12-08T21:26:04.289869+0000","last_clean":"2023-12-08T21:26:04.289869+0000","last_became_active":"2023-12-08T20:54:54.980023+0000","last_became_peered":"2023-12-08T20:54:54.980023+0000","last_unstale":"2023-12-08T21:26:04.289869+0000","last_undegraded":"2023-12-08T21:26:04.289869+0000","last_fullsized":"2023-12-08T21:26:04.289869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'407","last_scrub_stamp":"2023-12-08T21:26:04.289595+0000","last_deep_scrub":"30'407","last_deep_scrub_stamp":"2023-12-08T21:26:04.289595+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.289595+0000","objects_scrubbed":2,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:14:17.977538+0000","scrub_duration":0.006696993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'116","reported_seq":153,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:38.070529+0000","last_change":"2023-12-08T21:26:38.070565+0000","last_active":"2023-12-08T21:26:38.070529+0000","last_peered":"2023-12-08T21:26:38.070529+0000","last_clean":"2023-12-08T21:26:38.070529+0000","last_became_active":"2023-12-08T20:55:04.522325+0000","last_became_peered":"2023-12-08T20:55:04.522325+0000","last_unstale":"2023-12-08T21:26:38.070529+0000","last_undegraded":"2023-12-08T21:26:38.070529+0000","last_fullsized":"2023-12-08T21:26:38.070529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'116","last_scrub_stamp":"2023-12-08T21:26:38.070400+0000","last_deep_scrub":"30'116","last_deep_scrub_stamp":"2023-12-08T21:26:38.070400+0000","last_clean_scrub_stamp":"2023-12-08T21:26:38.070400+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:07:09.957382+0000","scrub_duration":0.005104379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":12653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'29","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.923377+0000","last_change":"2023-12-08T21:25:59.923377+0000","last_active":"2023-12-08T21:25:59.923377+0000","last_peered":"2023-12-08T21:25:59.923377+0000","last_clean":"2023-12-08T21:25:59.923377+0000","last_became_active":"2023-12-08T20:54:56.409539+0000","last_became_peered":"2023-12-08T20:54:56.409539+0000","last_unstale":"2023-12-08T21:25:59.923377+0000","last_undegraded":"2023-12-08T21:25:59.923377+0000","last_fullsized":"2023-12-08T21:25:59.923377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-12-08T21:25:59.923139+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-12-08T21:25:59.923139+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.923139+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:20:00.596635+0000","scrub_duration":0.0048008690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'3","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.174774+0000","last_change":"2023-12-08T21:26:01.174774+0000","last_active":"2023-12-08T21:26:01.174774+0000","last_peered":"2023-12-08T21:26:01.174774+0000","last_clean":"2023-12-08T21:26:01.174774+0000","last_became_active":"2023-12-08T20:54:54.935889+0000","last_became_peered":"2023-12-08T20:54:54.935889+0000","last_unstale":"2023-12-08T21:26:01.174774+0000","last_undegraded":"2023-12-08T21:26:01.174774+0000","last_fullsized":"2023-12-08T21:26:01.174774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:26:01.174531+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:26:01.174531+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.174531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:17:02.143286+0000","scrub_duration":0.0027935500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'68","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:38.212698+0000","last_change":"2023-12-08T21:26:38.212814+0000","last_active":"2023-12-08T21:26:38.212698+0000","last_peered":"2023-12-08T21:26:38.212698+0000","last_clean":"2023-12-08T21:26:38.212698+0000","last_became_active":"2023-12-08T20:56:00.560282+0000","last_became_peered":"2023-12-08T20:56:00.560282+0000","last_unstale":"2023-12-08T21:26:38.212698+0000","last_undegraded":"2023-12-08T21:26:38.212698+0000","last_fullsized":"2023-12-08T21:26:38.212698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'68","last_scrub_stamp":"2023-12-08T21:26:38.212460+0000","last_deep_scrub":"30'68","last_deep_scrub_stamp":"2023-12-08T21:26:38.212460+0000","last_clean_scrub_stamp":"2023-12-08T21:26:38.212460+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:22:34.139291+0000","scrub_duration":0.0071014620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":7515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:18.920419+0000","last_change":"2023-12-08T21:26:18.920419+0000","last_active":"2023-12-08T21:26:18.920419+0000","last_peered":"2023-12-08T21:26:18.920419+0000","last_clean":"2023-12-08T21:26:18.920419+0000","last_became_active":"2023-12-08T20:54:56.369709+0000","last_became_peered":"2023-12-08T20:54:56.369709+0000","last_unstale":"2023-12-08T21:26:18.920419+0000","last_undegraded":"2023-12-08T21:26:18.920419+0000","last_fullsized":"2023-12-08T21:26:18.920419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:18.920028+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:18.920028+0000","last_clean_scrub_stamp":"2023-12-08T21:26:18.920028+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:27:46.684571+0000","scrub_duration":0.0029217309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'3","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:54.755396+0000","last_change":"2023-12-08T21:25:54.755396+0000","last_active":"2023-12-08T21:25:54.755396+0000","last_peered":"2023-12-08T21:25:54.755396+0000","last_clean":"2023-12-08T21:25:54.755396+0000","last_became_active":"2023-12-08T20:54:54.979751+0000","last_became_peered":"2023-12-08T20:54:54.979751+0000","last_unstale":"2023-12-08T21:25:54.755396+0000","last_undegraded":"2023-12-08T21:25:54.755396+0000","last_fullsized":"2023-12-08T21:25:54.755396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:25:54.755239+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:25:54.755239+0000","last_clean_scrub_stamp":"2023-12-08T21:25:54.755239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:03:48.852944+0000","scrub_duration":0.002413353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'79","reported_seq":116,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:34.019701+0000","last_change":"2023-12-08T21:26:34.019764+0000","last_active":"2023-12-08T21:26:34.019701+0000","last_peered":"2023-12-08T21:26:34.019701+0000","last_clean":"2023-12-08T21:26:34.019701+0000","last_became_active":"2023-12-08T20:55:04.511405+0000","last_became_peered":"2023-12-08T20:55:04.511405+0000","last_unstale":"2023-12-08T21:26:34.019701+0000","last_undegraded":"2023-12-08T21:26:34.019701+0000","last_fullsized":"2023-12-08T21:26:34.019701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'79","last_scrub_stamp":"2023-12-08T21:26:34.019500+0000","last_deep_scrub":"30'79","last_deep_scrub_stamp":"2023-12-08T21:26:34.019500+0000","last_clean_scrub_stamp":"2023-12-08T21:26:34.019500+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:13:31.028622+0000","scrub_duration":0.0067922219999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:24.006292+0000","last_change":"2023-12-08T21:26:24.006328+0000","last_active":"2023-12-08T21:26:24.006292+0000","last_peered":"2023-12-08T21:26:24.006292+0000","last_clean":"2023-12-08T21:26:24.006292+0000","last_became_active":"2023-12-08T20:55:04.536497+0000","last_became_peered":"2023-12-08T20:55:04.536497+0000","last_unstale":"2023-12-08T21:26:24.006292+0000","last_undegraded":"2023-12-08T21:26:24.006292+0000","last_fullsized":"2023-12-08T21:26:24.006292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'65","last_scrub_stamp":"2023-12-08T21:26:24.006179+0000","last_deep_scrub":"30'65","last_deep_scrub_stamp":"2023-12-08T21:26:24.006179+0000","last_clean_scrub_stamp":"2023-12-08T21:26:24.006179+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:37:20.579091+0000","scrub_duration":0.0039742140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:18.981955+0000","last_change":"2023-12-08T21:26:18.981955+0000","last_active":"2023-12-08T21:26:18.981955+0000","last_peered":"2023-12-08T21:26:18.981955+0000","last_clean":"2023-12-08T21:26:18.981955+0000","last_became_active":"2023-12-08T20:54:56.317895+0000","last_became_peered":"2023-12-08T20:54:56.317895+0000","last_unstale":"2023-12-08T21:26:18.981955+0000","last_undegraded":"2023-12-08T21:26:18.981955+0000","last_fullsized":"2023-12-08T21:26:18.981955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:18.981665+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:18.981665+0000","last_clean_scrub_stamp":"2023-12-08T21:26:18.981665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:15:26.653378+0000","scrub_duration":0.0031400199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'4","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.214946+0000","last_change":"2023-12-08T21:26:17.214946+0000","last_active":"2023-12-08T21:26:17.214946+0000","last_peered":"2023-12-08T21:26:17.214946+0000","last_clean":"2023-12-08T21:26:17.214946+0000","last_became_active":"2023-12-08T20:54:54.935578+0000","last_became_peered":"2023-12-08T20:54:54.935578+0000","last_unstale":"2023-12-08T21:26:17.214946+0000","last_undegraded":"2023-12-08T21:26:17.214946+0000","last_fullsized":"2023-12-08T21:26:17.214946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:26:17.214737+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:26:17.214737+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.214737+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:14:28.047119+0000","scrub_duration":0.0019532619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'80","reported_seq":111,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:51.796206+0000","last_change":"2023-12-08T20:55:04.535940+0000","last_active":"2023-12-08T21:25:51.796206+0000","last_peered":"2023-12-08T21:25:51.796206+0000","last_clean":"2023-12-08T21:25:51.796206+0000","last_became_active":"2023-12-08T20:55:04.535525+0000","last_became_peered":"2023-12-08T20:55:04.535525+0000","last_unstale":"2023-12-08T21:25:51.796206+0000","last_undegraded":"2023-12-08T21:25:51.796206+0000","last_fullsized":"2023-12-08T21:25:51.796206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:55:02.807686+0000","last_clean_scrub_stamp":"2023-12-08T20:55:02.807686+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":11364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:30.927893+0000","last_change":"2023-12-08T21:26:30.927947+0000","last_active":"2023-12-08T21:26:30.927893+0000","last_peered":"2023-12-08T21:26:30.927893+0000","last_clean":"2023-12-08T21:26:30.927893+0000","last_became_active":"2023-12-08T20:54:56.412133+0000","last_became_peered":"2023-12-08T20:54:56.412133+0000","last_unstale":"2023-12-08T21:26:30.927893+0000","last_undegraded":"2023-12-08T21:26:30.927893+0000","last_fullsized":"2023-12-08T21:26:30.927893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:30.927680+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:30.927680+0000","last_clean_scrub_stamp":"2023-12-08T21:26:30.927680+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:10:28.638287+0000","scrub_duration":0.003176187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'3","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:58.532461+0000","last_change":"2023-12-08T21:25:58.532461+0000","last_active":"2023-12-08T21:25:58.532461+0000","last_peered":"2023-12-08T21:25:58.532461+0000","last_clean":"2023-12-08T21:25:58.532461+0000","last_became_active":"2023-12-08T20:54:54.926804+0000","last_became_peered":"2023-12-08T20:54:54.926804+0000","last_unstale":"2023-12-08T21:25:58.532461+0000","last_undegraded":"2023-12-08T21:25:58.532461+0000","last_fullsized":"2023-12-08T21:25:58.532461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:25:58.532282+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:25:58.532282+0000","last_clean_scrub_stamp":"2023-12-08T21:25:58.532282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:57:27.213154+0000","scrub_duration":0.0026443899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'616","reported_seq":658,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:16.216138+0000","last_change":"2023-12-08T21:26:16.216200+0000","last_active":"2023-12-08T21:26:16.216138+0000","last_peered":"2023-12-08T21:26:16.216138+0000","last_clean":"2023-12-08T21:26:16.216138+0000","last_became_active":"2023-12-08T20:54:54.930324+0000","last_became_peered":"2023-12-08T20:54:54.930324+0000","last_unstale":"2023-12-08T21:26:16.216138+0000","last_undegraded":"2023-12-08T21:26:16.216138+0000","last_fullsized":"2023-12-08T21:26:16.216138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'616","last_scrub_stamp":"2023-12-08T21:26:16.215928+0000","last_deep_scrub":"30'616","last_deep_scrub_stamp":"2023-12-08T21:26:16.215928+0000","last_clean_scrub_stamp":"2023-12-08T21:26:16.215928+0000","objects_scrubbed":1,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:45:43.919045+0000","scrub_duration":0.033128956000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.998145+0000","last_change":"2023-12-08T21:26:08.998185+0000","last_active":"2023-12-08T21:26:08.998145+0000","last_peered":"2023-12-08T21:26:08.998145+0000","last_clean":"2023-12-08T21:26:08.998145+0000","last_became_active":"2023-12-08T20:54:56.383467+0000","last_became_peered":"2023-12-08T20:54:56.383467+0000","last_unstale":"2023-12-08T21:26:08.998145+0000","last_undegraded":"2023-12-08T21:26:08.998145+0000","last_fullsized":"2023-12-08T21:26:08.998145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:08.998020+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:08.998020+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.998020+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:43:06.448077+0000","scrub_duration":0.0029810240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'50","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:38.921415+0000","last_change":"2023-12-08T21:26:38.921533+0000","last_active":"2023-12-08T21:26:38.921415+0000","last_peered":"2023-12-08T21:26:38.921415+0000","last_clean":"2023-12-08T21:26:38.921415+0000","last_became_active":"2023-12-08T20:55:04.536537+0000","last_became_peered":"2023-12-08T20:55:04.536537+0000","last_unstale":"2023-12-08T21:26:38.921415+0000","last_undegraded":"2023-12-08T21:26:38.921415+0000","last_fullsized":"2023-12-08T21:26:38.921415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'50","last_scrub_stamp":"2023-12-08T21:26:38.921200+0000","last_deep_scrub":"30'50","last_deep_scrub_stamp":"2023-12-08T21:26:38.921200+0000","last_clean_scrub_stamp":"2023-12-08T21:26:38.921200+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:32.596592+0000","scrub_duration":0.005835153,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'554","reported_seq":596,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:10.943632+0000","last_change":"2023-12-08T21:26:10.943758+0000","last_active":"2023-12-08T21:26:10.943632+0000","last_peered":"2023-12-08T21:26:10.943632+0000","last_clean":"2023-12-08T21:26:10.943632+0000","last_became_active":"2023-12-08T20:54:54.925229+0000","last_became_peered":"2023-12-08T20:54:54.925229+0000","last_unstale":"2023-12-08T21:26:10.943632+0000","last_undegraded":"2023-12-08T21:26:10.943632+0000","last_fullsized":"2023-12-08T21:26:10.943632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'554","last_scrub_stamp":"2023-12-08T21:26:10.943330+0000","last_deep_scrub":"30'554","last_deep_scrub_stamp":"2023-12-08T21:26:10.943330+0000","last_clean_scrub_stamp":"2023-12-08T21:26:10.943330+0000","objects_scrubbed":1,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:10:30.749700+0000","scrub_duration":0.033797185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'20","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:00.754130+0000","last_change":"2023-12-08T21:26:00.754182+0000","last_active":"2023-12-08T21:26:00.754130+0000","last_peered":"2023-12-08T21:26:00.754130+0000","last_clean":"2023-12-08T21:26:00.754130+0000","last_became_active":"2023-12-08T20:54:56.403996+0000","last_became_peered":"2023-12-08T20:54:56.403996+0000","last_unstale":"2023-12-08T21:26:00.754130+0000","last_undegraded":"2023-12-08T21:26:00.754130+0000","last_fullsized":"2023-12-08T21:26:00.754130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:00.753925+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:00.753925+0000","last_clean_scrub_stamp":"2023-12-08T21:26:00.753925+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:14:14.441869+0000","scrub_duration":0.003347722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'97","reported_seq":133,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.316666+0000","last_change":"2023-12-08T21:26:14.316722+0000","last_active":"2023-12-08T21:26:14.316666+0000","last_peered":"2023-12-08T21:26:14.316666+0000","last_clean":"2023-12-08T21:26:14.316666+0000","last_became_active":"2023-12-08T20:55:04.523137+0000","last_became_peered":"2023-12-08T20:55:04.523137+0000","last_unstale":"2023-12-08T21:26:14.316666+0000","last_undegraded":"2023-12-08T21:26:14.316666+0000","last_fullsized":"2023-12-08T21:26:14.316666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'97","last_scrub_stamp":"2023-12-08T21:26:14.316453+0000","last_deep_scrub":"30'97","last_deep_scrub_stamp":"2023-12-08T21:26:14.316453+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.316453+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:34:50.101165+0000","scrub_duration":0.0078096950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"30'37","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.876227+0000","last_change":"2023-12-08T21:26:08.876227+0000","last_active":"2023-12-08T21:26:08.876227+0000","last_peered":"2023-12-08T21:26:08.876227+0000","last_clean":"2023-12-08T21:26:08.876227+0000","last_became_active":"2023-12-08T20:54:56.373080+0000","last_became_peered":"2023-12-08T20:54:56.373080+0000","last_unstale":"2023-12-08T21:26:08.876227+0000","last_undegraded":"2023-12-08T21:26:08.876227+0000","last_fullsized":"2023-12-08T21:26:08.876227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'37","last_scrub_stamp":"2023-12-08T21:26:08.875831+0000","last_deep_scrub":"30'37","last_deep_scrub_stamp":"2023-12-08T21:26:08.875831+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.875831+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:35:17.879073+0000","scrub_duration":0.003168078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'27","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:07.352563+0000","last_change":"2023-12-08T21:26:07.352563+0000","last_active":"2023-12-08T21:26:07.352563+0000","last_peered":"2023-12-08T21:26:07.352563+0000","last_clean":"2023-12-08T21:26:07.352563+0000","last_became_active":"2023-12-08T20:54:56.378154+0000","last_became_peered":"2023-12-08T20:54:56.378154+0000","last_unstale":"2023-12-08T21:26:07.352563+0000","last_undegraded":"2023-12-08T21:26:07.352563+0000","last_fullsized":"2023-12-08T21:26:07.352563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-12-08T21:26:07.352305+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-12-08T21:26:07.352305+0000","last_clean_scrub_stamp":"2023-12-08T21:26:07.352305+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:43:19.113869+0000","scrub_duration":0.0029496069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'26","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:02.075761+0000","last_change":"2023-12-08T21:26:02.075761+0000","last_active":"2023-12-08T21:26:02.075761+0000","last_peered":"2023-12-08T21:26:02.075761+0000","last_clean":"2023-12-08T21:26:02.075761+0000","last_became_active":"2023-12-08T20:54:56.409863+0000","last_became_peered":"2023-12-08T20:54:56.409863+0000","last_unstale":"2023-12-08T21:26:02.075761+0000","last_undegraded":"2023-12-08T21:26:02.075761+0000","last_fullsized":"2023-12-08T21:26:02.075761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:02.075490+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:02.075490+0000","last_clean_scrub_stamp":"2023-12-08T21:26:02.075490+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:56:07.407825+0000","scrub_duration":0.0028810989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:19.853547+0000","last_change":"2023-12-08T21:26:19.853599+0000","last_active":"2023-12-08T21:26:19.853547+0000","last_peered":"2023-12-08T21:26:19.853547+0000","last_clean":"2023-12-08T21:26:19.853547+0000","last_became_active":"2023-12-08T20:54:56.408205+0000","last_became_peered":"2023-12-08T20:54:56.408205+0000","last_unstale":"2023-12-08T21:26:19.853547+0000","last_undegraded":"2023-12-08T21:26:19.853547+0000","last_fullsized":"2023-12-08T21:26:19.853547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-12-08T21:26:19.853354+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-12-08T21:26:19.853354+0000","last_clean_scrub_stamp":"2023-12-08T21:26:19.853354+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:40.279876+0000","scrub_duration":0.0040195689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'16","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.448817+0000","last_change":"2023-12-08T21:26:17.448848+0000","last_active":"2023-12-08T21:26:17.448817+0000","last_peered":"2023-12-08T21:26:17.448817+0000","last_clean":"2023-12-08T21:26:17.448817+0000","last_became_active":"2023-12-08T20:54:56.386344+0000","last_became_peered":"2023-12-08T20:54:56.386344+0000","last_unstale":"2023-12-08T21:26:17.448817+0000","last_undegraded":"2023-12-08T21:26:17.448817+0000","last_fullsized":"2023-12-08T21:26:17.448817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-12-08T21:26:17.448692+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-12-08T21:26:17.448692+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.448692+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:27:35.548731+0000","scrub_duration":0.0025673380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.337483+0000","last_change":"2023-12-08T21:26:14.337534+0000","last_active":"2023-12-08T21:26:14.337483+0000","last_peered":"2023-12-08T21:26:14.337483+0000","last_clean":"2023-12-08T21:26:14.337483+0000","last_became_active":"2023-12-08T20:54:56.366967+0000","last_became_peered":"2023-12-08T20:54:56.366967+0000","last_unstale":"2023-12-08T21:26:14.337483+0000","last_undegraded":"2023-12-08T21:26:14.337483+0000","last_fullsized":"2023-12-08T21:26:14.337483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:14.337293+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:14.337293+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.337293+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:11:34.657650+0000","scrub_duration":0.0035456820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'32","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:23.915395+0000","last_change":"2023-12-08T21:26:23.915503+0000","last_active":"2023-12-08T21:26:23.915395+0000","last_peered":"2023-12-08T21:26:23.915395+0000","last_clean":"2023-12-08T21:26:23.915395+0000","last_became_active":"2023-12-08T20:54:56.371954+0000","last_became_peered":"2023-12-08T20:54:56.371954+0000","last_unstale":"2023-12-08T21:26:23.915395+0000","last_undegraded":"2023-12-08T21:26:23.915395+0000","last_fullsized":"2023-12-08T21:26:23.915395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:23.915162+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:23.915162+0000","last_clean_scrub_stamp":"2023-12-08T21:26:23.915162+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:45:34.269396+0000","scrub_duration":0.0022833179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:03.870345+0000","last_change":"2023-12-08T21:26:03.870397+0000","last_active":"2023-12-08T21:26:03.870345+0000","last_peered":"2023-12-08T21:26:03.870345+0000","last_clean":"2023-12-08T21:26:03.870345+0000","last_became_active":"2023-12-08T20:54:56.409462+0000","last_became_peered":"2023-12-08T20:54:56.409462+0000","last_unstale":"2023-12-08T21:26:03.870345+0000","last_undegraded":"2023-12-08T21:26:03.870345+0000","last_fullsized":"2023-12-08T21:26:03.870345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:03.870148+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:03.870148+0000","last_clean_scrub_stamp":"2023-12-08T21:26:03.870148+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:04:32.166396+0000","scrub_duration":0.0033986340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'18","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.202058+0000","last_change":"2023-12-08T21:25:59.202112+0000","last_active":"2023-12-08T21:25:59.202058+0000","last_peered":"2023-12-08T21:25:59.202058+0000","last_clean":"2023-12-08T21:25:59.202058+0000","last_became_active":"2023-12-08T20:54:56.415176+0000","last_became_peered":"2023-12-08T20:54:56.415176+0000","last_unstale":"2023-12-08T21:25:59.202058+0000","last_undegraded":"2023-12-08T21:25:59.202058+0000","last_fullsized":"2023-12-08T21:25:59.202058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:25:59.201838+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:25:59.201838+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.201838+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:55:02.593105+0000","scrub_duration":0.0031189780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'31","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.841528+0000","last_change":"2023-12-08T21:26:13.841528+0000","last_active":"2023-12-08T21:26:13.841528+0000","last_peered":"2023-12-08T21:26:13.841528+0000","last_clean":"2023-12-08T21:26:13.841528+0000","last_became_active":"2023-12-08T20:54:56.400980+0000","last_became_peered":"2023-12-08T20:54:56.400980+0000","last_unstale":"2023-12-08T21:26:13.841528+0000","last_undegraded":"2023-12-08T21:26:13.841528+0000","last_fullsized":"2023-12-08T21:26:13.841528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-12-08T21:26:13.841252+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-12-08T21:26:13.841252+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.841252+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:55:29.119051+0000","scrub_duration":0.0036066679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:03.827576+0000","last_change":"2023-12-08T21:26:03.827576+0000","last_active":"2023-12-08T21:26:03.827576+0000","last_peered":"2023-12-08T21:26:03.827576+0000","last_clean":"2023-12-08T21:26:03.827576+0000","last_became_active":"2023-12-08T20:54:56.386413+0000","last_became_peered":"2023-12-08T20:54:56.386413+0000","last_unstale":"2023-12-08T21:26:03.827576+0000","last_undegraded":"2023-12-08T21:26:03.827576+0000","last_fullsized":"2023-12-08T21:26:03.827576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:03.827291+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:03.827291+0000","last_clean_scrub_stamp":"2023-12-08T21:26:03.827291+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:43:15.588855+0000","scrub_duration":0.003078543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.895627+0000","last_change":"2023-12-08T21:26:14.895627+0000","last_active":"2023-12-08T21:26:14.895627+0000","last_peered":"2023-12-08T21:26:14.895627+0000","last_clean":"2023-12-08T21:26:14.895627+0000","last_became_active":"2023-12-08T20:54:56.371456+0000","last_became_peered":"2023-12-08T20:54:56.371456+0000","last_unstale":"2023-12-08T21:26:14.895627+0000","last_undegraded":"2023-12-08T21:26:14.895627+0000","last_fullsized":"2023-12-08T21:26:14.895627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-12-08T21:26:14.895388+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-12-08T21:26:14.895388+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.895388+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:06:01.846393+0000","scrub_duration":0.0052799700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.144715+0000","last_change":"2023-12-08T21:26:17.144715+0000","last_active":"2023-12-08T21:26:17.144715+0000","last_peered":"2023-12-08T21:26:17.144715+0000","last_clean":"2023-12-08T21:26:17.144715+0000","last_became_active":"2023-12-08T20:54:56.380860+0000","last_became_peered":"2023-12-08T20:54:56.380860+0000","last_unstale":"2023-12-08T21:26:17.144715+0000","last_undegraded":"2023-12-08T21:26:17.144715+0000","last_fullsized":"2023-12-08T21:26:17.144715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:17.144561+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:17.144561+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.144561+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:10.819952+0000","scrub_duration":0.001893371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:32.244590+0000","last_change":"2023-12-08T21:26:32.244590+0000","last_active":"2023-12-08T21:26:32.244590+0000","last_peered":"2023-12-08T21:26:32.244590+0000","last_clean":"2023-12-08T21:26:32.244590+0000","last_became_active":"2023-12-08T20:54:56.260387+0000","last_became_peered":"2023-12-08T20:54:56.260387+0000","last_unstale":"2023-12-08T21:26:32.244590+0000","last_undegraded":"2023-12-08T21:26:32.244590+0000","last_fullsized":"2023-12-08T21:26:32.244590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:32.244249+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:32.244249+0000","last_clean_scrub_stamp":"2023-12-08T21:26:32.244249+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:14:23.949815+0000","scrub_duration":0.003446494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'32","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:10.301571+0000","last_change":"2023-12-08T21:26:10.301625+0000","last_active":"2023-12-08T21:26:10.301571+0000","last_peered":"2023-12-08T21:26:10.301571+0000","last_clean":"2023-12-08T21:26:10.301571+0000","last_became_active":"2023-12-08T20:54:56.387774+0000","last_became_peered":"2023-12-08T20:54:56.387774+0000","last_unstale":"2023-12-08T21:26:10.301571+0000","last_undegraded":"2023-12-08T21:26:10.301571+0000","last_fullsized":"2023-12-08T21:26:10.301571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:10.301372+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:10.301372+0000","last_clean_scrub_stamp":"2023-12-08T21:26:10.301372+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:19:37.645203+0000","scrub_duration":0.0036295450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:15.151085+0000","last_change":"2023-12-08T21:26:15.151138+0000","last_active":"2023-12-08T21:26:15.151085+0000","last_peered":"2023-12-08T21:26:15.151085+0000","last_clean":"2023-12-08T21:26:15.151085+0000","last_became_active":"2023-12-08T20:54:56.377029+0000","last_became_peered":"2023-12-08T20:54:56.377029+0000","last_unstale":"2023-12-08T21:26:15.151085+0000","last_undegraded":"2023-12-08T21:26:15.151085+0000","last_fullsized":"2023-12-08T21:26:15.151085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:15.150889+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:15.150889+0000","last_clean_scrub_stamp":"2023-12-08T21:26:15.150889+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:59:04.490083+0000","scrub_duration":0.006416382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.145181+0000","last_change":"2023-12-08T21:26:13.145289+0000","last_active":"2023-12-08T21:26:13.145181+0000","last_peered":"2023-12-08T21:26:13.145181+0000","last_clean":"2023-12-08T21:26:13.145181+0000","last_became_active":"2023-12-08T20:54:56.370707+0000","last_became_peered":"2023-12-08T20:54:56.370707+0000","last_unstale":"2023-12-08T21:26:13.145181+0000","last_undegraded":"2023-12-08T21:26:13.145181+0000","last_fullsized":"2023-12-08T21:26:13.145181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:13.144948+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:13.144948+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.144948+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:29:20.754089+0000","scrub_duration":0.0029542679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'29","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:15.785466+0000","last_change":"2023-12-08T21:26:15.785519+0000","last_active":"2023-12-08T21:26:15.785466+0000","last_peered":"2023-12-08T21:26:15.785466+0000","last_clean":"2023-12-08T21:26:15.785466+0000","last_became_active":"2023-12-08T20:54:56.401544+0000","last_became_peered":"2023-12-08T20:54:56.401544+0000","last_unstale":"2023-12-08T21:26:15.785466+0000","last_undegraded":"2023-12-08T21:26:15.785466+0000","last_fullsized":"2023-12-08T21:26:15.785466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-12-08T21:26:15.785268+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-12-08T21:26:15.785268+0000","last_clean_scrub_stamp":"2023-12-08T21:26:15.785268+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:56:21.117603+0000","scrub_duration":0.0032307500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.497763+0000","last_change":"2023-12-08T21:26:04.497882+0000","last_active":"2023-12-08T21:26:04.497763+0000","last_peered":"2023-12-08T21:26:04.497763+0000","last_clean":"2023-12-08T21:26:04.497763+0000","last_became_active":"2023-12-08T20:54:56.365432+0000","last_became_peered":"2023-12-08T20:54:56.365432+0000","last_unstale":"2023-12-08T21:26:04.497763+0000","last_undegraded":"2023-12-08T21:26:04.497763+0000","last_fullsized":"2023-12-08T21:26:04.497763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:04.497467+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:04.497467+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.497467+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:58:46.607618+0000","scrub_duration":0.0033388139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'32","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:03.491249+0000","last_change":"2023-12-08T21:26:03.491249+0000","last_active":"2023-12-08T21:26:03.491249+0000","last_peered":"2023-12-08T21:26:03.491249+0000","last_clean":"2023-12-08T21:26:03.491249+0000","last_became_active":"2023-12-08T20:54:56.392408+0000","last_became_peered":"2023-12-08T20:54:56.392408+0000","last_unstale":"2023-12-08T21:26:03.491249+0000","last_undegraded":"2023-12-08T21:26:03.491249+0000","last_fullsized":"2023-12-08T21:26:03.491249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:03.490973+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:03.490973+0000","last_clean_scrub_stamp":"2023-12-08T21:26:03.490973+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:48.345009+0000","scrub_duration":0.0042798330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:22.184387+0000","last_change":"2023-12-08T21:26:22.184387+0000","last_active":"2023-12-08T21:26:22.184387+0000","last_peered":"2023-12-08T21:26:22.184387+0000","last_clean":"2023-12-08T21:26:22.184387+0000","last_became_active":"2023-12-08T20:54:56.380137+0000","last_became_peered":"2023-12-08T20:54:56.380137+0000","last_unstale":"2023-12-08T21:26:22.184387+0000","last_undegraded":"2023-12-08T21:26:22.184387+0000","last_fullsized":"2023-12-08T21:26:22.184387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:26:22.183980+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:26:22.183980+0000","last_clean_scrub_stamp":"2023-12-08T21:26:22.183980+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:46:57.233922+0000","scrub_duration":0.0028384159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'21","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:34.215457+0000","last_change":"2023-12-08T21:26:34.215509+0000","last_active":"2023-12-08T21:26:34.215457+0000","last_peered":"2023-12-08T21:26:34.215457+0000","last_clean":"2023-12-08T21:26:34.215457+0000","last_became_active":"2023-12-08T20:54:56.391299+0000","last_became_peered":"2023-12-08T20:54:56.391299+0000","last_unstale":"2023-12-08T21:26:34.215457+0000","last_undegraded":"2023-12-08T21:26:34.215457+0000","last_fullsized":"2023-12-08T21:26:34.215457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:34.215250+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:34.215250+0000","last_clean_scrub_stamp":"2023-12-08T21:26:34.215250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:02:27.596309+0000","scrub_duration":0.0027662479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'32","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.100437+0000","last_change":"2023-12-08T21:26:14.100437+0000","last_active":"2023-12-08T21:26:14.100437+0000","last_peered":"2023-12-08T21:26:14.100437+0000","last_clean":"2023-12-08T21:26:14.100437+0000","last_became_active":"2023-12-08T20:54:56.392708+0000","last_became_peered":"2023-12-08T20:54:56.392708+0000","last_unstale":"2023-12-08T21:26:14.100437+0000","last_undegraded":"2023-12-08T21:26:14.100437+0000","last_fullsized":"2023-12-08T21:26:14.100437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:14.100007+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:14.100007+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.100007+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:23:56.090149+0000","scrub_duration":0.0033906460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'30","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:07.865013+0000","last_change":"2023-12-08T21:26:07.865013+0000","last_active":"2023-12-08T21:26:07.865013+0000","last_peered":"2023-12-08T21:26:07.865013+0000","last_clean":"2023-12-08T21:26:07.865013+0000","last_became_active":"2023-12-08T20:54:56.318400+0000","last_became_peered":"2023-12-08T20:54:56.318400+0000","last_unstale":"2023-12-08T21:26:07.865013+0000","last_undegraded":"2023-12-08T21:26:07.865013+0000","last_fullsized":"2023-12-08T21:26:07.865013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-12-08T21:26:07.864752+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-12-08T21:26:07.864752+0000","last_clean_scrub_stamp":"2023-12-08T21:26:07.864752+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:43:38.394802+0000","scrub_duration":0.0055178909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'20","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:36.909165+0000","last_change":"2023-12-08T21:26:36.909219+0000","last_active":"2023-12-08T21:26:36.909165+0000","last_peered":"2023-12-08T21:26:36.909165+0000","last_clean":"2023-12-08T21:26:36.909165+0000","last_became_active":"2023-12-08T20:54:56.413220+0000","last_became_peered":"2023-12-08T20:54:56.413220+0000","last_unstale":"2023-12-08T21:26:36.909165+0000","last_undegraded":"2023-12-08T21:26:36.909165+0000","last_fullsized":"2023-12-08T21:26:36.909165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:36.908966+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:36.908966+0000","last_clean_scrub_stamp":"2023-12-08T21:26:36.908966+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:54:27.292704+0000","scrub_duration":0.003304455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:11.113585+0000","last_change":"2023-12-08T21:26:11.113697+0000","last_active":"2023-12-08T21:26:11.113585+0000","last_peered":"2023-12-08T21:26:11.113585+0000","last_clean":"2023-12-08T21:26:11.113585+0000","last_became_active":"2023-12-08T20:54:56.365448+0000","last_became_peered":"2023-12-08T20:54:56.365448+0000","last_unstale":"2023-12-08T21:26:11.113585+0000","last_undegraded":"2023-12-08T21:26:11.113585+0000","last_fullsized":"2023-12-08T21:26:11.113585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:26:11.113287+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:26:11.113287+0000","last_clean_scrub_stamp":"2023-12-08T21:26:11.113287+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:21:06.223582+0000","scrub_duration":0.0035769590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'25","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.890733+0000","last_change":"2023-12-08T21:26:06.890777+0000","last_active":"2023-12-08T21:26:06.890733+0000","last_peered":"2023-12-08T21:26:06.890733+0000","last_clean":"2023-12-08T21:26:06.890733+0000","last_became_active":"2023-12-08T20:54:56.369574+0000","last_became_peered":"2023-12-08T20:54:56.369574+0000","last_unstale":"2023-12-08T21:26:06.890733+0000","last_undegraded":"2023-12-08T21:26:06.890733+0000","last_fullsized":"2023-12-08T21:26:06.890733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-12-08T21:26:06.890558+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-12-08T21:26:06.890558+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.890558+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:42:36.323222+0000","scrub_duration":0.0032420529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'21","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.103052+0000","last_change":"2023-12-08T21:26:13.103090+0000","last_active":"2023-12-08T21:26:13.103052+0000","last_peered":"2023-12-08T21:26:13.103052+0000","last_clean":"2023-12-08T21:26:13.103052+0000","last_became_active":"2023-12-08T20:54:56.411339+0000","last_became_peered":"2023-12-08T20:54:56.411339+0000","last_unstale":"2023-12-08T21:26:13.103052+0000","last_undegraded":"2023-12-08T21:26:13.103052+0000","last_fullsized":"2023-12-08T21:26:13.103052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:13.102896+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:13.102896+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.102896+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:37:09.675808+0000","scrub_duration":0.0030662670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'17","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:21.921172+0000","last_change":"2023-12-08T21:26:21.921229+0000","last_active":"2023-12-08T21:26:21.921172+0000","last_peered":"2023-12-08T21:26:21.921172+0000","last_clean":"2023-12-08T21:26:21.921172+0000","last_became_active":"2023-12-08T20:54:56.369650+0000","last_became_peered":"2023-12-08T20:54:56.369650+0000","last_unstale":"2023-12-08T21:26:21.921172+0000","last_undegraded":"2023-12-08T21:26:21.921172+0000","last_fullsized":"2023-12-08T21:26:21.921172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:26:21.920971+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:26:21.920971+0000","last_clean_scrub_stamp":"2023-12-08T21:26:21.920971+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:04:45.090796+0000","scrub_duration":0.0034163510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.876732+0000","last_change":"2023-12-08T21:26:04.876732+0000","last_active":"2023-12-08T21:26:04.876732+0000","last_peered":"2023-12-08T21:26:04.876732+0000","last_clean":"2023-12-08T21:26:04.876732+0000","last_became_active":"2023-12-08T20:54:56.408861+0000","last_became_peered":"2023-12-08T20:54:56.408861+0000","last_unstale":"2023-12-08T21:26:04.876732+0000","last_undegraded":"2023-12-08T21:26:04.876732+0000","last_fullsized":"2023-12-08T21:26:04.876732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:04.876470+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:04.876470+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.876470+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:42:10.809218+0000","scrub_duration":0.0033527380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'19","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:18.882384+0000","last_change":"2023-12-08T21:26:18.882418+0000","last_active":"2023-12-08T21:26:18.882384+0000","last_peered":"2023-12-08T21:26:18.882384+0000","last_clean":"2023-12-08T21:26:18.882384+0000","last_became_active":"2023-12-08T20:54:56.404697+0000","last_became_peered":"2023-12-08T20:54:56.404697+0000","last_unstale":"2023-12-08T21:26:18.882384+0000","last_undegraded":"2023-12-08T21:26:18.882384+0000","last_fullsized":"2023-12-08T21:26:18.882384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2023-12-08T21:26:18.882300+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2023-12-08T21:26:18.882300+0000","last_clean_scrub_stamp":"2023-12-08T21:26:18.882300+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:47:36.089699+0000","scrub_duration":0.0021163979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:15.123472+0000","last_change":"2023-12-08T21:26:15.123540+0000","last_active":"2023-12-08T21:26:15.123472+0000","last_peered":"2023-12-08T21:26:15.123472+0000","last_clean":"2023-12-08T21:26:15.123472+0000","last_became_active":"2023-12-08T20:54:56.377835+0000","last_became_peered":"2023-12-08T20:54:56.377835+0000","last_unstale":"2023-12-08T21:26:15.123472+0000","last_undegraded":"2023-12-08T21:26:15.123472+0000","last_fullsized":"2023-12-08T21:26:15.123472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:15.123273+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:15.123273+0000","last_clean_scrub_stamp":"2023-12-08T21:26:15.123273+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:25:29.875062+0000","scrub_duration":0.0058249160000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2350,"num_write_kb":252630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2525,"ondisk_log_size":2525,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1552,"ondisk_log_size":1552,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23858448,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":5673,"num_write_kb":26542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32464896,"data_stored":47716896,"data_compressed":4732252,"data_compressed_allocated":7307264,"data_compressed_original":22618112,"omap_allocated":0,"internal_metadata":0},"log_size":5234,"ondisk_log_size":5234,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509836,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":4588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":4698112,"data_stored":7801495,"data_compressed":855543,"data_compressed_allocated":1261568,"data_compressed_original":4567040,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.90900000000000003,"15min":0.88700000000000001},"min":{"1min":0.58499999999999996,"5min":0.57299999999999995,"15min":0.371},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92200000000000004,"15min":0.93899999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.262,"5min":1.4710000000000001,"15min":1.6479999999999999},"last":1.0960000000000001}]},{"osd":1,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.97199999999999998,"15min":0.93300000000000005},"min":{"1min":0.68799999999999994,"5min":0.52000000000000002,"15min":0.44400000000000001},"max":{"1min":1.2869999999999999,"5min":1.3640000000000001,"15min":1.405},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.91500000000000004,"15min":0.93400000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.48599999999999999},"max":{"1min":1.1659999999999999,"5min":1.3500000000000001,"15min":1.504},"last":0.997}]},{"osd":2,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96199999999999997,"15min":0.92100000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.177},{"interface":"front","average":{"1min":0.873,"5min":0.95699999999999996,"15min":0.98299999999999998},"min":{"1min":0.63,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":1.1919999999999999,"5min":1.3109999999999999,"15min":1.776},"last":1.2070000000000001}]},{"osd":3,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.99099999999999999,"15min":1.0029999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.46700000000000003},"max":{"1min":1.089,"5min":1.363,"15min":2.0840000000000001},"last":1.246},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0549999999999999,"15min":1.0760000000000001},"min":{"1min":0.78900000000000003,"5min":0.61399999999999999,"15min":0.44800000000000001},"max":{"1min":1.387,"5min":1.427,"15min":2.181},"last":0.91200000000000003}]},{"osd":4,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.89600000000000002,"15min":0.91800000000000004},"min":{"1min":0.69199999999999995,"5min":0.35699999999999998,"15min":0.30199999999999999},"max":{"1min":1.25,"5min":1.444,"15min":1.972},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.02,"15min":1.0329999999999999},"min":{"1min":0.69499999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.587,"5min":1.587,"15min":1.8149999999999999},"last":0.94599999999999995}]},{"osd":6,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":0.999,"15min":1.026},"min":{"1min":0.73399999999999999,"5min":0.48199999999999998,"15min":0.41799999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":2.3069999999999999},"last":1.135},{"interface":"front","average":{"1min":1.129,"5min":1.0489999999999999,"15min":1.069},"min":{"1min":0.80900000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.8959999999999999},"last":0.875}]},{"osd":7,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.109,"15min":1.1100000000000001},"min":{"1min":0.74099999999999999,"5min":0.65100000000000002,"15min":0.56999999999999995},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1599999999999999,"15min":1.1719999999999999},"min":{"1min":0.92300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5529999999999999,"5min":1.7110000000000001,"15min":1.8600000000000001},"last":1.0309999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509836,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62188,"kb_used_data":8804,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309652,"statfs":{"total":96636764160,"available":96573083648,"internally_reserved":0,"allocated":9015296,"data_stored":12714767,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.27800000000000002},"max":{"1min":1.0700000000000001,"5min":1.3700000000000001,"15min":1.655},"last":1.141},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.79200000000000004,"15min":0.77500000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.34699999999999998},"max":{"1min":1.0649999999999999,"5min":1.504,"15min":1.7809999999999999},"last":0.71299999999999997}]},{"osd":1,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.30399999999999999},"max":{"1min":1.016,"5min":1.5189999999999999,"15min":1.5329999999999999},"last":0.623},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.91600000000000004,"15min":0.92500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.26900000000000002},"max":{"1min":1.1910000000000001,"5min":1.4490000000000001,"15min":2.036},"last":0.98699999999999999}]},{"osd":2,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.92700000000000005,"15min":0.92400000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0669999999999999,"5min":1.585,"15min":1.9470000000000001},"last":0.87},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.96999999999999997,"15min":0.98199999999999998},"min":{"1min":0.442,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1699999999999999,"5min":1.4450000000000001,"15min":1.786},"last":0.82699999999999996}]},{"osd":4,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0640000000000001,"15min":1.079},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.52000000000000002},"max":{"1min":1.718,"5min":1.73,"15min":1.73},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.056,"5min":1.147,"15min":1.137},"min":{"1min":0.622,"5min":0.622,"15min":0.53700000000000003},"max":{"1min":1.4990000000000001,"5min":1.875,"15min":2.3039999999999998},"last":1.083}]},{"osd":5,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.177,"15min":1.165},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.65700000000000003},"max":{"1min":1.635,"5min":2.0619999999999998,"15min":2.2999999999999998},"last":1.319},{"interface":"front","average":{"1min":1.196,"5min":1.228,"15min":1.2649999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.55000000000000004},"max":{"1min":1.681,"5min":2.0129999999999999,"15min":2.9319999999999999},"last":1.2689999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.258,"15min":1.284},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.587,"5min":1.9199999999999999,"15min":2.5510000000000002},"last":1.363},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2150000000000001,"15min":1.2170000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.621},"max":{"1min":1.55,"5min":1.8460000000000001,"15min":1.9059999999999999},"last":1.044}]},{"osd":7,"last update":"Fri Dec 8 21:26:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.258,"15min":1.2589999999999999},"min":{"1min":0.78400000000000003,"5min":0.72099999999999997,"15min":0.58899999999999997},"max":{"1min":1.611,"5min":1.849,"15min":1.849},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.3149999999999999,"15min":1.2969999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.58499999999999996},"max":{"1min":1.8620000000000001,"5min":1.966,"15min":2.1640000000000001},"last":1.2170000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509835,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37588,"kb_used_data":6412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334252,"statfs":{"total":96636764160,"available":96598274048,"internally_reserved":0,"allocated":6565888,"data_stored":8520553,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74399999999999999,"15min":0.747},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.4670000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.80300000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.316},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.87,"15min":0.872},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.38900000000000001},"max":{"1min":1.202,"5min":1.466,"15min":1.6599999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.91700000000000004,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":4.5620000000000003},"last":0.86899999999999999}]},{"osd":3,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.86699999999999999,"15min":0.84999999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.39300000000000002},"max":{"1min":1.0509999999999999,"5min":1.704,"15min":1.704},"last":0.753},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.008},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4330000000000001,"5min":1.643,"15min":1.661},"last":0.92000000000000004}]},{"osd":4,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.111,"15min":1.0960000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.51200000000000001},"max":{"1min":1.3169999999999999,"5min":1.647,"15min":1.726},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0589999999999999,"15min":1.0409999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2589999999999999,"5min":1.6060000000000001,"15min":1.6240000000000001},"last":0.97999999999999998}]},{"osd":5,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.208,"15min":1.1970000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5800000000000001,"5min":1.7649999999999999,"15min":1.8009999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.196,"15min":1.1910000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.61099999999999999},"max":{"1min":1.667,"5min":1.7470000000000001,"15min":1.855},"last":1.0189999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.133,"15min":1.131},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.7270000000000001},"last":1.071},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.54700000000000004},"max":{"1min":1.8100000000000001,"5min":1.907,"15min":2.0150000000000001},"last":1.343}]},{"osd":7,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.284,"15min":1.272},"min":{"1min":0.81399999999999995,"5min":0.76200000000000001,"15min":0.56999999999999995},"max":{"1min":1.7729999999999999,"5min":1.8400000000000001,"15min":1.9810000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.2370000000000001,"15min":1.2130000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.68500000000000005},"max":{"1min":1.74,"5min":1.7869999999999999,"15min":1.8240000000000001},"last":1.133}]}]},{"osd":1,"up_from":15,"seq":64424509837,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":721711,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72399999999999998,"15min":0.73899999999999999},"min":{"1min":0.32800000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.1890000000000001,"5min":1.2569999999999999,"15min":1.7689999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.84999999999999998,"15min":0.79800000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1319999999999999,"5min":1.556,"15min":1.556},"last":0.98499999999999999}]},{"osd":2,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.748,"15min":0.748},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.179,"5min":1.3899999999999999,"15min":1.4510000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.93600000000000005,"15min":0.90800000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.33500000000000002},"max":{"1min":1.1890000000000001,"5min":1.5069999999999999,"15min":2.0019999999999998},"last":1.218}]},{"osd":3,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.96999999999999997,"15min":0.94899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.32400000000000001},"max":{"1min":1.431,"5min":1.639,"15min":1.948},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.96499999999999997,"15min":0.93700000000000006},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.35199999999999998},"max":{"1min":1.109,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.1000000000000001,"15min":1.079},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.57299999999999995},"max":{"1min":1.3560000000000001,"5min":1.879,"15min":1.879},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.169,"15min":1.1599999999999999},"min":{"1min":0.79400000000000004,"5min":0.66900000000000004,"15min":0.626},"max":{"1min":1.518,"5min":1.7470000000000001,"15min":1.841},"last":1.1240000000000001}]},{"osd":5,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.2070000000000001,"15min":1.163},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.60199999999999998},"max":{"1min":1.3600000000000001,"5min":1.6899999999999999,"15min":1.9179999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1910000000000001,"15min":1.1639999999999999},"min":{"1min":0.67100000000000004,"5min":0.65300000000000002,"15min":0.64600000000000002},"max":{"1min":1.5649999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1879999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.2430000000000001,"15min":1.2350000000000001},"min":{"1min":0.64800000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.456,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.254,"15min":1.2310000000000001},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.482,"5min":1.7529999999999999,"15min":2.0259999999999998},"last":1.419}]},{"osd":7,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.3069999999999999,"15min":1.274},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.6220000000000001,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.468},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.27,"15min":1.2430000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.67300000000000004},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.242}]}]},{"osd":0,"up_from":15,"seq":64424509836,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46668,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94325172,"statfs":{"total":96636764160,"available":96588976128,"internally_reserved":0,"allocated":3084288,"data_stored":4325633,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1319999999999999,"5min":1.3819999999999999,"15min":1.698},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81000000000000005,"15min":0.80000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1990000000000001,"5min":1.788,"15min":1.907},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.34100000000000003},"max":{"1min":1.2989999999999999,"5min":1.633,"15min":1.633},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91500000000000004,"15min":0.875},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.639,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.81799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.657},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0289999999999999,"15min":1.016},"min":{"1min":0.48399999999999999,"5min":0.40999999999999998,"15min":0.38400000000000001},"max":{"1min":1.4890000000000001,"5min":1.694,"15min":2.2850000000000001},"last":1.0229999999999999}]},{"osd":4,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.1000000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.081,"15min":1.1160000000000001},"min":{"1min":0.68500000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":14.787000000000001},"last":1.2130000000000001}]},{"osd":5,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1890000000000001,"15min":1.1839999999999999},"min":{"1min":0.76700000000000002,"5min":0.68000000000000005,"15min":0.61699999999999999},"max":{"1min":1.726,"5min":1.726,"15min":2.218},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.226,"15min":1.2010000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.66900000000000004},"max":{"1min":1.8009999999999999,"5min":1.8740000000000001,"15min":2.2309999999999999},"last":0.94299999999999995}]},{"osd":6,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1499999999999999,"15min":1.1419999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.3380000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2929999999999999,"15min":1.28},"min":{"1min":0.80900000000000005,"5min":0.747,"15min":0.68500000000000005},"max":{"1min":1.927,"5min":1.927,"15min":2.1480000000000001},"last":1.1779999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:26:07 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.2729999999999999,"15min":1.266},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.60199999999999998},"max":{"1min":1.9730000000000001,"5min":2.0059999999999998,"15min":2.3300000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2250000000000001,"15min":1.218},"min":{"1min":0.73999999999999999,"5min":0.67000000000000004,"15min":0.58099999999999996},"max":{"1min":2.024,"5min":2.024,"15min":2.4319999999999999},"last":1.1519999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542540,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29016,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342824,"statfs":{"total":96636764160,"available":96607051776,"internally_reserved":0,"allocated":2048000,"data_stored":3016855,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.93500000000000005,"15min":0.91500000000000004},"min":{"1min":0.56399999999999995,"5min":0.55200000000000005,"15min":0.38100000000000001},"max":{"1min":1.268,"5min":1.321,"15min":1.8939999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.60199999999999998,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.256,"5min":1.948,"15min":1.948},"last":1.056}]},{"osd":1,"last update":"Fri Dec 8 21:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.96399999999999997,"15min":0.93700000000000006},"min":{"1min":0.56000000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3100000000000001,"5min":3.246,"15min":3.246},"last":1.165},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.95199999999999996,"15min":0.94999999999999996},"min":{"1min":0.64500000000000002,"5min":0.499,"15min":0.45400000000000001},"max":{"1min":1.3560000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.0860000000000001}]},{"osd":2,"last update":"Fri Dec 8 21:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97999999999999998,"15min":0.98199999999999998},"min":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.228,"5min":1.2569999999999999,"15min":1.9399999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.083,"5min":1,"15min":0.98699999999999999},"min":{"1min":0.749,"5min":0.61899999999999999,"15min":0.47799999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.8280000000000001},"last":1.018}]},{"osd":3,"last update":"Fri Dec 8 21:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0329999999999999,"15min":1.0349999999999999},"min":{"1min":0.748,"5min":0.57199999999999995,"15min":0.55300000000000005},"max":{"1min":1.26,"5min":1.528,"15min":1.528},"last":1.123},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0249999999999999,"15min":1.0109999999999999},"min":{"1min":0.747,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.274,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Dec 8 21:26:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.627,"5min":0.58099999999999996,"15min":0.55300000000000005},"max":{"1min":1.302,"5min":1.3859999999999999,"15min":1.45},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.92500000000000004,"15min":0.99399999999999999},"min":{"1min":0.55000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.389,"5min":1.389,"15min":1.5680000000000001},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Dec 8 21:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92900000000000005,"15min":0.98299999999999998},"min":{"1min":0.67300000000000004,"5min":0.63800000000000001,"15min":0.54400000000000004},"max":{"1min":1.448,"5min":1.448,"15min":1.7410000000000001},"last":1.228},{"interface":"front","average":{"1min":1.153,"5min":1.095,"15min":1.1299999999999999},"min":{"1min":0.80000000000000004,"5min":0.67600000000000005,"15min":0.55400000000000005},"max":{"1min":1.5209999999999999,"5min":1.6419999999999999,"15min":1.857},"last":1.2689999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:26:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0109999999999999,"15min":1.0800000000000001},"min":{"1min":0.78500000000000003,"5min":0.68799999999999994,"15min":0.66400000000000003},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.948},"last":1.304},{"interface":"front","average":{"1min":1.24,"5min":1.198,"15min":1.216},"min":{"1min":0.995,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":2.0019999999999998},"last":1.198}]}]},{"osd":6,"up_from":14,"seq":60129542541,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42332,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329508,"statfs":{"total":96636764160,"available":96593416192,"internally_reserved":0,"allocated":2904064,"data_stored":4325577,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94699999999999995,"15min":0.89900000000000002},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48799999999999999},"max":{"1min":1.2390000000000001,"5min":1.395,"15min":1.4430000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.96699999999999997,"15min":0.90800000000000003},"min":{"1min":0.66800000000000004,"5min":0.56599999999999995,"15min":0.44900000000000001},"max":{"1min":1.3200000000000001,"5min":1.3979999999999999,"15min":1.4790000000000001},"last":1.1100000000000001}]},{"osd":1,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.98699999999999999,"15min":0.93999999999999995},"min":{"1min":0.59099999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.92700000000000005,"15min":0.91900000000000004},"min":{"1min":0.78500000000000003,"5min":0.53600000000000003,"15min":0.48699999999999999},"max":{"1min":1.304,"5min":1.4159999999999999,"15min":1.512},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.96999999999999997,"15min":0.93700000000000006},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.53800000000000003},"max":{"1min":1.2729999999999999,"5min":1.357,"15min":1.421},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0429999999999999,"15min":0.999},"min":{"1min":0.80000000000000004,"5min":0.59099999999999997,"15min":0.51300000000000001},"max":{"1min":1.4690000000000001,"5min":1.546,"15min":1.546},"last":1.2070000000000001}]},{"osd":3,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.032,"15min":1.0229999999999999},"min":{"1min":0.69299999999999995,"5min":0.621,"15min":0.56000000000000005},"max":{"1min":1.3700000000000001,"5min":1.5529999999999999,"15min":1.708},"last":1.137},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1559999999999999,"15min":1.1259999999999999},"min":{"1min":0.77400000000000002,"5min":0.72499999999999998,"15min":0.54700000000000004},"max":{"1min":1.3959999999999999,"5min":1.542,"15min":1.7},"last":1.05}]},{"osd":4,"last update":"Fri Dec 8 21:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.96399999999999997,"15min":0.97299999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.50900000000000001},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.016,"15min":1.0009999999999999},"min":{"1min":0.71899999999999997,"5min":0.64000000000000001,"15min":0.57899999999999996},"max":{"1min":1.3169999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.69099999999999995,"5min":0.56499999999999995,"15min":0.53100000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.79},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1200000000000001,"15min":1.113},"min":{"1min":0.90400000000000003,"5min":0.69399999999999995,"15min":0.432},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.83199999999999996}]},{"osd":7,"last update":"Fri Dec 8 21:26:03 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.0600000000000001,"15min":1.0620000000000001},"min":{"1min":0.70399999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5820000000000001,"5min":1.732,"15min":1.732},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.198,"15min":1.198},"min":{"1min":0.79900000000000004,"5min":0.75900000000000001,"15min":0.47299999999999998},"max":{"1min":1.6859999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.163}]}]},{"osd":4,"up_from":14,"seq":60129542539,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55520,"kb_used_data":6296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316320,"statfs":{"total":96636764160,"available":96579911680,"internally_reserved":0,"allocated":6447104,"data_stored":8521225,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.501,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":1.238,"5min":1.381,"15min":1.6000000000000001},"last":0.876},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91800000000000004,"15min":0.90700000000000003},"min":{"1min":0.58399999999999996,"5min":0.51000000000000001,"15min":0.41399999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.391},"last":1.0660000000000001}]},{"osd":1,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.94399999999999995,"15min":0.91400000000000003},"min":{"1min":0.63600000000000001,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":1.3140000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.03,"15min":0.998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.46100000000000002},"max":{"1min":1.304,"5min":1.4530000000000001,"15min":1.4570000000000001},"last":1.0980000000000001}]},{"osd":2,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.004,"15min":1.0129999999999999},"min":{"1min":0.59399999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4079999999999999,"5min":1.4710000000000001,"15min":1.681},"last":1.167},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95099999999999996,"15min":0.94799999999999995},"min":{"1min":0.68600000000000005,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.2250000000000001,"5min":1.385,"15min":1.52},"last":1.0169999999999999}]},{"osd":3,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98999999999999999,"15min":0.98899999999999999},"min":{"1min":0.73999999999999999,"5min":0.63100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2629999999999999,"5min":1.927,"15min":1.927},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.139,"15min":1.1140000000000001},"min":{"1min":0.75900000000000001,"5min":0.64100000000000001,"15min":0.433},"max":{"1min":1.377,"5min":1.6519999999999999,"15min":1.7549999999999999},"last":0.92700000000000005}]},{"osd":5,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89400000000000002,"15min":0.92100000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.206,"5min":1.28,"15min":1.504},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.048,"5min":1.026,"15min":1.0049999999999999},"min":{"1min":0.61499999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.409,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.745}]},{"osd":6,"last update":"Fri Dec 8 21:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0469999999999999,"15min":1.0589999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.0740000000000001,"15min":1.0600000000000001},"min":{"1min":0.71199999999999997,"5min":0.69899999999999995,"15min":0.52900000000000003},"max":{"1min":1.4970000000000001,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.1240000000000001}]},{"osd":7,"last update":"Fri Dec 8 21:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.181,"15min":1.1619999999999999},"min":{"1min":0.65600000000000003,"5min":0.65500000000000003,"15min":0.39400000000000002},"max":{"1min":1.806,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0920000000000001,"15min":1.0980000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45400000000000001},"max":{"1min":1.4650000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":4194360,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6246400,"data_stored":8389280,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8695808,"data_stored":12583494,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":8389952,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4313088,"data_stored":7079854,"data_compressed":822166,"data_compressed_allocated":1216512,"data_compressed_original":3993600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":4194304,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1728512,"data_stored":2885582,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T21:26:58.837 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:58.838 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:58.838 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:58.838 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-08T20:54:54.559919+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:58.839 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-08T20:55:02.807686+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=21, tm_min=25, tm_sec=46, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T21:26:58.840 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-08T21:27:03.716 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:27:03.719 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:27:18.842 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T21:27:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.977+0000 7f8d2131f640 1 Processor -- start 2023-12-08T21:27:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.977+0000 7f8d2131f640 1 -- start start 2023-12-08T21:27:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.977+0000 7f8d2131f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d1c0c6410 0x7f8d1c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.977+0000 7f8d2131f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1c0c01a0 con 0x7f8d1c0c1cf0 2023-12-08T21:27:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.977+0000 7f8d2131f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1c06f3a0 con 0x7f8d1c0c1910 2023-12-08T21:27:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.977+0000 7f8d2131f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c06ede0 con 0x7f8d1c0c6410 2023-12-08T21:27:18.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.981+0000 7f8d13fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8d1c0c1cf0 0x7f8d1c15ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34134/0 (socket says 172.21.15.53:34134) 2023-12-08T21:27:18.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.981+0000 7f8d13fff640 1 -- 172.21.15.53:0/3671681958 learned_addr learned my addr 172.21.15.53:0/3671681958 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:27:18.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.981+0000 7f8d1b7fe640 1 --2- 172.21.15.53:0/3671681958 >> v2:172.21.15.146:3300/0 conn(0x7f8d1c0c6410 0x7f8d1c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:18.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.981+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043907047 0 0) 0x7f8d1c0c01a0 con 0x7f8d1c0c1cf0 2023-12-08T21:27:18.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.981+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d08003530 con 0x7f8d1c0c1cf0 2023-12-08T21:27:18.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098498641 0 0) 0x7f8d08003530 con 0x7f8d1c0c1cf0 2023-12-08T21:27:18.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 >> v2:172.21.15.146:3300/0 conn(0x7f8d1c0c6410 msgr2=0x7f8d1c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:18.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 --2- 172.21.15.53:0/3671681958 >> v2:172.21.15.146:3300/0 conn(0x7f8d1c0c6410 0x7f8d1c15a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:18.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 >> v1:172.21.15.146:6789/0 conn(0x7f8d1c0c1910 legacy=0x7f8d1c14cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:18.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c06f0c0 con 0x7f8d1c0c1cf0 2023-12-08T21:27:18.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 149952835 0 0) 0x7f8d04001680 con 0x7f8d1c0c1cf0 2023-12-08T21:27:18.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 >> v1:172.21.15.53:6789/0 conn(0x7f8d1c0c1cf0 legacy=0x7f8d1c15ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:18.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 --2- 172.21.15.53:0/3671681958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d080039d0 0x7f8d08003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:18.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 --2- 172.21.15.53:0/3671681958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d080047d0 0x7f8d08004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:18.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 --2- 172.21.15.53:0/3671681958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 0x7f8d0800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:18.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c06ede0 con 0x7f8d08005190 2023-12-08T21:27:18.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0800e2a0 con 0x7f8d080047d0 2023-12-08T21:27:18.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.985+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0800e460 con 0x7f8d080039d0 2023-12-08T21:27:18.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.989+0000 7f8d1affd640 1 --2- 172.21.15.53:0/3671681958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d080039d0 0x7f8d08003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:18.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.989+0000 7f8d1b7fe640 1 --2- 172.21.15.53:0/3671681958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 0x7f8d0800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:18.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.993+0000 7f8d1b7fe640 1 -- 172.21.15.53:0/3671681958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d080039d0 msgr2=0x7f8d08003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:18.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.993+0000 7f8d1b7fe640 1 --2- 172.21.15.53:0/3671681958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d080039d0 0x7f8d08003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:18.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.993+0000 7f8d1b7fe640 1 -- 172.21.15.53:0/3671681958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d080047d0 msgr2=0x7f8d08004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:18.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.993+0000 7f8d1b7fe640 1 --2- 172.21.15.53:0/3671681958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d080047d0 0x7f8d08004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:18.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.993+0000 7f8d1b7fe640 1 -- 172.21.15.53:0/3671681958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08003530 con 0x7f8d08005190 2023-12-08T21:27:18.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.993+0000 7f8d1b7fe640 1 -- 172.21.15.53:0/3671681958 reap_dead start 2023-12-08T21:27:18.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:18.997+0000 7f8d1b7fe640 1 --2- 172.21.15.53:0/3671681958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 0x7f8d0800dba0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009fc0 tx=0x7f8d1401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c3cabb0f57abad server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.001+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d140a5cb0 con 0x7f8d08005190 2023-12-08T21:27:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.001+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1400f040 con 0x7f8d08005190 2023-12-08T21:27:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.001+0000 7f8d1a7fc640 1 -- 172.21.15.53:0/3671681958 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14003be0 con 0x7f8d08005190 2023-12-08T21:27:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.001+0000 7f8d2131f640 1 -- 172.21.15.53:0/3671681958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 msgr2=0x7f8d0800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.001+0000 7f8d2131f640 1 --2- 172.21.15.53:0/3671681958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 0x7f8d0800dba0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009fc0 tx=0x7f8d1401cca0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.001+0000 7f8d2131f640 1 -- 172.21.15.53:0/3671681958 shutdown_connections 2023-12-08T21:27:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.001+0000 7f8d2131f640 1 --2- 172.21.15.53:0/3671681958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 0x7f8d0800dba0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.001+0000 7f8d2131f640 1 -- 172.21.15.53:0/3671681958 >> 172.21.15.53:0/3671681958 conn(0x7f8d1c0caef0 msgr2=0x7f8d1c0cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.001+0000 7f8d2131f640 1 -- 172.21.15.53:0/3671681958 shutdown_connections 2023-12-08T21:27:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.001+0000 7f8d2131f640 1 -- 172.21.15.53:0/3671681958 wait complete. 2023-12-08T21:27:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.001+0000 7f8d2131f640 1 Processor -- start 2023-12-08T21:27:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.005+0000 7f8d2131f640 1 -- start start 2023-12-08T21:27:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.005+0000 7f8d2131f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 0x7f8d1c1e1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.005+0000 7f8d2131f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c146150 0x7f8d1c1f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.005+0000 7f8d2131f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c0c7ac0 0x7f8d1c0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.005+0000 7f8d2131f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c1f2460 con 0x7f8d08005190 2023-12-08T21:27:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.005+0000 7f8d2131f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c0c8480 con 0x7f8d1c0c7ac0 2023-12-08T21:27:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.005+0000 7f8d2131f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c159610 con 0x7f8d1c146150 2023-12-08T21:27:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.005+0000 7f8d1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 0x7f8d1c1e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.005+0000 7f8d13fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c146150 0x7f8d1c1f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.005+0000 7f8d1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 0x7f8d1c1e1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40326/0 (socket says 172.21.15.53:40326) 2023-12-08T21:27:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.005+0000 7f8d1affd640 1 -- 172.21.15.53:0/1252075755 learned_addr learned my addr 172.21.15.53:0/1252075755 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:19.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.005+0000 7f8d1b7fe640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c0c7ac0 0x7f8d1c0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.009+0000 7f8d1affd640 1 -- 172.21.15.53:0/1252075755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c146150 msgr2=0x7f8d1c1f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:19.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.009+0000 7f8d1affd640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c146150 0x7f8d1c1f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.009+0000 7f8d1affd640 1 -- 172.21.15.53:0/1252075755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c0c7ac0 msgr2=0x7f8d1c0c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:19.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.009+0000 7f8d1affd640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c0c7ac0 0x7f8d1c0c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.009+0000 7f8d1affd640 1 -- 172.21.15.53:0/1252075755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c1e1f30 con 0x7f8d08005190 2023-12-08T21:27:19.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.013+0000 7f8d1affd640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 0x7f8d1c1e1940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00f820 tx=0x7f8d0c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:19.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.017+0000 7f8d137fe640 1 -- 172.21.15.53:0/1252075755 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c001cf0 con 0x7f8d08005190 2023-12-08T21:27:19.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.017+0000 7f8d137fe640 1 -- 172.21.15.53:0/1252075755 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c0052e0 con 0x7f8d08005190 2023-12-08T21:27:19.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.017+0000 7f8d2131f640 1 -- 172.21.15.53:0/1252075755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1c159050 con 0x7f8d08005190 2023-12-08T21:27:19.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.017+0000 7f8d137fe640 1 -- 172.21.15.53:0/1252075755 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00d970 con 0x7f8d08005190 2023-12-08T21:27:19.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.017+0000 7f8d2131f640 1 -- 172.21.15.53:0/1252075755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c1f2080 con 0x7f8d08005190 2023-12-08T21:27:19.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.017+0000 7f8d2131f640 1 -- 172.21.15.53:0/1252075755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1c1f2240 con 0x7f8d08005190 2023-12-08T21:27:19.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.329+0000 7f8d137fe640 1 -- 172.21.15.53:0/1252075755 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8d0c00dad0 con 0x7f8d08005190 2023-12-08T21:27:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.333+0000 7f8d137fe640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8cfc0664f0 0x7f8cfc0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.333+0000 7f8d13fff640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8cfc0664f0 0x7f8cfc0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:19.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.333+0000 7f8d13fff640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8cfc0664f0 0x7f8cfc0689b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8d04001ec0 tx=0x7f8d04001940 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:19.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.373+0000 7f8d137fe640 1 -- 172.21.15.53:0/1252075755 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f8d0c0558b0 con 0x7f8d08005190 2023-12-08T21:27:19.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.373+0000 7f8d137fe640 1 -- 172.21.15.53:0/1252075755 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d0c051bf0 con 0x7f8d08005190 2023-12-08T21:27:19.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.541+0000 7f8d2131f640 1 -- 172.21.15.53:0/1252075755 --> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d1c159c40 con 0x7f8cfc0664f0 2023-12-08T21:27:19.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.557+0000 7f8d137fe640 1 -- 172.21.15.53:0/1252075755 <== mgr.4105 v2:172.21.15.53:6800/748035024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372226 (secure 0 0 0) 0x7f8d0400f8e0 con 0x7f8cfc0664f0 2023-12-08T21:27:19.563 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:27:19.566 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-12-08T21:27:19.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.565+0000 7f8d2131f640 1 -- 172.21.15.53:0/1252075755 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8cfc0664f0 msgr2=0x7f8cfc0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:19.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.565+0000 7f8d2131f640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8cfc0664f0 0x7f8cfc0689b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8d04001ec0 tx=0x7f8d04001940 comp rx=0 tx=0).stop 2023-12-08T21:27:19.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.565+0000 7f8d2131f640 1 -- 172.21.15.53:0/1252075755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 msgr2=0x7f8d1c1e1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:19.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.565+0000 7f8d2131f640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 0x7f8d1c1e1940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00f820 tx=0x7f8d0c00fce0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.565+0000 7f8d2131f640 1 -- 172.21.15.53:0/1252075755 shutdown_connections 2023-12-08T21:27:19.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.565+0000 7f8d2131f640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8cfc0664f0 0x7f8cfc0689b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.565+0000 7f8d2131f640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c0c7ac0 0x7f8d1c0c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.565+0000 7f8d2131f640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c146150 0x7f8d1c1f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.565+0000 7f8d2131f640 1 --2- 172.21.15.53:0/1252075755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d08005190 0x7f8d1c1e1940 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.565+0000 7f8d2131f640 1 -- 172.21.15.53:0/1252075755 >> 172.21.15.53:0/1252075755 conn(0x7f8d1c0caef0 msgr2=0x7f8d1c14c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:19.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.565+0000 7f8d2131f640 1 -- 172.21.15.53:0/1252075755 shutdown_connections 2023-12-08T21:27:19.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.565+0000 7f8d2131f640 1 -- 172.21.15.53:0/1252075755 wait complete. 2023-12-08T21:27:19.590 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":1020,"stamp":"2023-12-08T21:27:18.088400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24448816,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":690,"num_read_kb":695,"num_write":8182,"num_write_kb":281588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9430,"ondisk_log_size":9430,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332312,"kb_used_data":34328,"kb_used_omap":12,"kb_used_meta":297907,"kb_avail":754642408,"statfs":{"total":773094113280,"available":772753825792,"internally_reserved":0,"allocated":35151872,"data_stored":49947816,"data_compressed":4799006,"data_compressed_allocated":7397376,"data_compressed_original":23764992,"omap_allocated":12752,"internal_metadata":305057328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005326"},"pg_stats":[{"pgid":"2.1f","version":"30'723","reported_seq":768,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.005407+0000","last_change":"2023-12-08T21:26:04.005407+0000","last_active":"2023-12-08T21:26:04.005407+0000","last_peered":"2023-12-08T21:26:04.005407+0000","last_clean":"2023-12-08T21:26:04.005407+0000","last_became_active":"2023-12-08T20:54:54.982479+0000","last_became_peered":"2023-12-08T20:54:54.982479+0000","last_unstale":"2023-12-08T21:26:04.005407+0000","last_undegraded":"2023-12-08T21:26:04.005407+0000","last_fullsized":"2023-12-08T21:26:04.005407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'723","last_scrub_stamp":"2023-12-08T21:26:04.005126+0000","last_deep_scrub":"30'723","last_deep_scrub_stamp":"2023-12-08T21:26:04.005126+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.005126+0000","objects_scrubbed":3,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:15:19.024106+0000","scrub_duration":0.032565425000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":4491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.842746+0000","last_change":"2023-12-08T21:26:17.842746+0000","last_active":"2023-12-08T21:26:17.842746+0000","last_peered":"2023-12-08T21:26:17.842746+0000","last_clean":"2023-12-08T21:26:17.842746+0000","last_became_active":"2023-12-08T20:54:56.406245+0000","last_became_peered":"2023-12-08T20:54:56.406245+0000","last_unstale":"2023-12-08T21:26:17.842746+0000","last_undegraded":"2023-12-08T21:26:17.842746+0000","last_fullsized":"2023-12-08T21:26:17.842746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:26:17.842517+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:26:17.842517+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.842517+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:52:41.624179+0000","scrub_duration":0.0034622569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'66","reported_seq":103,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.354863+0000","last_change":"2023-12-08T21:26:13.354863+0000","last_active":"2023-12-08T21:26:13.354863+0000","last_peered":"2023-12-08T21:26:13.354863+0000","last_clean":"2023-12-08T21:26:13.354863+0000","last_became_active":"2023-12-08T20:55:04.458087+0000","last_became_peered":"2023-12-08T20:55:04.458087+0000","last_unstale":"2023-12-08T21:26:13.354863+0000","last_undegraded":"2023-12-08T21:26:13.354863+0000","last_fullsized":"2023-12-08T21:26:13.354863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'66","last_scrub_stamp":"2023-12-08T21:26:13.354616+0000","last_deep_scrub":"30'66","last_deep_scrub_stamp":"2023-12-08T21:26:13.354616+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.354616+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:22:11.785201+0000","scrub_duration":0.0069482959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'291","reported_seq":337,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:12.896418+0000","last_change":"2023-12-08T21:26:12.896418+0000","last_active":"2023-12-08T21:26:12.896418+0000","last_peered":"2023-12-08T21:26:12.896418+0000","last_clean":"2023-12-08T21:26:12.896418+0000","last_became_active":"2023-12-08T20:54:54.929391+0000","last_became_peered":"2023-12-08T20:54:54.929391+0000","last_unstale":"2023-12-08T21:26:12.896418+0000","last_undegraded":"2023-12-08T21:26:12.896418+0000","last_fullsized":"2023-12-08T21:26:12.896418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'291","last_scrub_stamp":"2023-12-08T21:26:12.896235+0000","last_deep_scrub":"30'291","last_deep_scrub_stamp":"2023-12-08T21:26:12.896235+0000","last_clean_scrub_stamp":"2023-12-08T21:26:12.896235+0000","objects_scrubbed":1,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:55:16.287502+0000","scrub_duration":0.026480232999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759983,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":2843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:05.915231+0000","last_change":"2023-12-08T21:26:05.915231+0000","last_active":"2023-12-08T21:26:05.915231+0000","last_peered":"2023-12-08T21:26:05.915231+0000","last_clean":"2023-12-08T21:26:05.915231+0000","last_became_active":"2023-12-08T20:54:56.408361+0000","last_became_peered":"2023-12-08T20:54:56.408361+0000","last_unstale":"2023-12-08T21:26:05.915231+0000","last_undegraded":"2023-12-08T21:26:05.915231+0000","last_fullsized":"2023-12-08T21:26:05.915231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:05.914915+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:05.914915+0000","last_clean_scrub_stamp":"2023-12-08T21:26:05.914915+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:55:04.773085+0000","scrub_duration":0.0057752130000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'74","reported_seq":111,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:45.105789+0000","last_change":"2023-12-08T21:26:45.105850+0000","last_active":"2023-12-08T21:26:45.105789+0000","last_peered":"2023-12-08T21:26:45.105789+0000","last_clean":"2023-12-08T21:26:45.105789+0000","last_became_active":"2023-12-08T20:55:04.528732+0000","last_became_peered":"2023-12-08T20:55:04.528732+0000","last_unstale":"2023-12-08T21:26:45.105789+0000","last_undegraded":"2023-12-08T21:26:45.105789+0000","last_fullsized":"2023-12-08T21:26:45.105789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'74","last_scrub_stamp":"2023-12-08T21:26:45.105581+0000","last_deep_scrub":"30'74","last_deep_scrub_stamp":"2023-12-08T21:26:45.105581+0000","last_clean_scrub_stamp":"2023-12-08T21:26:45.105581+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:21:40.215877+0000","scrub_duration":0.007506693,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'10","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.114439+0000","last_change":"2023-12-08T21:26:06.114494+0000","last_active":"2023-12-08T21:26:06.114439+0000","last_peered":"2023-12-08T21:26:06.114439+0000","last_clean":"2023-12-08T21:26:06.114439+0000","last_became_active":"2023-12-08T20:54:54.935620+0000","last_became_peered":"2023-12-08T20:54:54.935620+0000","last_unstale":"2023-12-08T21:26:06.114439+0000","last_undegraded":"2023-12-08T21:26:06.114439+0000","last_fullsized":"2023-12-08T21:26:06.114439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'10","last_scrub_stamp":"2023-12-08T21:26:06.114261+0000","last_deep_scrub":"30'10","last_deep_scrub_stamp":"2023-12-08T21:26:06.114261+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.114261+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:08:13.151028+0000","scrub_duration":0.0062390579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'23","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.720222+0000","last_change":"2023-12-08T21:25:55.720252+0000","last_active":"2023-12-08T21:25:55.720222+0000","last_peered":"2023-12-08T21:25:55.720222+0000","last_clean":"2023-12-08T21:25:55.720222+0000","last_became_active":"2023-12-08T20:54:56.380927+0000","last_became_peered":"2023-12-08T20:54:56.380927+0000","last_unstale":"2023-12-08T21:25:55.720222+0000","last_undegraded":"2023-12-08T21:25:55.720222+0000","last_fullsized":"2023-12-08T21:25:55.720222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-12-08T21:25:55.720096+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-12-08T21:25:55.720096+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.720096+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:07:37.367406+0000","scrub_duration":0.001780451,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'75","reported_seq":111,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:36.073394+0000","last_change":"2023-12-08T21:26:36.073452+0000","last_active":"2023-12-08T21:26:36.073394+0000","last_peered":"2023-12-08T21:26:36.073394+0000","last_clean":"2023-12-08T21:26:36.073394+0000","last_became_active":"2023-12-08T20:55:04.526605+0000","last_became_peered":"2023-12-08T20:55:04.526605+0000","last_unstale":"2023-12-08T21:26:36.073394+0000","last_undegraded":"2023-12-08T21:26:36.073394+0000","last_fullsized":"2023-12-08T21:26:36.073394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'75","last_scrub_stamp":"2023-12-08T21:26:36.073188+0000","last_deep_scrub":"30'75","last_deep_scrub_stamp":"2023-12-08T21:26:36.073188+0000","last_clean_scrub_stamp":"2023-12-08T21:26:36.073188+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:11:04.385755+0000","scrub_duration":0.0062326710000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'4","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.138425+0000","last_change":"2023-12-08T21:25:59.138488+0000","last_active":"2023-12-08T21:25:59.138425+0000","last_peered":"2023-12-08T21:25:59.138425+0000","last_clean":"2023-12-08T21:25:59.138425+0000","last_became_active":"2023-12-08T20:54:54.926132+0000","last_became_peered":"2023-12-08T20:54:54.926132+0000","last_unstale":"2023-12-08T21:25:59.138425+0000","last_undegraded":"2023-12-08T21:25:59.138425+0000","last_fullsized":"2023-12-08T21:25:59.138425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:25:59.138233+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:25:59.138233+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.138233+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:45:09.492467+0000","scrub_duration":0.0063764290000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.270295+0000","last_change":"2023-12-08T21:25:53.270348+0000","last_active":"2023-12-08T21:25:53.270295+0000","last_peered":"2023-12-08T21:25:53.270295+0000","last_clean":"2023-12-08T21:25:53.270295+0000","last_became_active":"2023-12-08T20:54:56.387528+0000","last_became_peered":"2023-12-08T20:54:56.387528+0000","last_unstale":"2023-12-08T21:25:53.270295+0000","last_undegraded":"2023-12-08T21:25:53.270295+0000","last_fullsized":"2023-12-08T21:25:53.270295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-12-08T21:25:53.270101+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-12-08T21:25:53.270101+0000","last_clean_scrub_stamp":"2023-12-08T21:25:53.270101+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:05:32.821478+0000","scrub_duration":0.0031071860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'65","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:31.052896+0000","last_change":"2023-12-08T21:26:31.052951+0000","last_active":"2023-12-08T21:26:31.052896+0000","last_peered":"2023-12-08T21:26:31.052896+0000","last_clean":"2023-12-08T21:26:31.052896+0000","last_became_active":"2023-12-08T20:55:04.522777+0000","last_became_peered":"2023-12-08T20:55:04.522777+0000","last_unstale":"2023-12-08T21:26:31.052896+0000","last_undegraded":"2023-12-08T21:26:31.052896+0000","last_fullsized":"2023-12-08T21:26:31.052896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'65","last_scrub_stamp":"2023-12-08T21:26:31.052697+0000","last_deep_scrub":"30'65","last_deep_scrub_stamp":"2023-12-08T21:26:31.052697+0000","last_clean_scrub_stamp":"2023-12-08T21:26:31.052697+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:17:32.021452+0000","scrub_duration":0.0065787759999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'17","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:56.220369+0000","last_change":"2023-12-08T21:25:56.220422+0000","last_active":"2023-12-08T21:25:56.220369+0000","last_peered":"2023-12-08T21:25:56.220369+0000","last_clean":"2023-12-08T21:25:56.220369+0000","last_became_active":"2023-12-08T20:54:56.318855+0000","last_became_peered":"2023-12-08T20:54:56.318855+0000","last_unstale":"2023-12-08T21:25:56.220369+0000","last_undegraded":"2023-12-08T21:25:56.220369+0000","last_fullsized":"2023-12-08T21:25:56.220369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:25:56.220174+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:25:56.220174+0000","last_clean_scrub_stamp":"2023-12-08T21:25:56.220174+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:56:56.117995+0000","scrub_duration":0.0032244330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'724","reported_seq":768,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:20.319654+0000","last_change":"2023-12-08T21:26:20.319654+0000","last_active":"2023-12-08T21:26:20.319654+0000","last_peered":"2023-12-08T21:26:20.319654+0000","last_clean":"2023-12-08T21:26:20.319654+0000","last_became_active":"2023-12-08T20:54:54.928702+0000","last_became_peered":"2023-12-08T20:54:54.928702+0000","last_unstale":"2023-12-08T21:26:20.319654+0000","last_undegraded":"2023-12-08T21:26:20.319654+0000","last_fullsized":"2023-12-08T21:26:20.319654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'724","last_scrub_stamp":"2023-12-08T21:26:20.319380+0000","last_deep_scrub":"30'724","last_deep_scrub_stamp":"2023-12-08T21:26:20.319380+0000","last_clean_scrub_stamp":"2023-12-08T21:26:20.319380+0000","objects_scrubbed":2,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:20:37.962997+0000","scrub_duration":0.034444677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'78","reported_seq":116,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:49.452408+0000","last_change":"2023-12-08T21:26:49.452432+0000","last_active":"2023-12-08T21:26:49.452408+0000","last_peered":"2023-12-08T21:26:49.452408+0000","last_clean":"2023-12-08T21:26:49.452408+0000","last_became_active":"2023-12-08T20:55:04.535119+0000","last_became_peered":"2023-12-08T20:55:04.535119+0000","last_unstale":"2023-12-08T21:26:49.452408+0000","last_undegraded":"2023-12-08T21:26:49.452408+0000","last_fullsized":"2023-12-08T21:26:49.452408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'78","last_scrub_stamp":"2023-12-08T21:26:49.452315+0000","last_deep_scrub":"30'78","last_deep_scrub_stamp":"2023-12-08T21:26:49.452315+0000","last_clean_scrub_stamp":"2023-12-08T21:26:49.452315+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:46:22.898222+0000","scrub_duration":0.0048583580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":12383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.326859+0000","last_change":"2023-12-08T21:26:08.326859+0000","last_active":"2023-12-08T21:26:08.326859+0000","last_peered":"2023-12-08T21:26:08.326859+0000","last_clean":"2023-12-08T21:26:08.326859+0000","last_became_active":"2023-12-08T20:54:56.370044+0000","last_became_peered":"2023-12-08T20:54:56.370044+0000","last_unstale":"2023-12-08T21:26:08.326859+0000","last_undegraded":"2023-12-08T21:26:08.326859+0000","last_fullsized":"2023-12-08T21:26:08.326859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2023-12-08T21:26:08.326522+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2023-12-08T21:26:08.326522+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.326522+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:07:31.757565+0000","scrub_duration":0.0050124770000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'5","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:57.537252+0000","last_change":"2023-12-08T21:25:57.537304+0000","last_active":"2023-12-08T21:25:57.537252+0000","last_peered":"2023-12-08T21:25:57.537252+0000","last_clean":"2023-12-08T21:25:57.537252+0000","last_became_active":"2023-12-08T20:54:54.922960+0000","last_became_peered":"2023-12-08T20:54:54.922960+0000","last_unstale":"2023-12-08T21:25:57.537252+0000","last_undegraded":"2023-12-08T21:25:57.537252+0000","last_fullsized":"2023-12-08T21:25:57.537252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:25:57.537058+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:25:57.537058+0000","last_clean_scrub_stamp":"2023-12-08T21:25:57.537058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:59:00.836091+0000","scrub_duration":0.0026381299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'95","reported_seq":133,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:36.246599+0000","last_change":"2023-12-08T21:26:36.246655+0000","last_active":"2023-12-08T21:26:36.246599+0000","last_peered":"2023-12-08T21:26:36.246599+0000","last_clean":"2023-12-08T21:26:36.246599+0000","last_became_active":"2023-12-08T20:55:04.522172+0000","last_became_peered":"2023-12-08T20:55:04.522172+0000","last_unstale":"2023-12-08T21:26:36.246599+0000","last_undegraded":"2023-12-08T21:26:36.246599+0000","last_fullsized":"2023-12-08T21:26:36.246599+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'95","last_scrub_stamp":"2023-12-08T21:26:36.246395+0000","last_deep_scrub":"30'95","last_deep_scrub_stamp":"2023-12-08T21:26:36.246395+0000","last_clean_scrub_stamp":"2023-12-08T21:26:36.246395+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:44:36.664221+0000","scrub_duration":0.0059448610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'24","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.988500+0000","last_change":"2023-12-08T21:26:06.988550+0000","last_active":"2023-12-08T21:26:06.988500+0000","last_peered":"2023-12-08T21:26:06.988500+0000","last_clean":"2023-12-08T21:26:06.988500+0000","last_became_active":"2023-12-08T20:54:56.365552+0000","last_became_peered":"2023-12-08T20:54:56.365552+0000","last_unstale":"2023-12-08T21:26:06.988500+0000","last_undegraded":"2023-12-08T21:26:06.988500+0000","last_fullsized":"2023-12-08T21:26:06.988500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:06.988314+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:06.988314+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.988314+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:03:51.063039+0000","scrub_duration":0.0036073989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'3","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.063454+0000","last_change":"2023-12-08T21:26:01.063563+0000","last_active":"2023-12-08T21:26:01.063454+0000","last_peered":"2023-12-08T21:26:01.063454+0000","last_clean":"2023-12-08T21:26:01.063454+0000","last_became_active":"2023-12-08T20:54:54.979668+0000","last_became_peered":"2023-12-08T20:54:54.979668+0000","last_unstale":"2023-12-08T21:26:01.063454+0000","last_undegraded":"2023-12-08T21:26:01.063454+0000","last_fullsized":"2023-12-08T21:26:01.063454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:26:01.063157+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:26:01.063157+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.063157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:35:10.066399+0000","scrub_duration":0.0036668270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'67","reported_seq":105,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:16.259836+0000","last_change":"2023-12-08T21:26:16.259836+0000","last_active":"2023-12-08T21:26:16.259836+0000","last_peered":"2023-12-08T21:26:16.259836+0000","last_clean":"2023-12-08T21:26:16.259836+0000","last_became_active":"2023-12-08T20:55:04.512549+0000","last_became_peered":"2023-12-08T20:55:04.512549+0000","last_unstale":"2023-12-08T21:26:16.259836+0000","last_undegraded":"2023-12-08T21:26:16.259836+0000","last_fullsized":"2023-12-08T21:26:16.259836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'67","last_scrub_stamp":"2023-12-08T21:26:16.259537+0000","last_deep_scrub":"30'67","last_deep_scrub_stamp":"2023-12-08T21:26:16.259537+0000","last_clean_scrub_stamp":"2023-12-08T21:26:16.259537+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:51:54.386694+0000","scrub_duration":0.005660259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:05.098379+0000","last_change":"2023-12-08T21:26:05.098498+0000","last_active":"2023-12-08T21:26:05.098379+0000","last_peered":"2023-12-08T21:26:05.098379+0000","last_clean":"2023-12-08T21:26:05.098379+0000","last_became_active":"2023-12-08T20:54:56.260355+0000","last_became_peered":"2023-12-08T20:54:56.260355+0000","last_unstale":"2023-12-08T21:26:05.098379+0000","last_undegraded":"2023-12-08T21:26:05.098379+0000","last_fullsized":"2023-12-08T21:26:05.098379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:05.098155+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:05.098155+0000","last_clean_scrub_stamp":"2023-12-08T21:26:05.098155+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:42:49.369328+0000","scrub_duration":0.0031917870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'6","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:00.129273+0000","last_change":"2023-12-08T21:26:00.129326+0000","last_active":"2023-12-08T21:26:00.129273+0000","last_peered":"2023-12-08T21:26:00.129273+0000","last_clean":"2023-12-08T21:26:00.129273+0000","last_became_active":"2023-12-08T20:54:54.925888+0000","last_became_peered":"2023-12-08T20:54:54.925888+0000","last_unstale":"2023-12-08T21:26:00.129273+0000","last_undegraded":"2023-12-08T21:26:00.129273+0000","last_fullsized":"2023-12-08T21:26:00.129273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:26:00.129079+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:26:00.129079+0000","last_clean_scrub_stamp":"2023-12-08T21:26:00.129079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:31:04.788470+0000","scrub_duration":0.002440752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'77","reported_seq":115,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:41.100928+0000","last_change":"2023-12-08T21:26:41.100990+0000","last_active":"2023-12-08T21:26:41.100928+0000","last_peered":"2023-12-08T21:26:41.100928+0000","last_clean":"2023-12-08T21:26:41.100928+0000","last_became_active":"2023-12-08T20:55:04.528640+0000","last_became_peered":"2023-12-08T20:55:04.528640+0000","last_unstale":"2023-12-08T21:26:41.100928+0000","last_undegraded":"2023-12-08T21:26:41.100928+0000","last_fullsized":"2023-12-08T21:26:41.100928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'77","last_scrub_stamp":"2023-12-08T21:26:41.100713+0000","last_deep_scrub":"30'77","last_deep_scrub_stamp":"2023-12-08T21:26:41.100713+0000","last_clean_scrub_stamp":"2023-12-08T21:26:41.100713+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:55:30.113824+0000","scrub_duration":0.0074332440000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.094936+0000","last_change":"2023-12-08T21:25:55.094987+0000","last_active":"2023-12-08T21:25:55.094936+0000","last_peered":"2023-12-08T21:25:55.094936+0000","last_clean":"2023-12-08T21:25:55.094936+0000","last_became_active":"2023-12-08T20:54:56.364597+0000","last_became_peered":"2023-12-08T20:54:56.364597+0000","last_unstale":"2023-12-08T21:25:55.094936+0000","last_undegraded":"2023-12-08T21:25:55.094936+0000","last_fullsized":"2023-12-08T21:25:55.094936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-12-08T21:25:55.094713+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-12-08T21:25:55.094713+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.094713+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:04:47.008353+0000","scrub_duration":0.00344094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'6","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:29.259458+0000","last_change":"2023-12-08T21:26:29.259541+0000","last_active":"2023-12-08T21:26:29.259458+0000","last_peered":"2023-12-08T21:26:29.259458+0000","last_clean":"2023-12-08T21:26:29.259458+0000","last_became_active":"2023-12-08T20:54:54.927814+0000","last_became_peered":"2023-12-08T20:54:54.927814+0000","last_unstale":"2023-12-08T21:26:29.259458+0000","last_undegraded":"2023-12-08T21:26:29.259458+0000","last_fullsized":"2023-12-08T21:26:29.259458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:26:29.259239+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:26:29.259239+0000","last_clean_scrub_stamp":"2023-12-08T21:26:29.259239+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:15:48.929649+0000","scrub_duration":0.0064215950000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'64","reported_seq":103,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:49.086323+0000","last_change":"2023-12-08T21:26:49.086441+0000","last_active":"2023-12-08T21:26:49.086323+0000","last_peered":"2023-12-08T21:26:49.086323+0000","last_clean":"2023-12-08T21:26:49.086323+0000","last_became_active":"2023-12-08T20:55:04.522714+0000","last_became_peered":"2023-12-08T20:55:04.522714+0000","last_unstale":"2023-12-08T21:26:49.086323+0000","last_undegraded":"2023-12-08T21:26:49.086323+0000","last_fullsized":"2023-12-08T21:26:49.086323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'64","last_scrub_stamp":"2023-12-08T21:26:49.085974+0000","last_deep_scrub":"30'64","last_deep_scrub_stamp":"2023-12-08T21:26:49.085974+0000","last_clean_scrub_stamp":"2023-12-08T21:26:49.085974+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:04:16.267852+0000","scrub_duration":0.0075080989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":9451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.956170+0000","last_change":"2023-12-08T21:26:17.956227+0000","last_active":"2023-12-08T21:26:17.956170+0000","last_peered":"2023-12-08T21:26:17.956170+0000","last_clean":"2023-12-08T21:26:17.956170+0000","last_became_active":"2023-12-08T20:54:56.330508+0000","last_became_peered":"2023-12-08T20:54:56.330508+0000","last_unstale":"2023-12-08T21:26:17.956170+0000","last_undegraded":"2023-12-08T21:26:17.956170+0000","last_fullsized":"2023-12-08T21:26:17.956170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:17.955970+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:17.955970+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.955970+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:06:44.699142+0000","scrub_duration":0.0048835149999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'333","reported_seq":377,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:02.992564+0000","last_change":"2023-12-08T21:26:02.992617+0000","last_active":"2023-12-08T21:26:02.992564+0000","last_peered":"2023-12-08T21:26:02.992564+0000","last_clean":"2023-12-08T21:26:02.992564+0000","last_became_active":"2023-12-08T20:54:54.981168+0000","last_became_peered":"2023-12-08T20:54:54.981168+0000","last_unstale":"2023-12-08T21:26:02.992564+0000","last_undegraded":"2023-12-08T21:26:02.992564+0000","last_fullsized":"2023-12-08T21:26:02.992564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'333","last_scrub_stamp":"2023-12-08T21:26:02.992373+0000","last_deep_scrub":"30'333","last_deep_scrub_stamp":"2023-12-08T21:26:02.992373+0000","last_clean_scrub_stamp":"2023-12-08T21:26:02.992373+0000","objects_scrubbed":1,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:49:36.659212+0000","scrub_duration":0.013256799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'104","reported_seq":144,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:22.992885+0000","last_change":"2023-12-08T21:26:22.992885+0000","last_active":"2023-12-08T21:26:22.992885+0000","last_peered":"2023-12-08T21:26:22.992885+0000","last_clean":"2023-12-08T21:26:22.992885+0000","last_became_active":"2023-12-08T20:55:04.511032+0000","last_became_peered":"2023-12-08T20:55:04.511032+0000","last_unstale":"2023-12-08T21:26:22.992885+0000","last_undegraded":"2023-12-08T21:26:22.992885+0000","last_fullsized":"2023-12-08T21:26:22.992885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'104","last_scrub_stamp":"2023-12-08T21:26:22.992736+0000","last_deep_scrub":"30'104","last_deep_scrub_stamp":"2023-12-08T21:26:22.992736+0000","last_clean_scrub_stamp":"2023-12-08T21:26:22.992736+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:20:50.133005+0000","scrub_duration":0.0062269689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":14212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'22","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.466208+0000","last_change":"2023-12-08T21:26:06.466208+0000","last_active":"2023-12-08T21:26:06.466208+0000","last_peered":"2023-12-08T21:26:06.466208+0000","last_clean":"2023-12-08T21:26:06.466208+0000","last_became_active":"2023-12-08T20:54:56.409291+0000","last_became_peered":"2023-12-08T20:54:56.409291+0000","last_unstale":"2023-12-08T21:26:06.466208+0000","last_undegraded":"2023-12-08T21:26:06.466208+0000","last_fullsized":"2023-12-08T21:26:06.466208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:06.465949+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:06.465949+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.465949+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:01:20.008768+0000","scrub_duration":0.0028777999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'5","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:24.230287+0000","last_change":"2023-12-08T21:26:24.230339+0000","last_active":"2023-12-08T21:26:24.230287+0000","last_peered":"2023-12-08T21:26:24.230287+0000","last_clean":"2023-12-08T21:26:24.230287+0000","last_became_active":"2023-12-08T20:54:54.978416+0000","last_became_peered":"2023-12-08T20:54:54.978416+0000","last_unstale":"2023-12-08T21:26:24.230287+0000","last_undegraded":"2023-12-08T21:26:24.230287+0000","last_fullsized":"2023-12-08T21:26:24.230287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:24.230104+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:24.230104+0000","last_clean_scrub_stamp":"2023-12-08T21:26:24.230104+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:02:35.315437+0000","scrub_duration":0.0024408920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'75","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:25.600755+0000","last_change":"2023-12-08T21:26:25.600817+0000","last_active":"2023-12-08T21:26:25.600755+0000","last_peered":"2023-12-08T21:26:25.600755+0000","last_clean":"2023-12-08T21:26:25.600755+0000","last_became_active":"2023-12-08T20:55:04.507454+0000","last_became_peered":"2023-12-08T20:55:04.507454+0000","last_unstale":"2023-12-08T21:26:25.600755+0000","last_undegraded":"2023-12-08T21:26:25.600755+0000","last_fullsized":"2023-12-08T21:26:25.600755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'75","last_scrub_stamp":"2023-12-08T21:26:25.600621+0000","last_deep_scrub":"30'75","last_deep_scrub_stamp":"2023-12-08T21:26:25.600621+0000","last_clean_scrub_stamp":"2023-12-08T21:26:25.600621+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:30:14.904992+0000","scrub_duration":0.0057153899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'17","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.919895+0000","last_change":"2023-12-08T21:25:55.919895+0000","last_active":"2023-12-08T21:25:55.919895+0000","last_peered":"2023-12-08T21:25:55.919895+0000","last_clean":"2023-12-08T21:25:55.919895+0000","last_became_active":"2023-12-08T20:54:56.369974+0000","last_became_peered":"2023-12-08T20:54:56.369974+0000","last_unstale":"2023-12-08T21:25:55.919895+0000","last_undegraded":"2023-12-08T21:25:55.919895+0000","last_fullsized":"2023-12-08T21:25:55.919895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:25:55.919642+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:25:55.919642+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.919642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:26:40.855619+0000","scrub_duration":0.0027648270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'3","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.967650+0000","last_change":"2023-12-08T21:26:08.967650+0000","last_active":"2023-12-08T21:26:08.967650+0000","last_peered":"2023-12-08T21:26:08.967650+0000","last_clean":"2023-12-08T21:26:08.967650+0000","last_became_active":"2023-12-08T20:54:54.925022+0000","last_became_peered":"2023-12-08T20:54:54.925022+0000","last_unstale":"2023-12-08T21:26:08.967650+0000","last_undegraded":"2023-12-08T21:26:08.967650+0000","last_fullsized":"2023-12-08T21:26:08.967650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:26:08.967384+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:26:08.967384+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.967384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:00:44.981669+0000","scrub_duration":0.0030121089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'85","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:28.727979+0000","last_change":"2023-12-08T21:26:28.728039+0000","last_active":"2023-12-08T21:26:28.727979+0000","last_peered":"2023-12-08T21:26:28.727979+0000","last_clean":"2023-12-08T21:26:28.727979+0000","last_became_active":"2023-12-08T20:55:04.530774+0000","last_became_peered":"2023-12-08T20:55:04.530774+0000","last_unstale":"2023-12-08T21:26:28.727979+0000","last_undegraded":"2023-12-08T21:26:28.727979+0000","last_fullsized":"2023-12-08T21:26:28.727979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'85","last_scrub_stamp":"2023-12-08T21:26:28.727787+0000","last_deep_scrub":"30'85","last_deep_scrub_stamp":"2023-12-08T21:26:28.727787+0000","last_clean_scrub_stamp":"2023-12-08T21:26:28.727787+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:17:55.250169+0000","scrub_duration":0.0057543309999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:48.955617+0000","last_change":"2023-12-08T21:25:48.955617+0000","last_active":"2023-12-08T21:25:48.955617+0000","last_peered":"2023-12-08T21:25:48.955617+0000","last_clean":"2023-12-08T21:25:48.955617+0000","last_became_active":"2023-12-08T20:54:56.385090+0000","last_became_peered":"2023-12-08T20:54:56.385090+0000","last_unstale":"2023-12-08T21:25:48.955617+0000","last_undegraded":"2023-12-08T21:25:48.955617+0000","last_fullsized":"2023-12-08T21:25:48.955617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:25:48.955488+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:25:48.955488+0000","last_clean_scrub_stamp":"2023-12-08T21:25:48.955488+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:12:34.372718+0000","scrub_duration":0.001815419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'6","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:30.222450+0000","last_change":"2023-12-08T21:26:30.222503+0000","last_active":"2023-12-08T21:26:30.222450+0000","last_peered":"2023-12-08T21:26:30.222450+0000","last_clean":"2023-12-08T21:26:30.222450+0000","last_became_active":"2023-12-08T20:54:54.932121+0000","last_became_peered":"2023-12-08T20:54:54.932121+0000","last_unstale":"2023-12-08T21:26:30.222450+0000","last_undegraded":"2023-12-08T21:26:30.222450+0000","last_fullsized":"2023-12-08T21:26:30.222450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:26:30.222251+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:26:30.222251+0000","last_clean_scrub_stamp":"2023-12-08T21:26:30.222251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:37:07.100059+0000","scrub_duration":0.0031246490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'55","reported_seq":94,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:33.736029+0000","last_change":"2023-12-08T21:26:33.736089+0000","last_active":"2023-12-08T21:26:33.736029+0000","last_peered":"2023-12-08T21:26:33.736029+0000","last_clean":"2023-12-08T21:26:33.736029+0000","last_became_active":"2023-12-08T20:55:04.528698+0000","last_became_peered":"2023-12-08T20:55:04.528698+0000","last_unstale":"2023-12-08T21:26:33.736029+0000","last_undegraded":"2023-12-08T21:26:33.736029+0000","last_fullsized":"2023-12-08T21:26:33.736029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'55","last_scrub_stamp":"2023-12-08T21:26:33.735880+0000","last_deep_scrub":"30'55","last_deep_scrub_stamp":"2023-12-08T21:26:33.735880+0000","last_clean_scrub_stamp":"2023-12-08T21:26:33.735880+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:51:26.467490+0000","scrub_duration":0.0055649899999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'24","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:33.929295+0000","last_change":"2023-12-08T21:26:33.929295+0000","last_active":"2023-12-08T21:26:33.929295+0000","last_peered":"2023-12-08T21:26:33.929295+0000","last_clean":"2023-12-08T21:26:33.929295+0000","last_became_active":"2023-12-08T20:54:56.412786+0000","last_became_peered":"2023-12-08T20:54:56.412786+0000","last_unstale":"2023-12-08T21:26:33.929295+0000","last_undegraded":"2023-12-08T21:26:33.929295+0000","last_fullsized":"2023-12-08T21:26:33.929295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:33.929031+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:33.929031+0000","last_clean_scrub_stamp":"2023-12-08T21:26:33.929031+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:39:06.696933+0000","scrub_duration":0.0034301499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'577","reported_seq":1196,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:05.340354+0000","last_change":"2023-12-08T21:26:05.340354+0000","last_active":"2023-12-08T21:26:05.340354+0000","last_peered":"2023-12-08T21:26:05.340354+0000","last_clean":"2023-12-08T21:26:05.340354+0000","last_became_active":"2023-12-08T20:54:54.922014+0000","last_became_peered":"2023-12-08T20:54:54.922014+0000","last_unstale":"2023-12-08T21:26:05.340354+0000","last_undegraded":"2023-12-08T21:26:05.340354+0000","last_fullsized":"2023-12-08T21:26:05.340354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'577","last_scrub_stamp":"2023-12-08T21:26:05.340116+0000","last_deep_scrub":"30'577","last_deep_scrub_stamp":"2023-12-08T21:26:05.340116+0000","last_clean_scrub_stamp":"2023-12-08T21:26:05.340116+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:25.924782+0000","scrub_duration":0.0067660819999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125475,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":574,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'71","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:32.720257+0000","last_change":"2023-12-08T21:26:32.720313+0000","last_active":"2023-12-08T21:26:32.720257+0000","last_peered":"2023-12-08T21:26:32.720257+0000","last_clean":"2023-12-08T21:26:32.720257+0000","last_became_active":"2023-12-08T20:55:04.508219+0000","last_became_peered":"2023-12-08T20:55:04.508219+0000","last_unstale":"2023-12-08T21:26:32.720257+0000","last_undegraded":"2023-12-08T21:26:32.720257+0000","last_fullsized":"2023-12-08T21:26:32.720257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'71","last_scrub_stamp":"2023-12-08T21:26:32.720060+0000","last_deep_scrub":"30'71","last_deep_scrub_stamp":"2023-12-08T21:26:32.720060+0000","last_clean_scrub_stamp":"2023-12-08T21:26:32.720060+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:08:42.229813+0000","scrub_duration":0.0047733469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'15","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.515080+0000","last_change":"2023-12-08T21:26:01.515080+0000","last_active":"2023-12-08T21:26:01.515080+0000","last_peered":"2023-12-08T21:26:01.515080+0000","last_clean":"2023-12-08T21:26:01.515080+0000","last_became_active":"2023-12-08T20:54:56.370121+0000","last_became_peered":"2023-12-08T20:54:56.370121+0000","last_unstale":"2023-12-08T21:26:01.515080+0000","last_undegraded":"2023-12-08T21:26:01.515080+0000","last_fullsized":"2023-12-08T21:26:01.515080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2023-12-08T21:26:01.514730+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2023-12-08T21:26:01.514730+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.514730+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:38:40.393317+0000","scrub_duration":0.0030279830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'5","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:19.277760+0000","last_change":"2023-12-08T21:26:19.277760+0000","last_active":"2023-12-08T21:26:19.277760+0000","last_peered":"2023-12-08T21:26:19.277760+0000","last_clean":"2023-12-08T21:26:19.277760+0000","last_became_active":"2023-12-08T20:54:54.927120+0000","last_became_peered":"2023-12-08T20:54:54.927120+0000","last_unstale":"2023-12-08T21:26:19.277760+0000","last_undegraded":"2023-12-08T21:26:19.277760+0000","last_fullsized":"2023-12-08T21:26:19.277760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:19.277517+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:19.277517+0000","last_clean_scrub_stamp":"2023-12-08T21:26:19.277517+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:23:11.851788+0000","scrub_duration":0.0053390110000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'100","reported_seq":138,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:27:00.750327+0000","last_change":"2023-12-08T21:27:00.750389+0000","last_active":"2023-12-08T21:27:00.750327+0000","last_peered":"2023-12-08T21:27:00.750327+0000","last_clean":"2023-12-08T21:27:00.750327+0000","last_became_active":"2023-12-08T20:55:04.546439+0000","last_became_peered":"2023-12-08T20:55:04.546439+0000","last_unstale":"2023-12-08T21:27:00.750327+0000","last_undegraded":"2023-12-08T21:27:00.750327+0000","last_fullsized":"2023-12-08T21:27:00.750327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'100","last_scrub_stamp":"2023-12-08T21:27:00.750105+0000","last_deep_scrub":"30'100","last_deep_scrub_stamp":"2023-12-08T21:27:00.750105+0000","last_clean_scrub_stamp":"2023-12-08T21:27:00.750105+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:40:56.332006+0000","scrub_duration":0.007254066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'20","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.022881+0000","last_change":"2023-12-08T21:26:08.022881+0000","last_active":"2023-12-08T21:26:08.022881+0000","last_peered":"2023-12-08T21:26:08.022881+0000","last_clean":"2023-12-08T21:26:08.022881+0000","last_became_active":"2023-12-08T20:54:56.372205+0000","last_became_peered":"2023-12-08T20:54:56.372205+0000","last_unstale":"2023-12-08T21:26:08.022881+0000","last_undegraded":"2023-12-08T21:26:08.022881+0000","last_fullsized":"2023-12-08T21:26:08.022881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:08.022557+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:08.022557+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.022557+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:31:12.681949+0000","scrub_duration":0.0030864669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'2","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:22.310608+0000","last_change":"2023-12-08T21:26:22.310661+0000","last_active":"2023-12-08T21:26:22.310608+0000","last_peered":"2023-12-08T21:26:22.310608+0000","last_clean":"2023-12-08T21:26:22.310608+0000","last_became_active":"2023-12-08T20:54:54.929177+0000","last_became_peered":"2023-12-08T20:54:54.929177+0000","last_unstale":"2023-12-08T21:26:22.310608+0000","last_undegraded":"2023-12-08T21:26:22.310608+0000","last_fullsized":"2023-12-08T21:26:22.310608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-08T21:26:22.310416+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-08T21:26:22.310416+0000","last_clean_scrub_stamp":"2023-12-08T21:26:22.310416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:33:18.117971+0000","scrub_duration":0.0028091259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":200,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:50.676647+0000","last_change":"2023-12-08T21:25:50.676647+0000","last_active":"2023-12-08T21:25:50.676647+0000","last_peered":"2023-12-08T21:25:50.676647+0000","last_clean":"2023-12-08T21:25:50.676647+0000","last_became_active":"2023-12-08T20:54:16.147507+0000","last_became_peered":"2023-12-08T20:54:16.147507+0000","last_unstale":"2023-12-08T21:25:50.676647+0000","last_undegraded":"2023-12-08T21:25:50.676647+0000","last_fullsized":"2023-12-08T21:25:50.676647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-12-08T21:25:50.676240+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-12-08T21:25:50.676240+0000","last_clean_scrub_stamp":"2023-12-08T21:25:50.676240+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:06:52.271476+0000","scrub_duration":0.014230578000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'75","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:38.381119+0000","last_change":"2023-12-08T21:26:38.381184+0000","last_active":"2023-12-08T21:26:38.381119+0000","last_peered":"2023-12-08T21:26:38.381119+0000","last_clean":"2023-12-08T21:26:38.381119+0000","last_became_active":"2023-12-08T20:55:04.515200+0000","last_became_peered":"2023-12-08T20:55:04.515200+0000","last_unstale":"2023-12-08T21:26:38.381119+0000","last_undegraded":"2023-12-08T21:26:38.381119+0000","last_fullsized":"2023-12-08T21:26:38.381119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'75","last_scrub_stamp":"2023-12-08T21:26:38.380934+0000","last_deep_scrub":"30'75","last_deep_scrub_stamp":"2023-12-08T21:26:38.380934+0000","last_clean_scrub_stamp":"2023-12-08T21:26:38.380934+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:35:52.967123+0000","scrub_duration":0.0095457140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'22","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:31.195729+0000","last_change":"2023-12-08T21:26:31.195849+0000","last_active":"2023-12-08T21:26:31.195729+0000","last_peered":"2023-12-08T21:26:31.195729+0000","last_clean":"2023-12-08T21:26:31.195729+0000","last_became_active":"2023-12-08T20:54:56.318408+0000","last_became_peered":"2023-12-08T20:54:56.318408+0000","last_unstale":"2023-12-08T21:26:31.195729+0000","last_undegraded":"2023-12-08T21:26:31.195729+0000","last_fullsized":"2023-12-08T21:26:31.195729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:31.195456+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:31.195456+0000","last_clean_scrub_stamp":"2023-12-08T21:26:31.195456+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:45:47.203860+0000","scrub_duration":0.0030641639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'4","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.531853+0000","last_change":"2023-12-08T21:25:59.531853+0000","last_active":"2023-12-08T21:25:59.531853+0000","last_peered":"2023-12-08T21:25:59.531853+0000","last_clean":"2023-12-08T21:25:59.531853+0000","last_became_active":"2023-12-08T20:54:54.925610+0000","last_became_peered":"2023-12-08T20:54:54.925610+0000","last_unstale":"2023-12-08T21:25:59.531853+0000","last_undegraded":"2023-12-08T21:25:59.531853+0000","last_fullsized":"2023-12-08T21:25:59.531853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:25:59.531609+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:25:59.531609+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.531609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:03:16.867575+0000","scrub_duration":0.0031837789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'78","reported_seq":116,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:50.996636+0000","last_change":"2023-12-08T21:26:50.996692+0000","last_active":"2023-12-08T21:26:50.996636+0000","last_peered":"2023-12-08T21:26:50.996636+0000","last_clean":"2023-12-08T21:26:50.996636+0000","last_became_active":"2023-12-08T20:55:04.522245+0000","last_became_peered":"2023-12-08T20:55:04.522245+0000","last_unstale":"2023-12-08T21:26:50.996636+0000","last_undegraded":"2023-12-08T21:26:50.996636+0000","last_fullsized":"2023-12-08T21:26:50.996636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'78","last_scrub_stamp":"2023-12-08T21:26:50.996424+0000","last_deep_scrub":"30'78","last_deep_scrub_stamp":"2023-12-08T21:26:50.996424+0000","last_clean_scrub_stamp":"2023-12-08T21:26:50.996424+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:27:51.845140+0000","scrub_duration":0.0068877979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:16.119078+0000","last_change":"2023-12-08T21:26:16.119078+0000","last_active":"2023-12-08T21:26:16.119078+0000","last_peered":"2023-12-08T21:26:16.119078+0000","last_clean":"2023-12-08T21:26:16.119078+0000","last_became_active":"2023-12-08T20:54:56.377762+0000","last_became_peered":"2023-12-08T20:54:56.377762+0000","last_unstale":"2023-12-08T21:26:16.119078+0000","last_undegraded":"2023-12-08T21:26:16.119078+0000","last_fullsized":"2023-12-08T21:26:16.119078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:16.118716+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:16.118716+0000","last_clean_scrub_stamp":"2023-12-08T21:26:16.118716+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:28:44.731995+0000","scrub_duration":0.0036787600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'5","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:11.909020+0000","last_change":"2023-12-08T21:26:11.909020+0000","last_active":"2023-12-08T21:26:11.909020+0000","last_peered":"2023-12-08T21:26:11.909020+0000","last_clean":"2023-12-08T21:26:11.909020+0000","last_became_active":"2023-12-08T20:54:54.935472+0000","last_became_peered":"2023-12-08T20:54:54.935472+0000","last_unstale":"2023-12-08T21:26:11.909020+0000","last_undegraded":"2023-12-08T21:26:11.909020+0000","last_fullsized":"2023-12-08T21:26:11.909020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:11.908761+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:11.908761+0000","last_clean_scrub_stamp":"2023-12-08T21:26:11.908761+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:47:38.208187+0000","scrub_duration":0.0077929649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'94","reported_seq":132,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:57.713312+0000","last_change":"2023-12-08T21:26:57.713371+0000","last_active":"2023-12-08T21:26:57.713312+0000","last_peered":"2023-12-08T21:26:57.713312+0000","last_clean":"2023-12-08T21:26:57.713312+0000","last_became_active":"2023-12-08T20:55:04.533305+0000","last_became_peered":"2023-12-08T20:55:04.533305+0000","last_unstale":"2023-12-08T21:26:57.713312+0000","last_undegraded":"2023-12-08T21:26:57.713312+0000","last_fullsized":"2023-12-08T21:26:57.713312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'94","last_scrub_stamp":"2023-12-08T21:26:57.713101+0000","last_deep_scrub":"30'94","last_deep_scrub_stamp":"2023-12-08T21:26:57.713101+0000","last_clean_scrub_stamp":"2023-12-08T21:26:57.713101+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:53:42.251422+0000","scrub_duration":0.0073049609999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":6556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'24","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:52.008697+0000","last_change":"2023-12-08T21:25:52.008697+0000","last_active":"2023-12-08T21:25:52.008697+0000","last_peered":"2023-12-08T21:25:52.008697+0000","last_clean":"2023-12-08T21:25:52.008697+0000","last_became_active":"2023-12-08T20:54:56.379933+0000","last_became_peered":"2023-12-08T20:54:56.379933+0000","last_unstale":"2023-12-08T21:25:52.008697+0000","last_undegraded":"2023-12-08T21:25:52.008697+0000","last_fullsized":"2023-12-08T21:25:52.008697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:25:52.008566+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:25:52.008566+0000","last_clean_scrub_stamp":"2023-12-08T21:25:52.008566+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:27:19.773108+0000","scrub_duration":0.001762434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'5","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.012158+0000","last_change":"2023-12-08T21:26:06.012158+0000","last_active":"2023-12-08T21:26:06.012158+0000","last_peered":"2023-12-08T21:26:06.012158+0000","last_clean":"2023-12-08T21:26:06.012158+0000","last_became_active":"2023-12-08T20:54:54.982414+0000","last_became_peered":"2023-12-08T20:54:54.982414+0000","last_unstale":"2023-12-08T21:26:06.012158+0000","last_undegraded":"2023-12-08T21:26:06.012158+0000","last_fullsized":"2023-12-08T21:26:06.012158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:06.011895+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:06.011895+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.011895+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:09:55.169141+0000","scrub_duration":0.0062428880000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'68","reported_seq":106,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:48.483476+0000","last_change":"2023-12-08T21:26:48.483617+0000","last_active":"2023-12-08T21:26:48.483476+0000","last_peered":"2023-12-08T21:26:48.483476+0000","last_clean":"2023-12-08T21:26:48.483476+0000","last_became_active":"2023-12-08T20:55:04.514907+0000","last_became_peered":"2023-12-08T20:55:04.514907+0000","last_unstale":"2023-12-08T21:26:48.483476+0000","last_undegraded":"2023-12-08T21:26:48.483476+0000","last_fullsized":"2023-12-08T21:26:48.483476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'68","last_scrub_stamp":"2023-12-08T21:26:48.483236+0000","last_deep_scrub":"30'68","last_deep_scrub_stamp":"2023-12-08T21:26:48.483236+0000","last_clean_scrub_stamp":"2023-12-08T21:26:48.483236+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:14:24.424288+0000","scrub_duration":0.0086099469999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:53.997391+0000","last_change":"2023-12-08T21:25:53.997391+0000","last_active":"2023-12-08T21:25:53.997391+0000","last_peered":"2023-12-08T21:25:53.997391+0000","last_clean":"2023-12-08T21:25:53.997391+0000","last_became_active":"2023-12-08T20:54:56.377430+0000","last_became_peered":"2023-12-08T20:54:56.377430+0000","last_unstale":"2023-12-08T21:25:53.997391+0000","last_undegraded":"2023-12-08T21:25:53.997391+0000","last_fullsized":"2023-12-08T21:25:53.997391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2023-12-08T21:25:53.997259+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2023-12-08T21:25:53.997259+0000","last_clean_scrub_stamp":"2023-12-08T21:25:53.997259+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:43:24.527309+0000","scrub_duration":0.0013451629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'4","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:02.148544+0000","last_change":"2023-12-08T21:26:02.148544+0000","last_active":"2023-12-08T21:26:02.148544+0000","last_peered":"2023-12-08T21:26:02.148544+0000","last_clean":"2023-12-08T21:26:02.148544+0000","last_became_active":"2023-12-08T20:54:54.926386+0000","last_became_peered":"2023-12-08T20:54:54.926386+0000","last_unstale":"2023-12-08T21:26:02.148544+0000","last_undegraded":"2023-12-08T21:26:02.148544+0000","last_fullsized":"2023-12-08T21:26:02.148544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:26:02.148292+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:26:02.148292+0000","last_clean_scrub_stamp":"2023-12-08T21:26:02.148292+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:05:49.099297+0000","scrub_duration":0.0069923229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'113","reported_seq":151,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:12.893870+0000","last_change":"2023-12-08T21:26:12.893986+0000","last_active":"2023-12-08T21:26:12.893870+0000","last_peered":"2023-12-08T21:26:12.893870+0000","last_clean":"2023-12-08T21:26:12.893870+0000","last_became_active":"2023-12-08T20:55:04.523074+0000","last_became_peered":"2023-12-08T20:55:04.523074+0000","last_unstale":"2023-12-08T21:26:12.893870+0000","last_undegraded":"2023-12-08T21:26:12.893870+0000","last_fullsized":"2023-12-08T21:26:12.893870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'113","last_scrub_stamp":"2023-12-08T21:26:12.893631+0000","last_deep_scrub":"30'113","last_deep_scrub_stamp":"2023-12-08T21:26:12.893631+0000","last_clean_scrub_stamp":"2023-12-08T21:26:12.893631+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:22:11.324216+0000","scrub_duration":0.0069858769999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":11577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:10.138076+0000","last_change":"2023-12-08T21:26:10.138136+0000","last_active":"2023-12-08T21:26:10.138076+0000","last_peered":"2023-12-08T21:26:10.138076+0000","last_clean":"2023-12-08T21:26:10.138076+0000","last_became_active":"2023-12-08T20:54:56.371132+0000","last_became_peered":"2023-12-08T20:54:56.371132+0000","last_unstale":"2023-12-08T21:26:10.138076+0000","last_undegraded":"2023-12-08T21:26:10.138076+0000","last_fullsized":"2023-12-08T21:26:10.138076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:10.137863+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:10.137863+0000","last_clean_scrub_stamp":"2023-12-08T21:26:10.137863+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:13:21.181423+0000","scrub_duration":0.0030374600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'18","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:58.116724+0000","last_change":"2023-12-08T21:25:58.116788+0000","last_active":"2023-12-08T21:25:58.116724+0000","last_peered":"2023-12-08T21:25:58.116724+0000","last_clean":"2023-12-08T21:25:58.116724+0000","last_became_active":"2023-12-08T20:54:54.984661+0000","last_became_peered":"2023-12-08T20:54:54.984661+0000","last_unstale":"2023-12-08T21:25:58.116724+0000","last_undegraded":"2023-12-08T21:25:58.116724+0000","last_fullsized":"2023-12-08T21:25:58.116724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:25:58.116543+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:25:58.116543+0000","last_clean_scrub_stamp":"2023-12-08T21:25:58.116543+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:51:16.122167+0000","scrub_duration":0.0098436089999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'88","reported_seq":125,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:38.912940+0000","last_change":"2023-12-08T21:26:38.912999+0000","last_active":"2023-12-08T21:26:38.912940+0000","last_peered":"2023-12-08T21:26:38.912940+0000","last_clean":"2023-12-08T21:26:38.912940+0000","last_became_active":"2023-12-08T20:55:04.541074+0000","last_became_peered":"2023-12-08T20:55:04.541074+0000","last_unstale":"2023-12-08T21:26:38.912940+0000","last_undegraded":"2023-12-08T21:26:38.912940+0000","last_fullsized":"2023-12-08T21:26:38.912940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'88","last_scrub_stamp":"2023-12-08T21:26:38.912733+0000","last_deep_scrub":"30'88","last_deep_scrub_stamp":"2023-12-08T21:26:38.912733+0000","last_clean_scrub_stamp":"2023-12-08T21:26:38.912733+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:44:57.786431+0000","scrub_duration":0.0074736400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'20","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.783826+0000","last_change":"2023-12-08T21:26:01.783879+0000","last_active":"2023-12-08T21:26:01.783826+0000","last_peered":"2023-12-08T21:26:01.783826+0000","last_clean":"2023-12-08T21:26:01.783826+0000","last_became_active":"2023-12-08T20:54:56.413023+0000","last_became_peered":"2023-12-08T20:54:56.413023+0000","last_unstale":"2023-12-08T21:26:01.783826+0000","last_undegraded":"2023-12-08T21:26:01.783826+0000","last_fullsized":"2023-12-08T21:26:01.783826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:01.783626+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:01.783626+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.783626+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:53:22.368293+0000","scrub_duration":0.0030916820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'1","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:09.105683+0000","last_change":"2023-12-08T21:26:09.105734+0000","last_active":"2023-12-08T21:26:09.105683+0000","last_peered":"2023-12-08T21:26:09.105683+0000","last_clean":"2023-12-08T21:26:09.105683+0000","last_became_active":"2023-12-08T20:54:54.928543+0000","last_became_peered":"2023-12-08T20:54:54.928543+0000","last_unstale":"2023-12-08T21:26:09.105683+0000","last_undegraded":"2023-12-08T21:26:09.105683+0000","last_fullsized":"2023-12-08T21:26:09.105683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-08T21:26:09.105497+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-08T21:26:09.105497+0000","last_clean_scrub_stamp":"2023-12-08T21:26:09.105497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:15:16.777211+0000","scrub_duration":0.0026113529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'85","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:55.728456+0000","last_change":"2023-12-08T21:26:55.728538+0000","last_active":"2023-12-08T21:26:55.728456+0000","last_peered":"2023-12-08T21:26:55.728456+0000","last_clean":"2023-12-08T21:26:55.728456+0000","last_became_active":"2023-12-08T20:55:04.535002+0000","last_became_peered":"2023-12-08T20:55:04.535002+0000","last_unstale":"2023-12-08T21:26:55.728456+0000","last_undegraded":"2023-12-08T21:26:55.728456+0000","last_fullsized":"2023-12-08T21:26:55.728456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'85","last_scrub_stamp":"2023-12-08T21:26:55.728229+0000","last_deep_scrub":"30'85","last_deep_scrub_stamp":"2023-12-08T21:26:55.728229+0000","last_clean_scrub_stamp":"2023-12-08T21:26:55.728229+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:20:45.989148+0000","scrub_duration":0.0070202479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'40","reported_seq":89,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:55.448465+0000","last_change":"2023-12-08T21:26:55.448522+0000","last_active":"2023-12-08T21:26:55.448465+0000","last_peered":"2023-12-08T21:26:55.448465+0000","last_clean":"2023-12-08T21:26:55.448465+0000","last_became_active":"2023-12-08T20:56:00.381771+0000","last_became_peered":"2023-12-08T20:56:00.381771+0000","last_unstale":"2023-12-08T21:26:55.448465+0000","last_undegraded":"2023-12-08T21:26:55.448465+0000","last_fullsized":"2023-12-08T21:26:55.448465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-12-08T21:26:55.448265+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-12-08T21:26:55.448265+0000","last_clean_scrub_stamp":"2023-12-08T21:26:55.448265+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:19:50.196184+0000","scrub_duration":0.0041651179999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'5","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:26.254290+0000","last_change":"2023-12-08T21:26:26.254343+0000","last_active":"2023-12-08T21:26:26.254290+0000","last_peered":"2023-12-08T21:26:26.254290+0000","last_clean":"2023-12-08T21:26:26.254290+0000","last_became_active":"2023-12-08T20:54:54.928065+0000","last_became_peered":"2023-12-08T20:54:54.928065+0000","last_unstale":"2023-12-08T21:26:26.254290+0000","last_undegraded":"2023-12-08T21:26:26.254290+0000","last_fullsized":"2023-12-08T21:26:26.254290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-12-08T21:26:26.254093+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-12-08T21:26:26.254093+0000","last_clean_scrub_stamp":"2023-12-08T21:26:26.254093+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:53:12.765582+0000","scrub_duration":0.0032426040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'59","reported_seq":96,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:36.762487+0000","last_change":"2023-12-08T21:26:36.762546+0000","last_active":"2023-12-08T21:26:36.762487+0000","last_peered":"2023-12-08T21:26:36.762487+0000","last_clean":"2023-12-08T21:26:36.762487+0000","last_became_active":"2023-12-08T20:55:04.516783+0000","last_became_peered":"2023-12-08T20:55:04.516783+0000","last_unstale":"2023-12-08T21:26:36.762487+0000","last_undegraded":"2023-12-08T21:26:36.762487+0000","last_fullsized":"2023-12-08T21:26:36.762487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'59","last_scrub_stamp":"2023-12-08T21:26:36.762262+0000","last_deep_scrub":"30'59","last_deep_scrub_stamp":"2023-12-08T21:26:36.762262+0000","last_clean_scrub_stamp":"2023-12-08T21:26:36.762262+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:45:57.057694+0000","scrub_duration":0.005678425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:24.559076+0000","last_change":"2023-12-08T21:26:24.559130+0000","last_active":"2023-12-08T21:26:24.559076+0000","last_peered":"2023-12-08T21:26:24.559076+0000","last_clean":"2023-12-08T21:26:24.559076+0000","last_became_active":"2023-12-08T20:54:56.330346+0000","last_became_peered":"2023-12-08T20:54:56.330346+0000","last_unstale":"2023-12-08T21:26:24.559076+0000","last_undegraded":"2023-12-08T21:26:24.559076+0000","last_fullsized":"2023-12-08T21:26:24.559076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:24.558877+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:24.558877+0000","last_clean_scrub_stamp":"2023-12-08T21:26:24.558877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:01:23.818334+0000","scrub_duration":0.002404836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'6","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:58.290149+0000","last_change":"2023-12-08T21:25:58.290260+0000","last_active":"2023-12-08T21:25:58.290149+0000","last_peered":"2023-12-08T21:25:58.290149+0000","last_clean":"2023-12-08T21:25:58.290149+0000","last_became_active":"2023-12-08T20:54:54.926435+0000","last_became_peered":"2023-12-08T20:54:54.926435+0000","last_unstale":"2023-12-08T21:25:58.290149+0000","last_undegraded":"2023-12-08T21:25:58.290149+0000","last_fullsized":"2023-12-08T21:25:58.290149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2023-12-08T21:25:58.289922+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2023-12-08T21:25:58.289922+0000","last_clean_scrub_stamp":"2023-12-08T21:25:58.289922+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:28:27.891672+0000","scrub_duration":0.0072454040000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'79","reported_seq":116,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:46.539241+0000","last_change":"2023-12-08T21:26:46.539384+0000","last_active":"2023-12-08T21:26:46.539241+0000","last_peered":"2023-12-08T21:26:46.539241+0000","last_clean":"2023-12-08T21:26:46.539241+0000","last_became_active":"2023-12-08T20:55:04.534289+0000","last_became_peered":"2023-12-08T20:55:04.534289+0000","last_unstale":"2023-12-08T21:26:46.539241+0000","last_undegraded":"2023-12-08T21:26:46.539241+0000","last_fullsized":"2023-12-08T21:26:46.539241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'79","last_scrub_stamp":"2023-12-08T21:26:46.539004+0000","last_deep_scrub":"30'79","last_deep_scrub_stamp":"2023-12-08T21:26:46.539004+0000","last_clean_scrub_stamp":"2023-12-08T21:26:46.539004+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:33:37.018995+0000","scrub_duration":0.0071002449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:55.093643+0000","last_change":"2023-12-08T21:25:55.093643+0000","last_active":"2023-12-08T21:25:55.093643+0000","last_peered":"2023-12-08T21:25:55.093643+0000","last_clean":"2023-12-08T21:25:55.093643+0000","last_became_active":"2023-12-08T20:54:56.375922+0000","last_became_peered":"2023-12-08T20:54:56.375922+0000","last_unstale":"2023-12-08T21:25:55.093643+0000","last_undegraded":"2023-12-08T21:25:55.093643+0000","last_fullsized":"2023-12-08T21:25:55.093643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:25:55.093529+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:25:55.093529+0000","last_clean_scrub_stamp":"2023-12-08T21:25:55.093529+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:56:51.759799+0000","scrub_duration":0.0031557159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'893","reported_seq":936,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:52.042951+0000","last_change":"2023-12-08T21:25:52.042995+0000","last_active":"2023-12-08T21:25:52.042951+0000","last_peered":"2023-12-08T21:25:52.042951+0000","last_clean":"2023-12-08T21:25:52.042951+0000","last_became_active":"2023-12-08T20:54:54.977999+0000","last_became_peered":"2023-12-08T20:54:54.977999+0000","last_unstale":"2023-12-08T21:25:52.042951+0000","last_undegraded":"2023-12-08T21:25:52.042951+0000","last_fullsized":"2023-12-08T21:25:52.042951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'893","last_scrub_stamp":"2023-12-08T21:25:52.042834+0000","last_deep_scrub":"30'893","last_deep_scrub_stamp":"2023-12-08T21:25:52.042834+0000","last_clean_scrub_stamp":"2023-12-08T21:25:52.042834+0000","objects_scrubbed":4,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:13:57.138876+0000","scrub_duration":0.033957383000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":887,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'80","reported_seq":117,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:31.050828+0000","last_change":"2023-12-08T21:26:31.050884+0000","last_active":"2023-12-08T21:26:31.050828+0000","last_peered":"2023-12-08T21:26:31.050828+0000","last_clean":"2023-12-08T21:26:31.050828+0000","last_became_active":"2023-12-08T20:55:04.522190+0000","last_became_peered":"2023-12-08T20:55:04.522190+0000","last_unstale":"2023-12-08T21:26:31.050828+0000","last_undegraded":"2023-12-08T21:26:31.050828+0000","last_fullsized":"2023-12-08T21:26:31.050828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'80","last_scrub_stamp":"2023-12-08T21:26:31.050628+0000","last_deep_scrub":"30'80","last_deep_scrub_stamp":"2023-12-08T21:26:31.050628+0000","last_clean_scrub_stamp":"2023-12-08T21:26:31.050628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:24:13.040770+0000","scrub_duration":0.0071926489999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:11.108977+0000","last_change":"2023-12-08T21:26:11.109034+0000","last_active":"2023-12-08T21:26:11.108977+0000","last_peered":"2023-12-08T21:26:11.108977+0000","last_clean":"2023-12-08T21:26:11.108977+0000","last_became_active":"2023-12-08T20:54:56.383561+0000","last_became_peered":"2023-12-08T20:54:56.383561+0000","last_unstale":"2023-12-08T21:26:11.108977+0000","last_undegraded":"2023-12-08T21:26:11.108977+0000","last_fullsized":"2023-12-08T21:26:11.108977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:11.108774+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:11.108774+0000","last_clean_scrub_stamp":"2023-12-08T21:26:11.108774+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:26:31.478244+0000","scrub_duration":0.0032197039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'407","reported_seq":450,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.289869+0000","last_change":"2023-12-08T21:26:04.289869+0000","last_active":"2023-12-08T21:26:04.289869+0000","last_peered":"2023-12-08T21:26:04.289869+0000","last_clean":"2023-12-08T21:26:04.289869+0000","last_became_active":"2023-12-08T20:54:54.980023+0000","last_became_peered":"2023-12-08T20:54:54.980023+0000","last_unstale":"2023-12-08T21:26:04.289869+0000","last_undegraded":"2023-12-08T21:26:04.289869+0000","last_fullsized":"2023-12-08T21:26:04.289869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'407","last_scrub_stamp":"2023-12-08T21:26:04.289595+0000","last_deep_scrub":"30'407","last_deep_scrub_stamp":"2023-12-08T21:26:04.289595+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.289595+0000","objects_scrubbed":2,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:14:17.977538+0000","scrub_duration":0.006696993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'116","reported_seq":153,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:38.070529+0000","last_change":"2023-12-08T21:26:38.070565+0000","last_active":"2023-12-08T21:26:38.070529+0000","last_peered":"2023-12-08T21:26:38.070529+0000","last_clean":"2023-12-08T21:26:38.070529+0000","last_became_active":"2023-12-08T20:55:04.522325+0000","last_became_peered":"2023-12-08T20:55:04.522325+0000","last_unstale":"2023-12-08T21:26:38.070529+0000","last_undegraded":"2023-12-08T21:26:38.070529+0000","last_fullsized":"2023-12-08T21:26:38.070529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'116","last_scrub_stamp":"2023-12-08T21:26:38.070400+0000","last_deep_scrub":"30'116","last_deep_scrub_stamp":"2023-12-08T21:26:38.070400+0000","last_clean_scrub_stamp":"2023-12-08T21:26:38.070400+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:07:09.957382+0000","scrub_duration":0.005104379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":12653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'29","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.923377+0000","last_change":"2023-12-08T21:25:59.923377+0000","last_active":"2023-12-08T21:25:59.923377+0000","last_peered":"2023-12-08T21:25:59.923377+0000","last_clean":"2023-12-08T21:25:59.923377+0000","last_became_active":"2023-12-08T20:54:56.409539+0000","last_became_peered":"2023-12-08T20:54:56.409539+0000","last_unstale":"2023-12-08T21:25:59.923377+0000","last_undegraded":"2023-12-08T21:25:59.923377+0000","last_fullsized":"2023-12-08T21:25:59.923377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-12-08T21:25:59.923139+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-12-08T21:25:59.923139+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.923139+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:20:00.596635+0000","scrub_duration":0.0048008690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'3","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:01.174774+0000","last_change":"2023-12-08T21:26:01.174774+0000","last_active":"2023-12-08T21:26:01.174774+0000","last_peered":"2023-12-08T21:26:01.174774+0000","last_clean":"2023-12-08T21:26:01.174774+0000","last_became_active":"2023-12-08T20:54:54.935889+0000","last_became_peered":"2023-12-08T20:54:54.935889+0000","last_unstale":"2023-12-08T21:26:01.174774+0000","last_undegraded":"2023-12-08T21:26:01.174774+0000","last_fullsized":"2023-12-08T21:26:01.174774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:26:01.174531+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:26:01.174531+0000","last_clean_scrub_stamp":"2023-12-08T21:26:01.174531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:17:02.143286+0000","scrub_duration":0.0027935500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'68","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:38.212698+0000","last_change":"2023-12-08T21:26:38.212814+0000","last_active":"2023-12-08T21:26:38.212698+0000","last_peered":"2023-12-08T21:26:38.212698+0000","last_clean":"2023-12-08T21:26:38.212698+0000","last_became_active":"2023-12-08T20:56:00.560282+0000","last_became_peered":"2023-12-08T20:56:00.560282+0000","last_unstale":"2023-12-08T21:26:38.212698+0000","last_undegraded":"2023-12-08T21:26:38.212698+0000","last_fullsized":"2023-12-08T21:26:38.212698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'68","last_scrub_stamp":"2023-12-08T21:26:38.212460+0000","last_deep_scrub":"30'68","last_deep_scrub_stamp":"2023-12-08T21:26:38.212460+0000","last_clean_scrub_stamp":"2023-12-08T21:26:38.212460+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:22:34.139291+0000","scrub_duration":0.0071014620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":7515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:18.920419+0000","last_change":"2023-12-08T21:26:18.920419+0000","last_active":"2023-12-08T21:26:18.920419+0000","last_peered":"2023-12-08T21:26:18.920419+0000","last_clean":"2023-12-08T21:26:18.920419+0000","last_became_active":"2023-12-08T20:54:56.369709+0000","last_became_peered":"2023-12-08T20:54:56.369709+0000","last_unstale":"2023-12-08T21:26:18.920419+0000","last_undegraded":"2023-12-08T21:26:18.920419+0000","last_fullsized":"2023-12-08T21:26:18.920419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:18.920028+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:18.920028+0000","last_clean_scrub_stamp":"2023-12-08T21:26:18.920028+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:27:46.684571+0000","scrub_duration":0.0029217309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'3","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:54.755396+0000","last_change":"2023-12-08T21:25:54.755396+0000","last_active":"2023-12-08T21:25:54.755396+0000","last_peered":"2023-12-08T21:25:54.755396+0000","last_clean":"2023-12-08T21:25:54.755396+0000","last_became_active":"2023-12-08T20:54:54.979751+0000","last_became_peered":"2023-12-08T20:54:54.979751+0000","last_unstale":"2023-12-08T21:25:54.755396+0000","last_undegraded":"2023-12-08T21:25:54.755396+0000","last_fullsized":"2023-12-08T21:25:54.755396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:25:54.755239+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:25:54.755239+0000","last_clean_scrub_stamp":"2023-12-08T21:25:54.755239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:03:48.852944+0000","scrub_duration":0.002413353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'79","reported_seq":116,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:34.019701+0000","last_change":"2023-12-08T21:26:34.019764+0000","last_active":"2023-12-08T21:26:34.019701+0000","last_peered":"2023-12-08T21:26:34.019701+0000","last_clean":"2023-12-08T21:26:34.019701+0000","last_became_active":"2023-12-08T20:55:04.511405+0000","last_became_peered":"2023-12-08T20:55:04.511405+0000","last_unstale":"2023-12-08T21:26:34.019701+0000","last_undegraded":"2023-12-08T21:26:34.019701+0000","last_fullsized":"2023-12-08T21:26:34.019701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'79","last_scrub_stamp":"2023-12-08T21:26:34.019500+0000","last_deep_scrub":"30'79","last_deep_scrub_stamp":"2023-12-08T21:26:34.019500+0000","last_clean_scrub_stamp":"2023-12-08T21:26:34.019500+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:13:31.028622+0000","scrub_duration":0.0067922219999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":10297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":105,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:24.006328+0000","last_change":"2023-12-08T21:26:24.006328+0000","last_active":"2023-12-08T21:26:24.006328+0000","last_peered":"2023-12-08T21:26:24.006328+0000","last_clean":"2023-12-08T21:26:24.006328+0000","last_became_active":"2023-12-08T20:55:04.536497+0000","last_became_peered":"2023-12-08T20:55:04.536497+0000","last_unstale":"2023-12-08T21:26:24.006328+0000","last_undegraded":"2023-12-08T21:26:24.006328+0000","last_fullsized":"2023-12-08T21:26:24.006328+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'65","last_scrub_stamp":"2023-12-08T21:26:24.006179+0000","last_deep_scrub":"30'65","last_deep_scrub_stamp":"2023-12-08T21:26:24.006179+0000","last_clean_scrub_stamp":"2023-12-08T21:26:24.006179+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:37:20.579091+0000","scrub_duration":0.0039742140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:18.981955+0000","last_change":"2023-12-08T21:26:18.981955+0000","last_active":"2023-12-08T21:26:18.981955+0000","last_peered":"2023-12-08T21:26:18.981955+0000","last_clean":"2023-12-08T21:26:18.981955+0000","last_became_active":"2023-12-08T20:54:56.317895+0000","last_became_peered":"2023-12-08T20:54:56.317895+0000","last_unstale":"2023-12-08T21:26:18.981955+0000","last_undegraded":"2023-12-08T21:26:18.981955+0000","last_fullsized":"2023-12-08T21:26:18.981955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:18.981665+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:18.981665+0000","last_clean_scrub_stamp":"2023-12-08T21:26:18.981665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:15:26.653378+0000","scrub_duration":0.0031400199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'4","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.214946+0000","last_change":"2023-12-08T21:26:17.214946+0000","last_active":"2023-12-08T21:26:17.214946+0000","last_peered":"2023-12-08T21:26:17.214946+0000","last_clean":"2023-12-08T21:26:17.214946+0000","last_became_active":"2023-12-08T20:54:54.935578+0000","last_became_peered":"2023-12-08T20:54:54.935578+0000","last_unstale":"2023-12-08T21:26:17.214946+0000","last_undegraded":"2023-12-08T21:26:17.214946+0000","last_fullsized":"2023-12-08T21:26:17.214946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-08T21:26:17.214737+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-08T21:26:17.214737+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.214737+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:14:28.047119+0000","scrub_duration":0.0019532619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'80","reported_seq":119,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:54.485579+0000","last_change":"2023-12-08T21:26:54.485642+0000","last_active":"2023-12-08T21:26:54.485579+0000","last_peered":"2023-12-08T21:26:54.485579+0000","last_clean":"2023-12-08T21:26:54.485579+0000","last_became_active":"2023-12-08T20:55:04.535525+0000","last_became_peered":"2023-12-08T20:55:04.535525+0000","last_unstale":"2023-12-08T21:26:54.485579+0000","last_undegraded":"2023-12-08T21:26:54.485579+0000","last_fullsized":"2023-12-08T21:26:54.485579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'80","last_scrub_stamp":"2023-12-08T21:26:54.485375+0000","last_deep_scrub":"30'80","last_deep_scrub_stamp":"2023-12-08T21:26:54.485375+0000","last_clean_scrub_stamp":"2023-12-08T21:26:54.485375+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:09:48.966147+0000","scrub_duration":0.0059798960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":11364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:30.927893+0000","last_change":"2023-12-08T21:26:30.927947+0000","last_active":"2023-12-08T21:26:30.927893+0000","last_peered":"2023-12-08T21:26:30.927893+0000","last_clean":"2023-12-08T21:26:30.927893+0000","last_became_active":"2023-12-08T20:54:56.412133+0000","last_became_peered":"2023-12-08T20:54:56.412133+0000","last_unstale":"2023-12-08T21:26:30.927893+0000","last_undegraded":"2023-12-08T21:26:30.927893+0000","last_fullsized":"2023-12-08T21:26:30.927893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:30.927680+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:30.927680+0000","last_clean_scrub_stamp":"2023-12-08T21:26:30.927680+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:10:28.638287+0000","scrub_duration":0.003176187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'3","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:58.532461+0000","last_change":"2023-12-08T21:25:58.532461+0000","last_active":"2023-12-08T21:25:58.532461+0000","last_peered":"2023-12-08T21:25:58.532461+0000","last_clean":"2023-12-08T21:25:58.532461+0000","last_became_active":"2023-12-08T20:54:54.926804+0000","last_became_peered":"2023-12-08T20:54:54.926804+0000","last_unstale":"2023-12-08T21:25:58.532461+0000","last_undegraded":"2023-12-08T21:25:58.532461+0000","last_fullsized":"2023-12-08T21:25:58.532461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-08T21:25:58.532282+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-08T21:25:58.532282+0000","last_clean_scrub_stamp":"2023-12-08T21:25:58.532282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:57:27.213154+0000","scrub_duration":0.0026443899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'616","reported_seq":658,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:16.216138+0000","last_change":"2023-12-08T21:26:16.216200+0000","last_active":"2023-12-08T21:26:16.216138+0000","last_peered":"2023-12-08T21:26:16.216138+0000","last_clean":"2023-12-08T21:26:16.216138+0000","last_became_active":"2023-12-08T20:54:54.930324+0000","last_became_peered":"2023-12-08T20:54:54.930324+0000","last_unstale":"2023-12-08T21:26:16.216138+0000","last_undegraded":"2023-12-08T21:26:16.216138+0000","last_fullsized":"2023-12-08T21:26:16.216138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'616","last_scrub_stamp":"2023-12-08T21:26:16.215928+0000","last_deep_scrub":"30'616","last_deep_scrub_stamp":"2023-12-08T21:26:16.215928+0000","last_clean_scrub_stamp":"2023-12-08T21:26:16.215928+0000","objects_scrubbed":1,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:45:43.919045+0000","scrub_duration":0.033128956000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.998145+0000","last_change":"2023-12-08T21:26:08.998185+0000","last_active":"2023-12-08T21:26:08.998145+0000","last_peered":"2023-12-08T21:26:08.998145+0000","last_clean":"2023-12-08T21:26:08.998145+0000","last_became_active":"2023-12-08T20:54:56.383467+0000","last_became_peered":"2023-12-08T20:54:56.383467+0000","last_unstale":"2023-12-08T21:26:08.998145+0000","last_undegraded":"2023-12-08T21:26:08.998145+0000","last_fullsized":"2023-12-08T21:26:08.998145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2023-12-08T21:26:08.998020+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2023-12-08T21:26:08.998020+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.998020+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T01:43:06.448077+0000","scrub_duration":0.0029810240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'50","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:38.921415+0000","last_change":"2023-12-08T21:26:38.921533+0000","last_active":"2023-12-08T21:26:38.921415+0000","last_peered":"2023-12-08T21:26:38.921415+0000","last_clean":"2023-12-08T21:26:38.921415+0000","last_became_active":"2023-12-08T20:55:04.536537+0000","last_became_peered":"2023-12-08T20:55:04.536537+0000","last_unstale":"2023-12-08T21:26:38.921415+0000","last_undegraded":"2023-12-08T21:26:38.921415+0000","last_fullsized":"2023-12-08T21:26:38.921415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'50","last_scrub_stamp":"2023-12-08T21:26:38.921200+0000","last_deep_scrub":"30'50","last_deep_scrub_stamp":"2023-12-08T21:26:38.921200+0000","last_clean_scrub_stamp":"2023-12-08T21:26:38.921200+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:32.596592+0000","scrub_duration":0.005835153,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":6314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'554","reported_seq":596,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:10.943632+0000","last_change":"2023-12-08T21:26:10.943758+0000","last_active":"2023-12-08T21:26:10.943632+0000","last_peered":"2023-12-08T21:26:10.943632+0000","last_clean":"2023-12-08T21:26:10.943632+0000","last_became_active":"2023-12-08T20:54:54.925229+0000","last_became_peered":"2023-12-08T20:54:54.925229+0000","last_unstale":"2023-12-08T21:26:10.943632+0000","last_undegraded":"2023-12-08T21:26:10.943632+0000","last_fullsized":"2023-12-08T21:26:10.943632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'554","last_scrub_stamp":"2023-12-08T21:26:10.943330+0000","last_deep_scrub":"30'554","last_deep_scrub_stamp":"2023-12-08T21:26:10.943330+0000","last_clean_scrub_stamp":"2023-12-08T21:26:10.943330+0000","objects_scrubbed":1,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:10:30.749700+0000","scrub_duration":0.033797185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'20","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:00.754130+0000","last_change":"2023-12-08T21:26:00.754182+0000","last_active":"2023-12-08T21:26:00.754130+0000","last_peered":"2023-12-08T21:26:00.754130+0000","last_clean":"2023-12-08T21:26:00.754130+0000","last_became_active":"2023-12-08T20:54:56.403996+0000","last_became_peered":"2023-12-08T20:54:56.403996+0000","last_unstale":"2023-12-08T21:26:00.754130+0000","last_undegraded":"2023-12-08T21:26:00.754130+0000","last_fullsized":"2023-12-08T21:26:00.754130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:00.753925+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:00.753925+0000","last_clean_scrub_stamp":"2023-12-08T21:26:00.753925+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:14:14.441869+0000","scrub_duration":0.003347722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'97","reported_seq":133,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.316666+0000","last_change":"2023-12-08T21:26:14.316722+0000","last_active":"2023-12-08T21:26:14.316666+0000","last_peered":"2023-12-08T21:26:14.316666+0000","last_clean":"2023-12-08T21:26:14.316666+0000","last_became_active":"2023-12-08T20:55:04.523137+0000","last_became_peered":"2023-12-08T20:55:04.523137+0000","last_unstale":"2023-12-08T21:26:14.316666+0000","last_undegraded":"2023-12-08T21:26:14.316666+0000","last_fullsized":"2023-12-08T21:26:14.316666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'97","last_scrub_stamp":"2023-12-08T21:26:14.316453+0000","last_deep_scrub":"30'97","last_deep_scrub_stamp":"2023-12-08T21:26:14.316453+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.316453+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:34:50.101165+0000","scrub_duration":0.0078096950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"30'37","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:08.876227+0000","last_change":"2023-12-08T21:26:08.876227+0000","last_active":"2023-12-08T21:26:08.876227+0000","last_peered":"2023-12-08T21:26:08.876227+0000","last_clean":"2023-12-08T21:26:08.876227+0000","last_became_active":"2023-12-08T20:54:56.373080+0000","last_became_peered":"2023-12-08T20:54:56.373080+0000","last_unstale":"2023-12-08T21:26:08.876227+0000","last_undegraded":"2023-12-08T21:26:08.876227+0000","last_fullsized":"2023-12-08T21:26:08.876227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'37","last_scrub_stamp":"2023-12-08T21:26:08.875831+0000","last_deep_scrub":"30'37","last_deep_scrub_stamp":"2023-12-08T21:26:08.875831+0000","last_clean_scrub_stamp":"2023-12-08T21:26:08.875831+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:35:17.879073+0000","scrub_duration":0.003168078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'27","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:07.352563+0000","last_change":"2023-12-08T21:26:07.352563+0000","last_active":"2023-12-08T21:26:07.352563+0000","last_peered":"2023-12-08T21:26:07.352563+0000","last_clean":"2023-12-08T21:26:07.352563+0000","last_became_active":"2023-12-08T20:54:56.378154+0000","last_became_peered":"2023-12-08T20:54:56.378154+0000","last_unstale":"2023-12-08T21:26:07.352563+0000","last_undegraded":"2023-12-08T21:26:07.352563+0000","last_fullsized":"2023-12-08T21:26:07.352563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-12-08T21:26:07.352305+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-12-08T21:26:07.352305+0000","last_clean_scrub_stamp":"2023-12-08T21:26:07.352305+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:43:19.113869+0000","scrub_duration":0.0029496069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'26","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:02.075761+0000","last_change":"2023-12-08T21:26:02.075761+0000","last_active":"2023-12-08T21:26:02.075761+0000","last_peered":"2023-12-08T21:26:02.075761+0000","last_clean":"2023-12-08T21:26:02.075761+0000","last_became_active":"2023-12-08T20:54:56.409863+0000","last_became_peered":"2023-12-08T20:54:56.409863+0000","last_unstale":"2023-12-08T21:26:02.075761+0000","last_undegraded":"2023-12-08T21:26:02.075761+0000","last_fullsized":"2023-12-08T21:26:02.075761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:02.075490+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:02.075490+0000","last_clean_scrub_stamp":"2023-12-08T21:26:02.075490+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:56:07.407825+0000","scrub_duration":0.0028810989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:19.853547+0000","last_change":"2023-12-08T21:26:19.853599+0000","last_active":"2023-12-08T21:26:19.853547+0000","last_peered":"2023-12-08T21:26:19.853547+0000","last_clean":"2023-12-08T21:26:19.853547+0000","last_became_active":"2023-12-08T20:54:56.408205+0000","last_became_peered":"2023-12-08T20:54:56.408205+0000","last_unstale":"2023-12-08T21:26:19.853547+0000","last_undegraded":"2023-12-08T21:26:19.853547+0000","last_fullsized":"2023-12-08T21:26:19.853547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-12-08T21:26:19.853354+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-12-08T21:26:19.853354+0000","last_clean_scrub_stamp":"2023-12-08T21:26:19.853354+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T23:31:40.279876+0000","scrub_duration":0.0040195689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'16","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.448817+0000","last_change":"2023-12-08T21:26:17.448848+0000","last_active":"2023-12-08T21:26:17.448817+0000","last_peered":"2023-12-08T21:26:17.448817+0000","last_clean":"2023-12-08T21:26:17.448817+0000","last_became_active":"2023-12-08T20:54:56.386344+0000","last_became_peered":"2023-12-08T20:54:56.386344+0000","last_unstale":"2023-12-08T21:26:17.448817+0000","last_undegraded":"2023-12-08T21:26:17.448817+0000","last_fullsized":"2023-12-08T21:26:17.448817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-12-08T21:26:17.448692+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-12-08T21:26:17.448692+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.448692+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:27:35.548731+0000","scrub_duration":0.0025673380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.337483+0000","last_change":"2023-12-08T21:26:14.337534+0000","last_active":"2023-12-08T21:26:14.337483+0000","last_peered":"2023-12-08T21:26:14.337483+0000","last_clean":"2023-12-08T21:26:14.337483+0000","last_became_active":"2023-12-08T20:54:56.366967+0000","last_became_peered":"2023-12-08T20:54:56.366967+0000","last_unstale":"2023-12-08T21:26:14.337483+0000","last_undegraded":"2023-12-08T21:26:14.337483+0000","last_fullsized":"2023-12-08T21:26:14.337483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:14.337293+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:14.337293+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.337293+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:11:34.657650+0000","scrub_duration":0.0035456820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'32","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:23.915395+0000","last_change":"2023-12-08T21:26:23.915503+0000","last_active":"2023-12-08T21:26:23.915395+0000","last_peered":"2023-12-08T21:26:23.915395+0000","last_clean":"2023-12-08T21:26:23.915395+0000","last_became_active":"2023-12-08T20:54:56.371954+0000","last_became_peered":"2023-12-08T20:54:56.371954+0000","last_unstale":"2023-12-08T21:26:23.915395+0000","last_undegraded":"2023-12-08T21:26:23.915395+0000","last_fullsized":"2023-12-08T21:26:23.915395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:23.915162+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:23.915162+0000","last_clean_scrub_stamp":"2023-12-08T21:26:23.915162+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:45:34.269396+0000","scrub_duration":0.0022833179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:03.870345+0000","last_change":"2023-12-08T21:26:03.870397+0000","last_active":"2023-12-08T21:26:03.870345+0000","last_peered":"2023-12-08T21:26:03.870345+0000","last_clean":"2023-12-08T21:26:03.870345+0000","last_became_active":"2023-12-08T20:54:56.409462+0000","last_became_peered":"2023-12-08T20:54:56.409462+0000","last_unstale":"2023-12-08T21:26:03.870345+0000","last_undegraded":"2023-12-08T21:26:03.870345+0000","last_fullsized":"2023-12-08T21:26:03.870345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:03.870148+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:03.870148+0000","last_clean_scrub_stamp":"2023-12-08T21:26:03.870148+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:04:32.166396+0000","scrub_duration":0.0033986340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'18","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:25:59.202058+0000","last_change":"2023-12-08T21:25:59.202112+0000","last_active":"2023-12-08T21:25:59.202058+0000","last_peered":"2023-12-08T21:25:59.202058+0000","last_clean":"2023-12-08T21:25:59.202058+0000","last_became_active":"2023-12-08T20:54:56.415176+0000","last_became_peered":"2023-12-08T20:54:56.415176+0000","last_unstale":"2023-12-08T21:25:59.202058+0000","last_undegraded":"2023-12-08T21:25:59.202058+0000","last_fullsized":"2023-12-08T21:25:59.202058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:25:59.201838+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:25:59.201838+0000","last_clean_scrub_stamp":"2023-12-08T21:25:59.201838+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T04:55:02.593105+0000","scrub_duration":0.0031189780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'31","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.841528+0000","last_change":"2023-12-08T21:26:13.841528+0000","last_active":"2023-12-08T21:26:13.841528+0000","last_peered":"2023-12-08T21:26:13.841528+0000","last_clean":"2023-12-08T21:26:13.841528+0000","last_became_active":"2023-12-08T20:54:56.400980+0000","last_became_peered":"2023-12-08T20:54:56.400980+0000","last_unstale":"2023-12-08T21:26:13.841528+0000","last_undegraded":"2023-12-08T21:26:13.841528+0000","last_fullsized":"2023-12-08T21:26:13.841528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-12-08T21:26:13.841252+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-12-08T21:26:13.841252+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.841252+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:55:29.119051+0000","scrub_duration":0.0036066679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:03.827576+0000","last_change":"2023-12-08T21:26:03.827576+0000","last_active":"2023-12-08T21:26:03.827576+0000","last_peered":"2023-12-08T21:26:03.827576+0000","last_clean":"2023-12-08T21:26:03.827576+0000","last_became_active":"2023-12-08T20:54:56.386413+0000","last_became_peered":"2023-12-08T20:54:56.386413+0000","last_unstale":"2023-12-08T21:26:03.827576+0000","last_undegraded":"2023-12-08T21:26:03.827576+0000","last_fullsized":"2023-12-08T21:26:03.827576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:03.827291+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:03.827291+0000","last_clean_scrub_stamp":"2023-12-08T21:26:03.827291+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:43:15.588855+0000","scrub_duration":0.003078543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.895627+0000","last_change":"2023-12-08T21:26:14.895627+0000","last_active":"2023-12-08T21:26:14.895627+0000","last_peered":"2023-12-08T21:26:14.895627+0000","last_clean":"2023-12-08T21:26:14.895627+0000","last_became_active":"2023-12-08T20:54:56.371456+0000","last_became_peered":"2023-12-08T20:54:56.371456+0000","last_unstale":"2023-12-08T21:26:14.895627+0000","last_undegraded":"2023-12-08T21:26:14.895627+0000","last_fullsized":"2023-12-08T21:26:14.895627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-12-08T21:26:14.895388+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-12-08T21:26:14.895388+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.895388+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:06:01.846393+0000","scrub_duration":0.0052799700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:17.144715+0000","last_change":"2023-12-08T21:26:17.144715+0000","last_active":"2023-12-08T21:26:17.144715+0000","last_peered":"2023-12-08T21:26:17.144715+0000","last_clean":"2023-12-08T21:26:17.144715+0000","last_became_active":"2023-12-08T20:54:56.380860+0000","last_became_peered":"2023-12-08T20:54:56.380860+0000","last_unstale":"2023-12-08T21:26:17.144715+0000","last_undegraded":"2023-12-08T21:26:17.144715+0000","last_fullsized":"2023-12-08T21:26:17.144715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:17.144561+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:17.144561+0000","last_clean_scrub_stamp":"2023-12-08T21:26:17.144561+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:44:10.819952+0000","scrub_duration":0.001893371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:32.244590+0000","last_change":"2023-12-08T21:26:32.244590+0000","last_active":"2023-12-08T21:26:32.244590+0000","last_peered":"2023-12-08T21:26:32.244590+0000","last_clean":"2023-12-08T21:26:32.244590+0000","last_became_active":"2023-12-08T20:54:56.260387+0000","last_became_peered":"2023-12-08T20:54:56.260387+0000","last_unstale":"2023-12-08T21:26:32.244590+0000","last_undegraded":"2023-12-08T21:26:32.244590+0000","last_fullsized":"2023-12-08T21:26:32.244590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:32.244249+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:32.244249+0000","last_clean_scrub_stamp":"2023-12-08T21:26:32.244249+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:14:23.949815+0000","scrub_duration":0.003446494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'32","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:10.301571+0000","last_change":"2023-12-08T21:26:10.301625+0000","last_active":"2023-12-08T21:26:10.301571+0000","last_peered":"2023-12-08T21:26:10.301571+0000","last_clean":"2023-12-08T21:26:10.301571+0000","last_became_active":"2023-12-08T20:54:56.387774+0000","last_became_peered":"2023-12-08T20:54:56.387774+0000","last_unstale":"2023-12-08T21:26:10.301571+0000","last_undegraded":"2023-12-08T21:26:10.301571+0000","last_fullsized":"2023-12-08T21:26:10.301571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:10.301372+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:10.301372+0000","last_clean_scrub_stamp":"2023-12-08T21:26:10.301372+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T09:19:37.645203+0000","scrub_duration":0.0036295450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:15.151085+0000","last_change":"2023-12-08T21:26:15.151138+0000","last_active":"2023-12-08T21:26:15.151085+0000","last_peered":"2023-12-08T21:26:15.151085+0000","last_clean":"2023-12-08T21:26:15.151085+0000","last_became_active":"2023-12-08T20:54:56.377029+0000","last_became_peered":"2023-12-08T20:54:56.377029+0000","last_unstale":"2023-12-08T21:26:15.151085+0000","last_undegraded":"2023-12-08T21:26:15.151085+0000","last_fullsized":"2023-12-08T21:26:15.151085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:15.150889+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:15.150889+0000","last_clean_scrub_stamp":"2023-12-08T21:26:15.150889+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:59:04.490083+0000","scrub_duration":0.006416382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.145181+0000","last_change":"2023-12-08T21:26:13.145289+0000","last_active":"2023-12-08T21:26:13.145181+0000","last_peered":"2023-12-08T21:26:13.145181+0000","last_clean":"2023-12-08T21:26:13.145181+0000","last_became_active":"2023-12-08T20:54:56.370707+0000","last_became_peered":"2023-12-08T20:54:56.370707+0000","last_unstale":"2023-12-08T21:26:13.145181+0000","last_undegraded":"2023-12-08T21:26:13.145181+0000","last_fullsized":"2023-12-08T21:26:13.145181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-12-08T21:26:13.144948+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-12-08T21:26:13.144948+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.144948+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:29:20.754089+0000","scrub_duration":0.0029542679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'29","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:15.785466+0000","last_change":"2023-12-08T21:26:15.785519+0000","last_active":"2023-12-08T21:26:15.785466+0000","last_peered":"2023-12-08T21:26:15.785466+0000","last_clean":"2023-12-08T21:26:15.785466+0000","last_became_active":"2023-12-08T20:54:56.401544+0000","last_became_peered":"2023-12-08T20:54:56.401544+0000","last_unstale":"2023-12-08T21:26:15.785466+0000","last_undegraded":"2023-12-08T21:26:15.785466+0000","last_fullsized":"2023-12-08T21:26:15.785466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-12-08T21:26:15.785268+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-12-08T21:26:15.785268+0000","last_clean_scrub_stamp":"2023-12-08T21:26:15.785268+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T02:56:21.117603+0000","scrub_duration":0.0032307500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.497763+0000","last_change":"2023-12-08T21:26:04.497882+0000","last_active":"2023-12-08T21:26:04.497763+0000","last_peered":"2023-12-08T21:26:04.497763+0000","last_clean":"2023-12-08T21:26:04.497763+0000","last_became_active":"2023-12-08T20:54:56.365432+0000","last_became_peered":"2023-12-08T20:54:56.365432+0000","last_unstale":"2023-12-08T21:26:04.497763+0000","last_undegraded":"2023-12-08T21:26:04.497763+0000","last_fullsized":"2023-12-08T21:26:04.497763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-12-08T21:26:04.497467+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-12-08T21:26:04.497467+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.497467+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:58:46.607618+0000","scrub_duration":0.0033388139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'32","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:03.491249+0000","last_change":"2023-12-08T21:26:03.491249+0000","last_active":"2023-12-08T21:26:03.491249+0000","last_peered":"2023-12-08T21:26:03.491249+0000","last_clean":"2023-12-08T21:26:03.491249+0000","last_became_active":"2023-12-08T20:54:56.392408+0000","last_became_peered":"2023-12-08T20:54:56.392408+0000","last_unstale":"2023-12-08T21:26:03.491249+0000","last_undegraded":"2023-12-08T21:26:03.491249+0000","last_fullsized":"2023-12-08T21:26:03.491249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:03.490973+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:03.490973+0000","last_clean_scrub_stamp":"2023-12-08T21:26:03.490973+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:55:48.345009+0000","scrub_duration":0.0042798330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:22.184387+0000","last_change":"2023-12-08T21:26:22.184387+0000","last_active":"2023-12-08T21:26:22.184387+0000","last_peered":"2023-12-08T21:26:22.184387+0000","last_clean":"2023-12-08T21:26:22.184387+0000","last_became_active":"2023-12-08T20:54:56.380137+0000","last_became_peered":"2023-12-08T20:54:56.380137+0000","last_unstale":"2023-12-08T21:26:22.184387+0000","last_undegraded":"2023-12-08T21:26:22.184387+0000","last_fullsized":"2023-12-08T21:26:22.184387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:26:22.183980+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:26:22.183980+0000","last_clean_scrub_stamp":"2023-12-08T21:26:22.183980+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:46:57.233922+0000","scrub_duration":0.0028384159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'21","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:34.215457+0000","last_change":"2023-12-08T21:26:34.215509+0000","last_active":"2023-12-08T21:26:34.215457+0000","last_peered":"2023-12-08T21:26:34.215457+0000","last_clean":"2023-12-08T21:26:34.215457+0000","last_became_active":"2023-12-08T20:54:56.391299+0000","last_became_peered":"2023-12-08T20:54:56.391299+0000","last_unstale":"2023-12-08T21:26:34.215457+0000","last_undegraded":"2023-12-08T21:26:34.215457+0000","last_fullsized":"2023-12-08T21:26:34.215457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:34.215250+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:34.215250+0000","last_clean_scrub_stamp":"2023-12-08T21:26:34.215250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T22:02:27.596309+0000","scrub_duration":0.0027662479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'32","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:14.100437+0000","last_change":"2023-12-08T21:26:14.100437+0000","last_active":"2023-12-08T21:26:14.100437+0000","last_peered":"2023-12-08T21:26:14.100437+0000","last_clean":"2023-12-08T21:26:14.100437+0000","last_became_active":"2023-12-08T20:54:56.392708+0000","last_became_peered":"2023-12-08T20:54:56.392708+0000","last_unstale":"2023-12-08T21:26:14.100437+0000","last_undegraded":"2023-12-08T21:26:14.100437+0000","last_fullsized":"2023-12-08T21:26:14.100437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-12-08T21:26:14.100007+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-12-08T21:26:14.100007+0000","last_clean_scrub_stamp":"2023-12-08T21:26:14.100007+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T06:23:56.090149+0000","scrub_duration":0.0033906460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'30","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:07.865013+0000","last_change":"2023-12-08T21:26:07.865013+0000","last_active":"2023-12-08T21:26:07.865013+0000","last_peered":"2023-12-08T21:26:07.865013+0000","last_clean":"2023-12-08T21:26:07.865013+0000","last_became_active":"2023-12-08T20:54:56.318400+0000","last_became_peered":"2023-12-08T20:54:56.318400+0000","last_unstale":"2023-12-08T21:26:07.865013+0000","last_undegraded":"2023-12-08T21:26:07.865013+0000","last_fullsized":"2023-12-08T21:26:07.865013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-12-08T21:26:07.864752+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-12-08T21:26:07.864752+0000","last_clean_scrub_stamp":"2023-12-08T21:26:07.864752+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:43:38.394802+0000","scrub_duration":0.0055178909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'20","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:36.909165+0000","last_change":"2023-12-08T21:26:36.909219+0000","last_active":"2023-12-08T21:26:36.909165+0000","last_peered":"2023-12-08T21:26:36.909165+0000","last_clean":"2023-12-08T21:26:36.909165+0000","last_became_active":"2023-12-08T20:54:56.413220+0000","last_became_peered":"2023-12-08T20:54:56.413220+0000","last_unstale":"2023-12-08T21:26:36.909165+0000","last_undegraded":"2023-12-08T21:26:36.909165+0000","last_fullsized":"2023-12-08T21:26:36.909165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2023-12-08T21:26:36.908966+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2023-12-08T21:26:36.908966+0000","last_clean_scrub_stamp":"2023-12-08T21:26:36.908966+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T21:54:27.292704+0000","scrub_duration":0.003304455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:11.113585+0000","last_change":"2023-12-08T21:26:11.113697+0000","last_active":"2023-12-08T21:26:11.113585+0000","last_peered":"2023-12-08T21:26:11.113585+0000","last_clean":"2023-12-08T21:26:11.113585+0000","last_became_active":"2023-12-08T20:54:56.365448+0000","last_became_peered":"2023-12-08T20:54:56.365448+0000","last_unstale":"2023-12-08T21:26:11.113585+0000","last_undegraded":"2023-12-08T21:26:11.113585+0000","last_fullsized":"2023-12-08T21:26:11.113585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2023-12-08T21:26:11.113287+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2023-12-08T21:26:11.113287+0000","last_clean_scrub_stamp":"2023-12-08T21:26:11.113287+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T08:21:06.223582+0000","scrub_duration":0.0035769590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'25","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:06.890733+0000","last_change":"2023-12-08T21:26:06.890777+0000","last_active":"2023-12-08T21:26:06.890733+0000","last_peered":"2023-12-08T21:26:06.890733+0000","last_clean":"2023-12-08T21:26:06.890733+0000","last_became_active":"2023-12-08T20:54:56.369574+0000","last_became_peered":"2023-12-08T20:54:56.369574+0000","last_unstale":"2023-12-08T21:26:06.890733+0000","last_undegraded":"2023-12-08T21:26:06.890733+0000","last_fullsized":"2023-12-08T21:26:06.890733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-12-08T21:26:06.890558+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-12-08T21:26:06.890558+0000","last_clean_scrub_stamp":"2023-12-08T21:26:06.890558+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:42:36.323222+0000","scrub_duration":0.0032420529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'21","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:13.103052+0000","last_change":"2023-12-08T21:26:13.103090+0000","last_active":"2023-12-08T21:26:13.103052+0000","last_peered":"2023-12-08T21:26:13.103052+0000","last_clean":"2023-12-08T21:26:13.103052+0000","last_became_active":"2023-12-08T20:54:56.411339+0000","last_became_peered":"2023-12-08T20:54:56.411339+0000","last_unstale":"2023-12-08T21:26:13.103052+0000","last_undegraded":"2023-12-08T21:26:13.103052+0000","last_fullsized":"2023-12-08T21:26:13.103052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-12-08T21:26:13.102896+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-12-08T21:26:13.102896+0000","last_clean_scrub_stamp":"2023-12-08T21:26:13.102896+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T03:37:09.675808+0000","scrub_duration":0.0030662670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'17","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:21.921229+0000","last_change":"2023-12-08T21:26:21.921229+0000","last_active":"2023-12-08T21:26:21.921229+0000","last_peered":"2023-12-08T21:26:21.921229+0000","last_clean":"2023-12-08T21:26:21.921229+0000","last_became_active":"2023-12-08T20:54:56.369650+0000","last_became_peered":"2023-12-08T20:54:56.369650+0000","last_unstale":"2023-12-08T21:26:21.921229+0000","last_undegraded":"2023-12-08T21:26:21.921229+0000","last_fullsized":"2023-12-08T21:26:21.921229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-12-08T21:26:21.920971+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-12-08T21:26:21.920971+0000","last_clean_scrub_stamp":"2023-12-08T21:26:21.920971+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:04:45.090796+0000","scrub_duration":0.0034163510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:04.876732+0000","last_change":"2023-12-08T21:26:04.876732+0000","last_active":"2023-12-08T21:26:04.876732+0000","last_peered":"2023-12-08T21:26:04.876732+0000","last_clean":"2023-12-08T21:26:04.876732+0000","last_became_active":"2023-12-08T20:54:56.408861+0000","last_became_peered":"2023-12-08T20:54:56.408861+0000","last_unstale":"2023-12-08T21:26:04.876732+0000","last_undegraded":"2023-12-08T21:26:04.876732+0000","last_fullsized":"2023-12-08T21:26:04.876732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:04.876470+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:04.876470+0000","last_clean_scrub_stamp":"2023-12-08T21:26:04.876470+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T05:42:10.809218+0000","scrub_duration":0.0033527380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'19","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:18.882384+0000","last_change":"2023-12-08T21:26:18.882418+0000","last_active":"2023-12-08T21:26:18.882384+0000","last_peered":"2023-12-08T21:26:18.882384+0000","last_clean":"2023-12-08T21:26:18.882384+0000","last_became_active":"2023-12-08T20:54:56.404697+0000","last_became_peered":"2023-12-08T20:54:56.404697+0000","last_unstale":"2023-12-08T21:26:18.882384+0000","last_undegraded":"2023-12-08T21:26:18.882384+0000","last_fullsized":"2023-12-08T21:26:18.882384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2023-12-08T21:26:18.882300+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2023-12-08T21:26:18.882300+0000","last_clean_scrub_stamp":"2023-12-08T21:26:18.882300+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:47:36.089699+0000","scrub_duration":0.0021163979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T21:26:15.123472+0000","last_change":"2023-12-08T21:26:15.123540+0000","last_active":"2023-12-08T21:26:15.123472+0000","last_peered":"2023-12-08T21:26:15.123472+0000","last_clean":"2023-12-08T21:26:15.123472+0000","last_became_active":"2023-12-08T20:54:56.377835+0000","last_became_peered":"2023-12-08T20:54:56.377835+0000","last_unstale":"2023-12-08T21:26:15.123472+0000","last_undegraded":"2023-12-08T21:26:15.123472+0000","last_fullsized":"2023-12-08T21:26:15.123472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-12-08T21:26:15.123273+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-12-08T21:26:15.123273+0000","last_clean_scrub_stamp":"2023-12-08T21:26:15.123273+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T00:25:29.875062+0000","scrub_duration":0.0058249160000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2350,"num_write_kb":252630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2525,"ondisk_log_size":2525,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1552,"ondisk_log_size":1552,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23858448,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":574,"num_read_kb":595,"num_write":5673,"num_write_kb":26542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32464896,"data_stored":47716896,"data_compressed":4732252,"data_compressed_allocated":7307264,"data_compressed_original":22618112,"omap_allocated":0,"internal_metadata":0},"log_size":5234,"ondisk_log_size":5234,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509840,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":4588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":4698112,"data_stored":7801495,"data_compressed":855543,"data_compressed_allocated":1261568,"data_compressed_original":4567040,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91600000000000004,"15min":0.89000000000000001},"min":{"1min":0.66300000000000003,"5min":0.57299999999999995,"15min":0.371},"max":{"1min":1.234,"5min":1.458,"15min":1.458},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.95999999999999996,"15min":0.95099999999999996},"min":{"1min":0.67600000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.26,"5min":1.4710000000000001,"15min":1.6479999999999999},"last":1.1799999999999999}]},{"osd":1,"last update":"Fri Dec 8 21:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1,"15min":0.94499999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.44400000000000001},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.91300000000000003,"15min":0.93100000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.48599999999999999},"max":{"1min":1.1819999999999999,"5min":1.3300000000000001,"15min":1.504},"last":0.81999999999999995}]},{"osd":2,"last update":"Fri Dec 8 21:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.98999999999999999,"15min":0.93100000000000005},"min":{"1min":0.65600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3779999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97199999999999998,"15min":0.98699999999999999},"min":{"1min":0.78300000000000003,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":1.2889999999999999,"5min":1.3049999999999999,"15min":1.776},"last":1.149}]},{"osd":3,"last update":"Fri Dec 8 21:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.004,"15min":1.0029999999999999},"min":{"1min":0.79100000000000004,"5min":0.58799999999999997,"15min":0.46700000000000003},"max":{"1min":1.399,"5min":1.399,"15min":2.0840000000000001},"last":1.05},{"interface":"front","average":{"1min":1.111,"5min":1.0740000000000001,"15min":1.0800000000000001},"min":{"1min":0.76800000000000002,"5min":0.61399999999999999,"15min":0.44800000000000001},"max":{"1min":1.331,"5min":1.427,"15min":2.181},"last":1.0920000000000001}]},{"osd":4,"last update":"Fri Dec 8 21:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90300000000000002,"15min":0.92600000000000005},"min":{"1min":0.71799999999999997,"5min":0.35699999999999998,"15min":0.30199999999999999},"max":{"1min":1.1859999999999999,"5min":1.444,"15min":1.972},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.03,"15min":1.0369999999999999},"min":{"1min":0.68400000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.593,"5min":1.593,"15min":1.8149999999999999},"last":1.3560000000000001}]},{"osd":6,"last update":"Fri Dec 8 21:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.01,"15min":1.0309999999999999},"min":{"1min":0.69499999999999995,"5min":0.48199999999999998,"15min":0.41799999999999998},"max":{"1min":1.375,"5min":1.4910000000000001,"15min":2.3069999999999999},"last":1.228},{"interface":"front","average":{"1min":1.048,"5min":1.052,"15min":1.0720000000000001},"min":{"1min":0.63,"5min":0.52700000000000002,"15min":0.52100000000000002},"max":{"1min":1.298,"5min":1.5569999999999999,"15min":1.8959999999999999},"last":1.125}]},{"osd":7,"last update":"Fri Dec 8 21:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1180000000000001,"15min":1.117},"min":{"1min":0.69299999999999995,"5min":0.65100000000000002,"15min":0.56999999999999995},"max":{"1min":1.5029999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.175,"15min":1.179},"min":{"1min":0.85299999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.548,"5min":1.5529999999999999,"15min":1.8600000000000001},"last":1.3100000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509840,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62188,"kb_used_data":8804,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309652,"statfs":{"total":96636764160,"available":96573083648,"internally_reserved":0,"allocated":9015296,"data_stored":12714767,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.504,"5min":0.35499999999999998,"15min":0.27800000000000002},"max":{"1min":1.359,"5min":1.3700000000000001,"15min":1.655},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78400000000000003,"15min":0.77300000000000002},"min":{"1min":0.46200000000000002,"5min":0.375,"15min":0.34699999999999998},"max":{"1min":0.95199999999999996,"5min":1.504,"15min":1.7809999999999999},"last":0.97899999999999998}]},{"osd":1,"last update":"Fri Dec 8 21:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.80700000000000005,"15min":0.80400000000000005},"min":{"1min":0.40000000000000002,"5min":0.34200000000000003,"15min":0.30399999999999999},"max":{"1min":1.0269999999999999,"5min":1.5189999999999999,"15min":1.5329999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.90200000000000002,"15min":0.92000000000000004},"min":{"1min":0.57099999999999995,"5min":0.40300000000000002,"15min":0.26900000000000002},"max":{"1min":1.2629999999999999,"5min":1.4490000000000001,"15min":2.036},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Dec 8 21:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.93000000000000005,"15min":0.91900000000000004},"min":{"1min":0.51500000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.238,"5min":1.585,"15min":1.9470000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.95699999999999996,"15min":0.97999999999999998},"min":{"1min":0.62,"5min":0.442,"15min":0.28399999999999997},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.786},"last":0.92500000000000004}]},{"osd":4,"last update":"Fri Dec 8 21:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.044,"15min":1.071},"min":{"1min":0.748,"5min":0.61499999999999999,"15min":0.52000000000000002},"max":{"1min":1.1140000000000001,"5min":1.73,"15min":1.73},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.125,"15min":1.1359999999999999},"min":{"1min":0.67400000000000004,"5min":0.622,"15min":0.53700000000000003},"max":{"1min":1.3320000000000001,"5min":1.875,"15min":2.3039999999999998},"last":1.0920000000000001}]},{"osd":5,"last update":"Fri Dec 8 21:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.177,"15min":1.167},"min":{"1min":0.75900000000000001,"5min":0.67800000000000005,"15min":0.65700000000000003},"max":{"1min":1.319,"5min":2.0619999999999998,"15min":2.2999999999999998},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.1970000000000001,"15min":1.252},"min":{"1min":0.79600000000000004,"5min":0.68000000000000005,"15min":0.55000000000000004},"max":{"1min":1.3120000000000001,"5min":2.0129999999999999,"15min":2.9319999999999999},"last":1.0329999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.2310000000000001,"15min":1.2709999999999999},"min":{"1min":0.88800000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.405,"5min":1.9199999999999999,"15min":2.5510000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1970000000000001,"15min":1.2070000000000001},"min":{"1min":0.81699999999999995,"5min":0.65600000000000003,"15min":0.621},"max":{"1min":1.2370000000000001,"5min":1.8460000000000001,"15min":1.9059999999999999},"last":1.1339999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.242,"15min":1.25},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.58899999999999997},"max":{"1min":1.3069999999999999,"5min":1.849,"15min":1.849},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.306,"15min":1.2909999999999999},"min":{"1min":0.83499999999999996,"5min":0.64100000000000001,"15min":0.58499999999999996},"max":{"1min":1.8740000000000001,"5min":1.966,"15min":2.1640000000000001},"last":1.22}]}]},{"osd":2,"up_from":15,"seq":64424509839,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37588,"kb_used_data":6412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334252,"statfs":{"total":96636764160,"available":96598274048,"internally_reserved":0,"allocated":6565888,"data_stored":8520553,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74399999999999999,"15min":0.747},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.4670000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.80300000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.316},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.59299999999999997}]},{"osd":1,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.87,"15min":0.872},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.38900000000000001},"max":{"1min":1.202,"5min":1.466,"15min":1.6599999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.91700000000000004,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":4.5620000000000003},"last":0.97099999999999997}]},{"osd":3,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.86699999999999999,"15min":0.84999999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.39300000000000002},"max":{"1min":1.0509999999999999,"5min":1.704,"15min":1.704},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.008},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4330000000000001,"5min":1.643,"15min":1.661},"last":0.874}]},{"osd":4,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.111,"15min":1.0960000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.51200000000000001},"max":{"1min":1.3169999999999999,"5min":1.647,"15min":1.726},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0589999999999999,"15min":1.0409999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2589999999999999,"5min":1.6060000000000001,"15min":1.6240000000000001},"last":1.2010000000000001}]},{"osd":5,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.208,"15min":1.1970000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5800000000000001,"5min":1.7649999999999999,"15min":1.8009999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.196,"15min":1.1910000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.61099999999999999},"max":{"1min":1.667,"5min":1.7470000000000001,"15min":1.855},"last":1.073}]},{"osd":6,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.133,"15min":1.131},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.7270000000000001},"last":1.048},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.54700000000000004},"max":{"1min":1.8100000000000001,"5min":1.907,"15min":2.0150000000000001},"last":1.232}]},{"osd":7,"last update":"Fri Dec 8 21:26:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.284,"15min":1.272},"min":{"1min":0.81399999999999995,"5min":0.76200000000000001,"15min":0.56999999999999995},"max":{"1min":1.7729999999999999,"5min":1.8400000000000001,"15min":1.9810000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.2370000000000001,"15min":1.2130000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.68500000000000005},"max":{"1min":1.74,"5min":1.7869999999999999,"15min":1.8240000000000001},"last":1.1180000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509841,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":721711,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72399999999999998,"15min":0.73899999999999999},"min":{"1min":0.32800000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.1890000000000001,"5min":1.2569999999999999,"15min":1.7689999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.84999999999999998,"15min":0.79800000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1319999999999999,"5min":1.556,"15min":1.556},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.748,"15min":0.748},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.179,"5min":1.3899999999999999,"15min":1.4510000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.93600000000000005,"15min":0.90800000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.33500000000000002},"max":{"1min":1.1890000000000001,"5min":1.5069999999999999,"15min":2.0019999999999998},"last":1.1140000000000001}]},{"osd":3,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.96999999999999997,"15min":0.94899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.32400000000000001},"max":{"1min":1.431,"5min":1.639,"15min":1.948},"last":1.3149999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.96499999999999997,"15min":0.93700000000000006},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.35199999999999998},"max":{"1min":1.109,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0629999999999999}]},{"osd":4,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.1000000000000001,"15min":1.079},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.57299999999999995},"max":{"1min":1.3560000000000001,"5min":1.879,"15min":1.879},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.169,"15min":1.1599999999999999},"min":{"1min":0.79400000000000004,"5min":0.66900000000000004,"15min":0.626},"max":{"1min":1.518,"5min":1.7470000000000001,"15min":1.841},"last":1.494}]},{"osd":5,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.2070000000000001,"15min":1.163},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.60199999999999998},"max":{"1min":1.3600000000000001,"5min":1.6899999999999999,"15min":1.9179999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1910000000000001,"15min":1.1639999999999999},"min":{"1min":0.67100000000000004,"5min":0.65300000000000002,"15min":0.64600000000000002},"max":{"1min":1.5649999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.98699999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.2430000000000001,"15min":1.2350000000000001},"min":{"1min":0.64800000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.456,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.607},{"interface":"front","average":{"1min":1.119,"5min":1.254,"15min":1.2310000000000001},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.482,"5min":1.7529999999999999,"15min":2.0259999999999998},"last":1.3999999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:26:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.3069999999999999,"15min":1.274},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.6220000000000001,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.27,"15min":1.2430000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.67300000000000004},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.3680000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509840,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46668,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94325172,"statfs":{"total":96636764160,"available":96588976128,"internally_reserved":0,"allocated":3084288,"data_stored":4325633,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 21:27:08 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.745},"min":{"1min":0.48199999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.698},"last":0.62},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.82199999999999995,"15min":0.80700000000000005},"min":{"1min":0.55300000000000005,"5min":0.377,"15min":0.377},"max":{"1min":1.3129999999999999,"5min":1.4650000000000001,"15min":1.907},"last":0.97699999999999998}]},{"osd":2,"last update":"Fri Dec 8 21:27:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.84099999999999997,"15min":0.83999999999999997},"min":{"1min":0.56599999999999995,"5min":0.41799999999999998,"15min":0.34100000000000003},"max":{"1min":1.117,"5min":1.3959999999999999,"15min":1.633},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.90100000000000002,"15min":0.874},"min":{"1min":0.59899999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2270000000000001,"5min":1.639,"15min":1.6990000000000001},"last":0.82399999999999995}]},{"osd":3,"last update":"Fri Dec 8 21:27:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.82899999999999996,"15min":0.82399999999999995},"min":{"1min":0.52000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2989999999999999,"5min":1.3819999999999999,"15min":1.657},"last":1.0800000000000001},{"interface":"front","average":{"1min":1,"5min":1.0229999999999999,"15min":1.0189999999999999},"min":{"1min":0.73799999999999999,"5min":0.40999999999999998,"15min":0.38400000000000001},"max":{"1min":1.2609999999999999,"5min":1.694,"15min":2.2850000000000001},"last":0.92500000000000004}]},{"osd":4,"last update":"Fri Dec 8 21:27:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3839999999999999,"5min":2.0760000000000001,"15min":2.1000000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.077,"15min":1.1180000000000001},"min":{"1min":0.72399999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3120000000000001,"5min":1.8720000000000001,"15min":14.787000000000001},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Dec 8 21:27:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1859999999999999,"15min":1.1870000000000001},"min":{"1min":0.92700000000000005,"5min":0.68000000000000005,"15min":0.61699999999999999},"max":{"1min":1.607,"5min":1.726,"15min":2.218},"last":1.04},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.2070000000000001,"15min":1.196},"min":{"1min":0.85899999999999999,"5min":0.73399999999999999,"15min":0.66900000000000004},"max":{"1min":1.385,"5min":1.8740000000000001,"15min":2.2309999999999999},"last":1.1619999999999999}]},{"osd":6,"last update":"Fri Dec 8 21:27:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.147,"15min":1.143},"min":{"1min":0.88800000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.365,"5min":2.1269999999999998,"15min":2.3380000000000001},"last":1.226},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2789999999999999,"15min":1.2849999999999999},"min":{"1min":0.95399999999999996,"5min":0.747,"15min":0.68500000000000005},"max":{"1min":1.6140000000000001,"5min":1.927,"15min":2.1480000000000001},"last":1.1299999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:27:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2609999999999999,"15min":1.27},"min":{"1min":0.90200000000000002,"5min":0.65000000000000002,"15min":0.60199999999999998},"max":{"1min":1.571,"5min":2.0059999999999998,"15min":2.3300000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.214,"15min":1.2210000000000001},"min":{"1min":1.0209999999999999,"5min":0.67000000000000004,"15min":0.58099999999999996},"max":{"1min":1.4890000000000001,"5min":2.024,"15min":2.4319999999999999},"last":1.306}]}]},{"osd":7,"up_from":14,"seq":60129542544,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29016,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342824,"statfs":{"total":96636764160,"available":96607051776,"internally_reserved":0,"allocated":2048000,"data_stored":3016855,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.93500000000000005,"15min":0.91500000000000004},"min":{"1min":0.56399999999999995,"5min":0.55200000000000005,"15min":0.38100000000000001},"max":{"1min":1.268,"5min":1.321,"15min":1.8939999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.60199999999999998,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.256,"5min":1.948,"15min":1.948},"last":1.1579999999999999}]},{"osd":1,"last update":"Fri Dec 8 21:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.96399999999999997,"15min":0.93700000000000006},"min":{"1min":0.56000000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3100000000000001,"5min":3.246,"15min":3.246},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.95199999999999996,"15min":0.94999999999999996},"min":{"1min":0.64500000000000002,"5min":0.499,"15min":0.45400000000000001},"max":{"1min":1.3560000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.1930000000000001}]},{"osd":2,"last update":"Fri Dec 8 21:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97999999999999998,"15min":0.98199999999999998},"min":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.228,"5min":1.2569999999999999,"15min":1.9399999999999999},"last":0.87},{"interface":"front","average":{"1min":1.083,"5min":1,"15min":0.98699999999999999},"min":{"1min":0.749,"5min":0.61899999999999999,"15min":0.47799999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.8280000000000001},"last":0.94799999999999995}]},{"osd":3,"last update":"Fri Dec 8 21:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0329999999999999,"15min":1.0349999999999999},"min":{"1min":0.748,"5min":0.57199999999999995,"15min":0.55300000000000005},"max":{"1min":1.26,"5min":1.528,"15min":1.528},"last":1.228},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0249999999999999,"15min":1.0109999999999999},"min":{"1min":0.747,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.274,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.90900000000000003}]},{"osd":4,"last update":"Fri Dec 8 21:26:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.627,"5min":0.58099999999999996,"15min":0.55300000000000005},"max":{"1min":1.302,"5min":1.3859999999999999,"15min":1.45},"last":1.333},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.92500000000000004,"15min":0.99399999999999999},"min":{"1min":0.55000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.389,"5min":1.389,"15min":1.5680000000000001},"last":1.0429999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92900000000000005,"15min":0.98299999999999998},"min":{"1min":0.67300000000000004,"5min":0.63800000000000001,"15min":0.54400000000000004},"max":{"1min":1.448,"5min":1.448,"15min":1.7410000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.095,"15min":1.1299999999999999},"min":{"1min":0.80000000000000004,"5min":0.67600000000000005,"15min":0.55400000000000005},"max":{"1min":1.5209999999999999,"5min":1.6419999999999999,"15min":1.857},"last":1.0820000000000001}]},{"osd":6,"last update":"Fri Dec 8 21:26:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0109999999999999,"15min":1.0800000000000001},"min":{"1min":0.78500000000000003,"5min":0.68799999999999994,"15min":0.66400000000000003},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.948},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.198,"15min":1.216},"min":{"1min":0.995,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":2.0019999999999998},"last":1.2869999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542545,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42332,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329508,"statfs":{"total":96636764160,"available":96593416192,"internally_reserved":0,"allocated":2904064,"data_stored":4325577,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.94699999999999995,"15min":0.90400000000000003},"min":{"1min":0.624,"5min":0.48999999999999999,"15min":0.48799999999999999},"max":{"1min":1.375,"5min":1.395,"15min":1.4430000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98099999999999998,"15min":0.91100000000000003},"min":{"1min":0.70699999999999996,"5min":0.56599999999999995,"15min":0.44900000000000001},"max":{"1min":1.3420000000000001,"5min":1.3979999999999999,"15min":1.4790000000000001},"last":1.2030000000000001}]},{"osd":1,"last update":"Fri Dec 8 21:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.98899999999999999,"15min":0.93799999999999994},"min":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.55000000000000004},"max":{"1min":1.2010000000000001,"5min":1.512,"15min":1.512},"last":1.3109999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.91400000000000003},"min":{"1min":0.621,"5min":0.60899999999999999,"15min":0.48699999999999999},"max":{"1min":1.2130000000000001,"5min":1.4159999999999999,"15min":1.512},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Dec 8 21:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96999999999999997,"15min":0.93999999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.53800000000000003},"max":{"1min":1.3420000000000001,"5min":1.357,"15min":1.421},"last":1.018},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.044,"15min":1.002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.51300000000000001},"max":{"1min":1.274,"5min":1.546,"15min":1.546},"last":1.0649999999999999}]},{"osd":3,"last update":"Fri Dec 8 21:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0229999999999999,"15min":1.0189999999999999},"min":{"1min":0.80500000000000005,"5min":0.621,"15min":0.56000000000000005},"max":{"1min":1.3480000000000001,"5min":1.5529999999999999,"15min":1.708},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.149,"15min":1.123},"min":{"1min":0.73299999999999998,"5min":0.72499999999999998,"15min":0.54700000000000004},"max":{"1min":1.4419999999999999,"5min":1.542,"15min":1.7},"last":1.3779999999999999}]},{"osd":4,"last update":"Fri Dec 8 21:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.94299999999999995,"15min":0.96899999999999997},"min":{"1min":0.61599999999999999,"5min":0.58899999999999997,"15min":0.50900000000000001},"max":{"1min":1.2929999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.151},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0109999999999999,"15min":1.0049999999999999},"min":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.57899999999999996},"max":{"1min":1.4530000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.96099999999999997}]},{"osd":5,"last update":"Fri Dec 8 21:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.95399999999999996,"15min":0.96699999999999997},"min":{"1min":0.68500000000000005,"5min":0.56499999999999995,"15min":0.53100000000000003},"max":{"1min":1.337,"5min":1.496,"15min":1.79},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.127,"15min":1.1160000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.432},"max":{"1min":1.4890000000000001,"5min":1.754,"15min":1.754},"last":1.2589999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.071,"15min":1.073},"min":{"1min":0.70499999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.202,"15min":1.2010000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.47299999999999998},"max":{"1min":1.544,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.4650000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542543,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55520,"kb_used_data":6296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316320,"statfs":{"total":96636764160,"available":96579911680,"internally_reserved":0,"allocated":6447104,"data_stored":8521225,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.501,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":1.238,"5min":1.381,"15min":1.6000000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91800000000000004,"15min":0.90700000000000003},"min":{"1min":0.58399999999999996,"5min":0.51000000000000001,"15min":0.41399999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.391},"last":0.83899999999999997}]},{"osd":1,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.94399999999999995,"15min":0.91400000000000003},"min":{"1min":0.63600000000000001,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":1.3140000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.03,"15min":0.998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.46100000000000002},"max":{"1min":1.304,"5min":1.4530000000000001,"15min":1.4570000000000001},"last":0.63900000000000001}]},{"osd":2,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.004,"15min":1.0129999999999999},"min":{"1min":0.59399999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4079999999999999,"5min":1.4710000000000001,"15min":1.681},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95099999999999996,"15min":0.94799999999999995},"min":{"1min":0.68600000000000005,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.2250000000000001,"5min":1.385,"15min":1.52},"last":0.996}]},{"osd":3,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98999999999999999,"15min":0.98899999999999999},"min":{"1min":0.73999999999999999,"5min":0.63100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2629999999999999,"5min":1.927,"15min":1.927},"last":0.755},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.139,"15min":1.1140000000000001},"min":{"1min":0.75900000000000001,"5min":0.64100000000000001,"15min":0.433},"max":{"1min":1.377,"5min":1.6519999999999999,"15min":1.7549999999999999},"last":1.0609999999999999}]},{"osd":5,"last update":"Fri Dec 8 21:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89400000000000002,"15min":0.92100000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.206,"5min":1.28,"15min":1.504},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.048,"5min":1.026,"15min":1.0049999999999999},"min":{"1min":0.61499999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.409,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Dec 8 21:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0469999999999999,"15min":1.0589999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.073,"5min":1.0740000000000001,"15min":1.0600000000000001},"min":{"1min":0.71199999999999997,"5min":0.69899999999999995,"15min":0.52900000000000003},"max":{"1min":1.4970000000000001,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.0269999999999999}]},{"osd":7,"last update":"Fri Dec 8 21:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.181,"15min":1.1619999999999999},"min":{"1min":0.65600000000000003,"5min":0.65500000000000003,"15min":0.39400000000000002},"max":{"1min":1.806,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.077,"5min":1.0920000000000001,"15min":1.0980000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45400000000000001},"max":{"1min":1.4650000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.92100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":4194360,"data_compressed":441445,"data_compressed_allocated":659456,"data_compressed_original":2097152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6246400,"data_stored":8389280,"data_compressed":708924,"data_compressed_allocated":1179648,"data_compressed_original":3330048,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8695808,"data_stored":12583494,"data_compressed":1200153,"data_compressed_allocated":1822720,"data_compressed_original":5713920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":8389952,"data_compressed":737398,"data_compressed_allocated":1212416,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4313088,"data_stored":7079854,"data_compressed":822166,"data_compressed_allocated":1216512,"data_compressed_original":3993600,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":4194304,"data_compressed":464943,"data_compressed_allocated":704512,"data_compressed_original":2314240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1728512,"data_stored":2885582,"data_compressed":357223,"data_compressed_allocated":512000,"data_compressed_original":1679360,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T21:27:19.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-08T21:27:19.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.761+0000 7f2fd6de6640 1 Processor -- start 2023-12-08T21:27:19.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.761+0000 7f2fd6de6640 1 -- start start 2023-12-08T21:27:19.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.761+0000 7f2fd6de6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fd006ed30 0x7f2fd00c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:19.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.761+0000 7f2fd6de6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2fd0071140 0x7f2fd0157290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:19.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.761+0000 7f2fd6de6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd0157e90 con 0x7f2fd006f110 2023-12-08T21:27:19.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.761+0000 7f2fd6de6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd0158170 con 0x7f2fd0071140 2023-12-08T21:27:19.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.761+0000 7f2fd6de6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd015a920 con 0x7f2fd006ed30 2023-12-08T21:27:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.761+0000 7f2fd4b82640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fd006ed30 0x7f2fd00c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.761+0000 7f2fd5383640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2fd0071140 0x7f2fd0157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:19.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.761+0000 7f2fd4b82640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fd006ed30 0x7f2fd00c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:42816/0 (socket says 172.21.15.53:42816) 2023-12-08T21:27:19.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.761+0000 7f2fd4b82640 1 -- 172.21.15.53:0/3794078714 learned_addr learned my addr 172.21.15.53:0/3794078714 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.769+0000 7f2fd4b82640 1 -- 172.21.15.53:0/3794078714 >> v2:172.21.15.146:3300/0 conn(0x7f2fd0071140 msgr2=0x7f2fd0157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.769+0000 7f2fd4b82640 1 --2- 172.21.15.53:0/3794078714 >> v2:172.21.15.146:3300/0 conn(0x7f2fd0071140 0x7f2fd0157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.769+0000 7f2fd4b82640 1 -- 172.21.15.53:0/3794078714 >> v1:172.21.15.146:6789/0 conn(0x7f2fd006f110 legacy=0x7f2fd006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.769+0000 7f2fd4b82640 1 -- 172.21.15.53:0/3794078714 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd015ac00 con 0x7f2fd006ed30 2023-12-08T21:27:19.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.773+0000 7f2fd4b82640 1 --2- 172.21.15.53:0/3794078714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fd006ed30 0x7f2fd00c58f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009870 tx=0x7f2fcc01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4b99489f4aaf895 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:19.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.781+0000 7f2fc77fe640 1 -- 172.21.15.53:0/3794078714 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0a8a30 con 0x7f2fd006ed30 2023-12-08T21:27:19.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.781+0000 7f2fc77fe640 1 -- 172.21.15.53:0/3794078714 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc0a8b90 con 0x7f2fd006ed30 2023-12-08T21:27:19.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.781+0000 7f2fc77fe640 1 -- 172.21.15.53:0/3794078714 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0b0440 con 0x7f2fd006ed30 2023-12-08T21:27:19.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.781+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3794078714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fd006ed30 msgr2=0x7f2fd00c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:19.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.781+0000 7f2fd6de6640 1 --2- 172.21.15.53:0/3794078714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fd006ed30 0x7f2fd00c58f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009870 tx=0x7f2fcc01ed30 comp rx=0 tx=0).stop 2023-12-08T21:27:19.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.781+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3794078714 shutdown_connections 2023-12-08T21:27:19.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.781+0000 7f2fd6de6640 1 --2- 172.21.15.53:0/3794078714 >> v2:172.21.15.146:3300/0 conn(0x7f2fd0071140 0x7f2fd0157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.781+0000 7f2fd6de6640 1 --2- 172.21.15.53:0/3794078714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fd006ed30 0x7f2fd00c58f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.781+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3794078714 >> 172.21.15.53:0/3794078714 conn(0x7f2fd00caef0 msgr2=0x7f2fd00cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:19.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.785+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3794078714 shutdown_connections 2023-12-08T21:27:19.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.785+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3794078714 wait complete. 2023-12-08T21:27:19.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.785+0000 7f2fd6de6640 1 Processor -- start 2023-12-08T21:27:19.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.785+0000 7f2fd6de6640 1 -- start start 2023-12-08T21:27:19.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.785+0000 7f2fd6de6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fd006ed30 0x7f2fd01e0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:19.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.785+0000 7f2fd6de6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fd006f110 0x7f2fd0159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:19.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.785+0000 7f2fd6de6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fd0071140 0x7f2fd01eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:19.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.785+0000 7f2fd6de6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01e14e0 con 0x7f2fd0071140 2023-12-08T21:27:19.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.785+0000 7f2fd6de6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01f2410 con 0x7f2fd006f110 2023-12-08T21:27:19.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.785+0000 7f2fd6de6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01e3f30 con 0x7f2fd006ed30 2023-12-08T21:27:19.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.785+0000 7f2fd5383640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fd0071140 0x7f2fd01eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:19.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.789+0000 7f2fd5383640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fd0071140 0x7f2fd01eeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40342/0 (socket says 172.21.15.53:40342) 2023-12-08T21:27:19.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.789+0000 7f2fd5383640 1 -- 172.21.15.53:0/3942887508 learned_addr learned my addr 172.21.15.53:0/3942887508 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:19.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.789+0000 7f2fc7fff640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fd006f110 0x7f2fd0159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:19.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.789+0000 7f2fd4b82640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fd006ed30 0x7f2fd01e0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:19.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.793+0000 7f2fd5383640 1 -- 172.21.15.53:0/3942887508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fd006ed30 msgr2=0x7f2fd01e0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:19.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.793+0000 7f2fd5383640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fd006ed30 0x7f2fd01e0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.793+0000 7f2fd5383640 1 -- 172.21.15.53:0/3942887508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fd006f110 msgr2=0x7f2fd0159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:19.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.793+0000 7f2fd5383640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fd006f110 0x7f2fd0159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:19.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.793+0000 7f2fd5383640 1 -- 172.21.15.53:0/3942887508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc0094d0 con 0x7f2fd0071140 2023-12-08T21:27:19.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.793+0000 7f2fd5383640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fd0071140 0x7f2fd01eeea0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800efc0 tx=0x7f2fc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:19.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.801+0000 7f2fc57fa640 1 -- 172.21.15.53:0/3942887508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8009ba0 con 0x7f2fd0071140 2023-12-08T21:27:19.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.801+0000 7f2fc57fa640 1 -- 172.21.15.53:0/3942887508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc800f040 con 0x7f2fd0071140 2023-12-08T21:27:19.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.801+0000 7f2fc57fa640 1 -- 172.21.15.53:0/3942887508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80146c0 con 0x7f2fd0071140 2023-12-08T21:27:19.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.801+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3942887508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd01e4210 con 0x7f2fd0071140 2023-12-08T21:27:19.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.801+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3942887508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd01f2940 con 0x7f2fd0071140 2023-12-08T21:27:19.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.801+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3942887508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd00675b0 con 0x7f2fd0071140 2023-12-08T21:27:19.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.825+0000 7f2fc57fa640 1 -- 172.21.15.53:0/3942887508 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2fc8014820 con 0x7f2fd0071140 2023-12-08T21:27:19.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.825+0000 7f2fc57fa640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2fbc0664c0 0x7f2fbc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:19.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.825+0000 7f2fd4b82640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2fbc0664c0 0x7f2fbc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:19.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:19.825+0000 7f2fd4b82640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2fbc0664c0 0x7f2fbc068980 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0b2000 tx=0x7f2fcc0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:20.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.113+0000 7f2fc57fa640 1 -- 172.21.15.53:0/3942887508 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f2fc8056300 con 0x7f2fd0071140 2023-12-08T21:27:20.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.113+0000 7f2fc57fa640 1 -- 172.21.15.53:0/3942887508 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2fc8052640 con 0x7f2fd0071140 2023-12-08T21:27:20.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.289+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3942887508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2fd0070f20 con 0x7f2fd0071140 2023-12-08T21:27:20.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.505+0000 7f2fc57fa640 1 -- 172.21.15.53:0/3942887508 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2fc8018020 con 0x7f2fd0071140 2023-12-08T21:27:20.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.505+0000 7f2fc57fa640 1 -- 172.21.15.53:0/3942887508 <== mon.0 v2:172.21.15.53:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2fc805a3a0 con 0x7f2fd0071140 2023-12-08T21:27:20.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.509+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3942887508 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2fbc0664c0 msgr2=0x7f2fbc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:20.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.509+0000 7f2fd6de6640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2fbc0664c0 0x7f2fbc068980 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0b2000 tx=0x7f2fcc0aa070 comp rx=0 tx=0).stop 2023-12-08T21:27:20.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.509+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3942887508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fd0071140 msgr2=0x7f2fd01eeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:20.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.509+0000 7f2fd6de6640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fd0071140 0x7f2fd01eeea0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800efc0 tx=0x7f2fc800c490 comp rx=0 tx=0).stop 2023-12-08T21:27:20.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.509+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3942887508 shutdown_connections 2023-12-08T21:27:20.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.509+0000 7f2fd6de6640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f2fbc0664c0 0x7f2fbc068980 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:20.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.509+0000 7f2fd6de6640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fd0071140 0x7f2fd01eeea0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:20.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.509+0000 7f2fd6de6640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fd006f110 0x7f2fd0159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.509+0000 7f2fd6de6640 1 --2- 172.21.15.53:0/3942887508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fd006ed30 0x7f2fd01e0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.509+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3942887508 >> 172.21.15.53:0/3942887508 conn(0x7f2fd00caef0 msgr2=0x7f2fd00c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.509+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3942887508 shutdown_connections 2023-12-08T21:27:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.509+0000 7f2fd6de6640 1 -- 172.21.15.53:0/3942887508 wait complete. 2023-12-08T21:27:20.538 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T21:27:20.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T21:27:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.665+0000 7f8bbe84b640 1 Processor -- start 2023-12-08T21:27:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.665+0000 7f8bbe84b640 1 -- start start 2023-12-08T21:27:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.665+0000 7f8bbe84b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bb815d870 0x7f8bb806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.665+0000 7f8bbe84b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb815d3e0 con 0x7f8bb806abf0 2023-12-08T21:27:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.665+0000 7f8bbe84b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb80c2ba0 con 0x7f8bb806a810 2023-12-08T21:27:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.665+0000 7f8bbe84b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80c1260 con 0x7f8bb815d870 2023-12-08T21:27:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.665+0000 7f8bbcde8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bb815d870 0x7f8bb806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.665+0000 7f8bb7fff640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8bb806a810 0x7f8bb806d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.53:39842/0 (socket says 172.21.15.53:39842) 2023-12-08T21:27:20.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.665+0000 7f8bb7fff640 1 -- 172.21.15.53:0/1423633602 learned_addr learned my addr 172.21.15.53:0/1423633602 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:27:20.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.673+0000 7f8bbcde8640 1 -- 172.21.15.53:0/1423633602 >> v1:172.21.15.146:6789/0 conn(0x7f8bb806a810 legacy=0x7f8bb806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:20.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.673+0000 7f8bbcde8640 1 -- 172.21.15.53:0/1423633602 >> v1:172.21.15.53:6789/0 conn(0x7f8bb806abf0 legacy=0x7f8bb8153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:20.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.673+0000 7f8bbcde8640 1 -- 172.21.15.53:0/1423633602 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80c2e80 con 0x7f8bb815d870 2023-12-08T21:27:20.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.677+0000 7f8bbcde8640 1 --2- 172.21.15.53:0/1423633602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bb815d870 0x7f8bb806b120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00097f0 tx=0x7f8bb001ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b3d512be044b0f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:20.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.689+0000 7f8bb6ffd640 1 -- 172.21.15.53:0/1423633602 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00a8970 con 0x7f8bb815d870 2023-12-08T21:27:20.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.689+0000 7f8bb6ffd640 1 -- 172.21.15.53:0/1423633602 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8bb00a8ad0 con 0x7f8bb815d870 2023-12-08T21:27:20.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.689+0000 7f8bb6ffd640 1 -- 172.21.15.53:0/1423633602 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00a8e80 con 0x7f8bb815d870 2023-12-08T21:27:20.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.689+0000 7f8bbe84b640 1 -- 172.21.15.53:0/1423633602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bb815d870 msgr2=0x7f8bb806b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:20.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.689+0000 7f8bbe84b640 1 --2- 172.21.15.53:0/1423633602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bb815d870 0x7f8bb806b120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00097f0 tx=0x7f8bb001ec70 comp rx=0 tx=0).stop 2023-12-08T21:27:20.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.689+0000 7f8bbe84b640 1 -- 172.21.15.53:0/1423633602 shutdown_connections 2023-12-08T21:27:20.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.689+0000 7f8bbe84b640 1 --2- 172.21.15.53:0/1423633602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bb815d870 0x7f8bb806b120 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:20.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.689+0000 7f8bbe84b640 1 -- 172.21.15.53:0/1423633602 >> 172.21.15.53:0/1423633602 conn(0x7f8bb80c8990 msgr2=0x7f8bb80c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:20.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.689+0000 7f8bbe84b640 1 -- 172.21.15.53:0/1423633602 shutdown_connections 2023-12-08T21:27:20.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.689+0000 7f8bbe84b640 1 -- 172.21.15.53:0/1423633602 wait complete. 2023-12-08T21:27:20.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.693+0000 7f8bbe84b640 1 Processor -- start 2023-12-08T21:27:20.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.693+0000 7f8bbe84b640 1 -- start start 2023-12-08T21:27:20.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.693+0000 7f8bbe84b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bb806a810 0x7f8bb80c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:20.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.693+0000 7f8bbe84b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bb806abf0 0x7f8bb806d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:20.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.693+0000 7f8bbe84b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb815d870 0x7f8bb81f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:20.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.693+0000 7f8bbe84b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80c5d80 con 0x7f8bb806a810 2023-12-08T21:27:20.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.693+0000 7f8bbe84b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80c4130 con 0x7f8bb815d870 2023-12-08T21:27:20.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.693+0000 7f8bbe84b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80c51f0 con 0x7f8bb806abf0 2023-12-08T21:27:20.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.693+0000 7f8bbcde8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb815d870 0x7f8bb81f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.693+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bb806abf0 0x7f8bb806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.693+0000 7f8bbcde8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb815d870 0x7f8bb81f2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.53:50246/0 (socket says 172.21.15.53:50246) 2023-12-08T21:27:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.693+0000 7f8bbcde8640 1 -- 172.21.15.53:0/4184181182 learned_addr learned my addr 172.21.15.53:0/4184181182 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:20.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.705+0000 7f8bb77fe640 1 -- 172.21.15.53:0/4184181182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb815d870 msgr2=0x7f8bb81f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:20.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.705+0000 7f8bb77fe640 1 --2- 172.21.15.53:0/4184181182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb815d870 0x7f8bb81f2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:20.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.705+0000 7f8bb77fe640 1 -- 172.21.15.53:0/4184181182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bb806a810 msgr2=0x7f8bb80c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:20.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.705+0000 7f8bb77fe640 1 --2- 172.21.15.53:0/4184181182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bb806a810 0x7f8bb80c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:20.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.705+0000 7f8bb77fe640 1 -- 172.21.15.53:0/4184181182 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0009420 con 0x7f8bb806abf0 2023-12-08T21:27:20.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.713+0000 7f8bb77fe640 1 --2- 172.21.15.53:0/4184181182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bb806abf0 0x7f8bb806d900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bb806b010 tx=0x7f8ba000c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:20.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.721+0000 7f8bb4ff9640 1 -- 172.21.15.53:0/4184181182 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0003600 con 0x7f8bb806abf0 2023-12-08T21:27:20.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.721+0000 7f8bbe84b640 1 -- 172.21.15.53:0/4184181182 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb814a0b0 con 0x7f8bb806abf0 2023-12-08T21:27:20.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.721+0000 7f8bbe84b640 1 -- 172.21.15.53:0/4184181182 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb80c5490 con 0x7f8bb806abf0 2023-12-08T21:27:20.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.721+0000 7f8bbe84b640 1 -- 172.21.15.53:0/4184181182 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb80714e0 con 0x7f8bb806abf0 2023-12-08T21:27:20.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.733+0000 7f8bb4ff9640 1 -- 172.21.15.53:0/4184181182 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8ba0007030 con 0x7f8bb806abf0 2023-12-08T21:27:20.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:20.733+0000 7f8bb4ff9640 1 -- 172.21.15.53:0/4184181182 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0007440 con 0x7f8bb806abf0 2023-12-08T21:27:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.141+0000 7f8bb4ff9640 1 -- 172.21.15.53:0/4184181182 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ba00075a0 con 0x7f8bb806abf0 2023-12-08T21:27:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.145+0000 7f8bb4ff9640 1 --2- 172.21.15.53:0/4184181182 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8b98066470 0x7f8b98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.145+0000 7f8bb7fff640 1 --2- 172.21.15.53:0/4184181182 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8b98066470 0x7f8b98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.145+0000 7f8bb7fff640 1 --2- 172.21.15.53:0/4184181182 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8b98066470 0x7f8b98068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8002080 tx=0x7f8ba8001670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:21.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.153+0000 7f8bb4ff9640 1 -- 172.21.15.53:0/4184181182 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f8ba0054850 con 0x7f8bb806abf0 2023-12-08T21:27:21.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.181+0000 7f8bb4ff9640 1 -- 172.21.15.53:0/4184181182 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ba0050b90 con 0x7f8bb806abf0 2023-12-08T21:27:21.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.389+0000 7f8bbe84b640 1 -- 172.21.15.53:0/4184181182 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bb8074190 con 0x7f8bb806abf0 2023-12-08T21:27:21.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.405+0000 7f8bb4ff9640 1 -- 172.21.15.53:0/4184181182 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6501 (secure 0 0 0) 0x7f8ba0017090 con 0x7f8bb806abf0 2023-12-08T21:27:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:27:21.408 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6838/3541484412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3541484412},{"type":"v1","addr":"172.21.15.53:6838","nonce":3541484412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/2329639389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6837","nonce":2329639389},{"type":"v1","addr":"172.21.15.53:6839","nonce":2329639389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3938297948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3938297948},{"type":"v1","addr":"172.21.15.146:6833","nonce":3938297948}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2026540331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2026540331},{"type":"v1","addr":"172.21.15.146:6836","nonce":2026540331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/4236922545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4236922545},{"type":"v1","addr":"172.21.15.146:6837","nonce":4236922545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T20:54:56.254252+0000","modified":"2023-12-08T20:55:37.903706+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6835/3454931938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3454931938},{"type":"v1","addr":"172.21.15.53:6835","nonce":3454931938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T21:27:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 10 2023-12-08T21:27:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.409+0000 7f8bbe84b640 1 -- 172.21.15.53:0/4184181182 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8b98066470 msgr2=0x7f8b98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.409+0000 7f8bbe84b640 1 --2- 172.21.15.53:0/4184181182 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8b98066470 0x7f8b98068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8002080 tx=0x7f8ba8001670 comp rx=0 tx=0).stop 2023-12-08T21:27:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.409+0000 7f8bbe84b640 1 -- 172.21.15.53:0/4184181182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bb806abf0 msgr2=0x7f8bb806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.409+0000 7f8bbe84b640 1 --2- 172.21.15.53:0/4184181182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bb806abf0 0x7f8bb806d900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bb806b010 tx=0x7f8ba000c870 comp rx=0 tx=0).stop 2023-12-08T21:27:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.409+0000 7f8bbe84b640 1 -- 172.21.15.53:0/4184181182 shutdown_connections 2023-12-08T21:27:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.409+0000 7f8bbe84b640 1 --2- 172.21.15.53:0/4184181182 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f8b98066470 0x7f8b98068930 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.409+0000 7f8bbe84b640 1 --2- 172.21.15.53:0/4184181182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb815d870 0x7f8bb81f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.409+0000 7f8bbe84b640 1 --2- 172.21.15.53:0/4184181182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bb806abf0 0x7f8bb806d900 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.409+0000 7f8bbe84b640 1 --2- 172.21.15.53:0/4184181182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bb806a810 0x7f8bb80c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.409+0000 7f8bbe84b640 1 -- 172.21.15.53:0/4184181182 >> 172.21.15.53:0/4184181182 conn(0x7f8bb80c8990 msgr2=0x7f8bb80ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.409+0000 7f8bbe84b640 1 -- 172.21.15.53:0/4184181182 shutdown_connections 2023-12-08T21:27:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.409+0000 7f8bbe84b640 1 -- 172.21.15.53:0/4184181182 wait complete. 2023-12-08T21:27:21.430 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T21:27:21.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.549+0000 7efdaeb3b640 1 Processor -- start 2023-12-08T21:27:21.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.549+0000 7efdaeb3b640 1 -- start start 2023-12-08T21:27:21.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.549+0000 7efdaeb3b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efda80c1910 0x7efda815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:21.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.549+0000 7efdaeb3b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efda80c1cf0 0x7efda806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:21.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.549+0000 7efdaeb3b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda80c01a0 con 0x7efda80c6410 2023-12-08T21:27:21.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.549+0000 7efdaeb3b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda806f3a0 con 0x7efda80c1910 2023-12-08T21:27:21.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.549+0000 7efdaeb3b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda806ede0 con 0x7efda80c1cf0 2023-12-08T21:27:21.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.553+0000 7efdac8d7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efda80c1910 0x7efda815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:21.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.553+0000 7efdac8d7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efda80c1910 0x7efda815a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33720/0 (socket says 172.21.15.53:33720) 2023-12-08T21:27:21.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.553+0000 7efdac8d7640 1 -- 172.21.15.53:0/375702192 learned_addr learned my addr 172.21.15.53:0/375702192 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:21.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.553+0000 7efda7fff640 1 --2- 172.21.15.53:0/375702192 >> v2:172.21.15.146:3300/0 conn(0x7efda80c1cf0 0x7efda806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.553+0000 7efdac8d7640 1 -- 172.21.15.53:0/375702192 >> v2:172.21.15.146:3300/0 conn(0x7efda80c1cf0 msgr2=0x7efda806e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.553+0000 7efdac8d7640 1 --2- 172.21.15.53:0/375702192 >> v2:172.21.15.146:3300/0 conn(0x7efda80c1cf0 0x7efda806e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:21.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.553+0000 7efdac8d7640 1 -- 172.21.15.53:0/375702192 >> v1:172.21.15.146:6789/0 conn(0x7efda80c6410 legacy=0x7efda814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:21.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.553+0000 7efdac8d7640 1 -- 172.21.15.53:0/375702192 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda806f0c0 con 0x7efda80c1910 2023-12-08T21:27:21.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.553+0000 7efda7fff640 1 --2- 172.21.15.53:0/375702192 >> v2:172.21.15.146:3300/0 conn(0x7efda80c1cf0 0x7efda806e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T21:27:21.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.557+0000 7efdac8d7640 1 --2- 172.21.15.53:0/375702192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda80c1910 0x7efda815a440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efda806b490 tx=0x7efd9801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4223edd501180903 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:21.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efda77fe640 1 -- 172.21.15.53:0/375702192 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd980aa5f0 con 0x7efda80c1910 2023-12-08T21:27:21.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efda77fe640 1 -- 172.21.15.53:0/375702192 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efd980aa750 con 0x7efda80c1910 2023-12-08T21:27:21.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efda77fe640 1 -- 172.21.15.53:0/375702192 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd980aab00 con 0x7efda80c1910 2023-12-08T21:27:21.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 -- 172.21.15.53:0/375702192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda80c1910 msgr2=0x7efda815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:21.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 --2- 172.21.15.53:0/375702192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda80c1910 0x7efda815a440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efda806b490 tx=0x7efd9801c490 comp rx=0 tx=0).stop 2023-12-08T21:27:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 -- 172.21.15.53:0/375702192 shutdown_connections 2023-12-08T21:27:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 --2- 172.21.15.53:0/375702192 >> v2:172.21.15.146:3300/0 conn(0x7efda80c1cf0 0x7efda806e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 --2- 172.21.15.53:0/375702192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda80c1910 0x7efda815a440 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 -- 172.21.15.53:0/375702192 >> 172.21.15.53:0/375702192 conn(0x7efda80caef0 msgr2=0x7efda80cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 -- 172.21.15.53:0/375702192 shutdown_connections 2023-12-08T21:27:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 -- 172.21.15.53:0/375702192 wait complete. 2023-12-08T21:27:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 Processor -- start 2023-12-08T21:27:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 -- start start 2023-12-08T21:27:21.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda80c1910 0x7efda80c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:21.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80c1cf0 0x7efda814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:21.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda80c6410 0x7efda813d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:21.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda814aeb0 con 0x7efda80c6410 2023-12-08T21:27:21.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda814f4f0 con 0x7efda80c1910 2023-12-08T21:27:21.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.565+0000 7efdaeb3b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda80c7fd0 con 0x7efda80c1cf0 2023-12-08T21:27:21.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.569+0000 7efdad0d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda80c6410 0x7efda813d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:21.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.569+0000 7efdad0d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda80c6410 0x7efda813d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33722/0 (socket says 172.21.15.53:33722) 2023-12-08T21:27:21.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.569+0000 7efdad0d8640 1 -- 172.21.15.53:0/2795826796 learned_addr learned my addr 172.21.15.53:0/2795826796 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:21.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.569+0000 7efda7fff640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80c1cf0 0x7efda814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:21.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.569+0000 7efdac8d7640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda80c1910 0x7efda80c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:21.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.573+0000 7efdad0d8640 1 -- 172.21.15.53:0/2795826796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80c1cf0 msgr2=0x7efda814fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:21.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.573+0000 7efdad0d8640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80c1cf0 0x7efda814fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:21.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.573+0000 7efdad0d8640 1 -- 172.21.15.53:0/2795826796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda80c1910 msgr2=0x7efda80c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:21.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.573+0000 7efdad0d8640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda80c1910 0x7efda80c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:21.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.573+0000 7efdad0d8640 1 -- 172.21.15.53:0/2795826796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd980094d0 con 0x7efda80c6410 2023-12-08T21:27:21.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.573+0000 7efdad0d8640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda80c6410 0x7efda813d880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efda000c780 tx=0x7efda000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:21.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.577+0000 7efda57fa640 1 -- 172.21.15.53:0/2795826796 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0003d90 con 0x7efda80c6410 2023-12-08T21:27:21.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.577+0000 7efda57fa640 1 -- 172.21.15.53:0/2795826796 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efda000ce90 con 0x7efda80c6410 2023-12-08T21:27:21.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.577+0000 7efdaeb3b640 1 -- 172.21.15.53:0/2795826796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda80c82b0 con 0x7efda80c6410 2023-12-08T21:27:21.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.577+0000 7efda57fa640 1 -- 172.21.15.53:0/2795826796 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00052d0 con 0x7efda80c6410 2023-12-08T21:27:21.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.577+0000 7efdaeb3b640 1 -- 172.21.15.53:0/2795826796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda814a860 con 0x7efda80c6410 2023-12-08T21:27:21.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.581+0000 7efdaeb3b640 1 -- 172.21.15.53:0/2795826796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda814b060 con 0x7efda80c6410 2023-12-08T21:27:21.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.605+0000 7efda57fa640 1 -- 172.21.15.53:0/2795826796 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efda0005430 con 0x7efda80c6410 2023-12-08T21:27:21.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.605+0000 7efda57fa640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efd880664c0 0x7efd88068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:21.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.609+0000 7efdac8d7640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efd880664c0 0x7efd88068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:21.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.609+0000 7efdac8d7640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efd880664c0 0x7efd88068980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd980ae000 tx=0x7efd980b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.897+0000 7efda57fa640 1 -- 172.21.15.53:0/2795826796 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7efda0054b10 con 0x7efda80c6410 2023-12-08T21:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:21.897+0000 7efda57fa640 1 -- 172.21.15.53:0/2795826796 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efda0050e50 con 0x7efda80c6410 2023-12-08T21:27:22.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.093+0000 7efdaeb3b640 1 -- 172.21.15.53:0/2795826796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efda80675b0 con 0x7efda80c6410 2023-12-08T21:27:22.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efda57fa640 1 -- 172.21.15.53:0/2795826796 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6501 (secure 0 0 0) 0x7efda0017020 con 0x7efda80c6410 2023-12-08T21:27:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:27:22.126 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6838/3541484412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3541484412},{"type":"v1","addr":"172.21.15.53:6838","nonce":3541484412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/2329639389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6837","nonce":2329639389},{"type":"v1","addr":"172.21.15.53:6839","nonce":2329639389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3938297948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3938297948},{"type":"v1","addr":"172.21.15.146:6833","nonce":3938297948}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2026540331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2026540331},{"type":"v1","addr":"172.21.15.146:6836","nonce":2026540331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/4236922545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4236922545},{"type":"v1","addr":"172.21.15.146:6837","nonce":4236922545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T20:54:56.254252+0000","modified":"2023-12-08T20:55:37.903706+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6835/3454931938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3454931938},{"type":"v1","addr":"172.21.15.53:6835","nonce":3454931938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T21:27:22.126 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 10 2023-12-08T21:27:22.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efdaeb3b640 1 -- 172.21.15.53:0/2795826796 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efd880664c0 msgr2=0x7efd88068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:22.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efdaeb3b640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efd880664c0 0x7efd88068980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd980ae000 tx=0x7efd980b5040 comp rx=0 tx=0).stop 2023-12-08T21:27:22.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efdaeb3b640 1 -- 172.21.15.53:0/2795826796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda80c6410 msgr2=0x7efda813d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:22.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efdaeb3b640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda80c6410 0x7efda813d880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efda000c780 tx=0x7efda000cc40 comp rx=0 tx=0).stop 2023-12-08T21:27:22.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efdaeb3b640 1 -- 172.21.15.53:0/2795826796 shutdown_connections 2023-12-08T21:27:22.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efdaeb3b640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7efd880664c0 0x7efd88068980 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:22.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efdaeb3b640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda80c6410 0x7efda813d880 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:22.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efdaeb3b640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80c1cf0 0x7efda814fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:22.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efdaeb3b640 1 --2- 172.21.15.53:0/2795826796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda80c1910 0x7efda80c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:22.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efdaeb3b640 1 -- 172.21.15.53:0/2795826796 >> 172.21.15.53:0/2795826796 conn(0x7efda80caef0 msgr2=0x7efda814c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:22.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efdaeb3b640 1 -- 172.21.15.53:0/2795826796 shutdown_connections 2023-12-08T21:27:22.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.125+0000 7efdaeb3b640 1 -- 172.21.15.53:0/2795826796 wait complete. 2023-12-08T21:27:22.146 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T21:27:22.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.265+0000 7fc64801a640 1 Processor -- start 2023-12-08T21:27:22.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.265+0000 7fc64801a640 1 -- start start 2023-12-08T21:27:22.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.265+0000 7fc64801a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6400c1110 0x7fc6400c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:22.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.265+0000 7fc64801a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400b1c80 0x7fc640150130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:22.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.265+0000 7fc64801a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64015a350 con 0x7fc6400c94b0 2023-12-08T21:27:22.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.265+0000 7fc64801a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64015a860 con 0x7fc6400c1110 2023-12-08T21:27:22.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.265+0000 7fc64801a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400c2330 con 0x7fc6400b1c80 2023-12-08T21:27:22.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.269+0000 7fc6455b5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400b1c80 0x7fc640150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:22.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.269+0000 7fc645db6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6400c1110 0x7fc6400c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:22.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.269+0000 7fc6455b5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400b1c80 0x7fc640150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:55222/0 (socket says 172.21.15.53:55222) 2023-12-08T21:27:22.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.269+0000 7fc6455b5640 1 -- 172.21.15.53:0/2674359829 learned_addr learned my addr 172.21.15.53:0/2674359829 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:22.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.273+0000 7fc6455b5640 1 -- 172.21.15.53:0/2674359829 >> v2:172.21.15.146:3300/0 conn(0x7fc6400c1110 msgr2=0x7fc6400c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:22.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.273+0000 7fc6455b5640 1 --2- 172.21.15.53:0/2674359829 >> v2:172.21.15.146:3300/0 conn(0x7fc6400c1110 0x7fc6400c14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:22.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.273+0000 7fc6455b5640 1 -- 172.21.15.53:0/2674359829 >> v1:172.21.15.53:6789/0 conn(0x7fc6400c94b0 legacy=0x7fc64006e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:22.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.273+0000 7fc6455b5640 1 -- 172.21.15.53:0/2674359829 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64015a580 con 0x7fc6400b1c80 2023-12-08T21:27:22.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.281+0000 7fc6455b5640 1 --2- 172.21.15.53:0/2674359829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400b1c80 0x7fc640150130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc630009870 tx=0x7fc63001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be5ddaa90e08c1f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:22.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.289+0000 7fc644db4640 1 -- 172.21.15.53:0/2674359829 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6300aa5f0 con 0x7fc6400b1c80 2023-12-08T21:27:22.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.289+0000 7fc644db4640 1 -- 172.21.15.53:0/2674359829 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc6300aa750 con 0x7fc6400b1c80 2023-12-08T21:27:22.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.289+0000 7fc644db4640 1 -- 172.21.15.53:0/2674359829 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6300aab00 con 0x7fc6400b1c80 2023-12-08T21:27:22.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.293+0000 7fc64801a640 1 -- 172.21.15.53:0/2674359829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400b1c80 msgr2=0x7fc640150130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:22.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.293+0000 7fc64801a640 1 --2- 172.21.15.53:0/2674359829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400b1c80 0x7fc640150130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc630009870 tx=0x7fc63001c4d0 comp rx=0 tx=0).stop 2023-12-08T21:27:22.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.293+0000 7fc64801a640 1 -- 172.21.15.53:0/2674359829 shutdown_connections 2023-12-08T21:27:22.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.293+0000 7fc64801a640 1 --2- 172.21.15.53:0/2674359829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400b1c80 0x7fc640150130 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:22.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.293+0000 7fc64801a640 1 --2- 172.21.15.53:0/2674359829 >> v2:172.21.15.146:3300/0 conn(0x7fc6400c1110 0x7fc6400c14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:22.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.293+0000 7fc64801a640 1 -- 172.21.15.53:0/2674359829 >> 172.21.15.53:0/2674359829 conn(0x7fc6400c8990 msgr2=0x7fc6400c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:22.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.293+0000 7fc64801a640 1 -- 172.21.15.53:0/2674359829 shutdown_connections 2023-12-08T21:27:22.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.293+0000 7fc64801a640 1 -- 172.21.15.53:0/2674359829 wait complete. 2023-12-08T21:27:22.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.293+0000 7fc64801a640 1 Processor -- start 2023-12-08T21:27:22.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.293+0000 7fc64801a640 1 -- start start 2023-12-08T21:27:22.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.297+0000 7fc64801a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6400b1c80 0x7fc640143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:22.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.297+0000 7fc64801a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6400c1110 0x7fc6400c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:22.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.297+0000 7fc64801a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400c94b0 0x7fc6401f0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:22.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.297+0000 7fc64801a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6401f3b80 con 0x7fc6400c1110 2023-12-08T21:27:22.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.297+0000 7fc64801a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6401498f0 con 0x7fc6400b1c80 2023-12-08T21:27:22.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.297+0000 7fc64801a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6401546b0 con 0x7fc6400c94b0 2023-12-08T21:27:22.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.297+0000 7fc6465b7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400c94b0 0x7fc6401f0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:22.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.297+0000 7fc645db6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6400b1c80 0x7fc640143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:22.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.297+0000 7fc6465b7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400c94b0 0x7fc6401f0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:55224/0 (socket says 172.21.15.53:55224) 2023-12-08T21:27:22.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.297+0000 7fc6465b7640 1 -- 172.21.15.53:0/1457120178 learned_addr learned my addr 172.21.15.53:0/1457120178 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:22.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.305+0000 7fc645db6640 1 -- 172.21.15.53:0/1457120178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400c94b0 msgr2=0x7fc6401f0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:22.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.305+0000 7fc645db6640 1 --2- 172.21.15.53:0/1457120178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400c94b0 0x7fc6401f0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:22.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.305+0000 7fc645db6640 1 -- 172.21.15.53:0/1457120178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6400c1110 msgr2=0x7fc6400c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:22.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.305+0000 7fc645db6640 1 --2- 172.21.15.53:0/1457120178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6400c1110 0x7fc6400c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:22.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.305+0000 7fc645db6640 1 -- 172.21.15.53:0/1457120178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300094d0 con 0x7fc6400b1c80 2023-12-08T21:27:22.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.313+0000 7fc645db6640 1 --2- 172.21.15.53:0/1457120178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6400b1c80 0x7fc640143bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00e870 tx=0x7fc63c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:22.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.325+0000 7fc6367fc640 1 -- 172.21.15.53:0/1457120178 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c0095d0 con 0x7fc6400b1c80 2023-12-08T21:27:22.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.325+0000 7fc6367fc640 1 -- 172.21.15.53:0/1457120178 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc63c00c940 con 0x7fc6400b1c80 2023-12-08T21:27:22.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.325+0000 7fc64801a640 1 -- 172.21.15.53:0/1457120178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6401f38a0 con 0x7fc6400b1c80 2023-12-08T21:27:22.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.325+0000 7fc6367fc640 1 -- 172.21.15.53:0/1457120178 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00ccd0 con 0x7fc6400b1c80 2023-12-08T21:27:22.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.325+0000 7fc64801a640 1 -- 172.21.15.53:0/1457120178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc640159af0 con 0x7fc6400b1c80 2023-12-08T21:27:22.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.325+0000 7fc64801a640 1 -- 172.21.15.53:0/1457120178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc640074190 con 0x7fc6400b1c80 2023-12-08T21:27:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.657+0000 7fc6367fc640 1 -- 172.21.15.53:0/1457120178 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc63c013470 con 0x7fc6400b1c80 2023-12-08T21:27:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.657+0000 7fc6367fc640 1 --2- 172.21.15.53:0/1457120178 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc6240664c0 0x7fc624068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.657+0000 7fc6455b5640 1 --2- 172.21.15.53:0/1457120178 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc6240664c0 0x7fc624068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:22.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.661+0000 7fc6455b5640 1 --2- 172.21.15.53:0/1457120178 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc6240664c0 0x7fc624068980 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc6300ae000 tx=0x7fc630008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.669+0000 7fc6367fc640 1 -- 172.21.15.53:0/1457120178 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fc63c00ce30 con 0x7fc6400b1c80 2023-12-08T21:27:22.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.805+0000 7fc6367fc640 1 -- 172.21.15.53:0/1457120178 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc63c051ce0 con 0x7fc6400b1c80 2023-12-08T21:27:22.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:22.969+0000 7fc64801a640 1 -- 172.21.15.53:0/1457120178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6401501e0 con 0x7fc6400b1c80 2023-12-08T21:27:23.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.097+0000 7fc6367fc640 1 -- 172.21.15.53:0/1457120178 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18446 (secure 0 0 0) 0x7fc63c021020 con 0x7fc6400b1c80 2023-12-08T21:27:23.097 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-08T21:27:23.098 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"fsid":"b118091f-f50b-41fe-890c-fae34a9e8e21","created":"2023-12-08T20:53:48.994328+0000","modified":"2023-12-08T20:55:59.702174+0000","last_up_change":"2023-12-08T20:54:12.556607+0000","last_in_change":"2023-12-08T20:54:02.238448+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:54:13.707275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T20:54:52.929484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T20:54:54.529440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T20:55:01.908380+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c998f36b-7c21-4e9d-b670-855b2acda0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6813","nonce":1090159332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6815","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6817","nonce":1090159332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6824","nonce":1090159332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1090159332},{"type":"v1","addr":"172.21.15.53:6820","nonce":1090159332}]},"public_addr":"172.21.15.53:6813/1090159332","cluster_addr":"172.21.15.53:6817/1090159332","heartbeat_back_addr":"172.21.15.53:6824/1090159332","heartbeat_front_addr":"172.21.15.53:6820/1090159332","state":["exists","up"]},{"osd":1,"uuid":"8d77a649-afd9-4a9c-b26d-e8441f648abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6827","nonce":3198496294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6829","nonce":3198496294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6833","nonce":3198496294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3198496294},{"type":"v1","addr":"172.21.15.53:6831","nonce":3198496294}]},"public_addr":"172.21.15.53:6827/3198496294","cluster_addr":"172.21.15.53:6829/3198496294","heartbeat_back_addr":"172.21.15.53:6833/3198496294","heartbeat_front_addr":"172.21.15.53:6831/3198496294","state":["exists","up"]},{"osd":2,"uuid":"a26009bb-533d-40af-a8f6-9b4ae30cb26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6803","nonce":2948930321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6805","nonce":2948930321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6809","nonce":2948930321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2948930321},{"type":"v1","addr":"172.21.15.53:6807","nonce":2948930321}]},"public_addr":"172.21.15.53:6803/2948930321","cluster_addr":"172.21.15.53:6805/2948930321","heartbeat_back_addr":"172.21.15.53:6809/2948930321","heartbeat_front_addr":"172.21.15.53:6807/2948930321","state":["exists","up"]},{"osd":3,"uuid":"45890f53-e85e-4a31-984e-408d82667826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6812","nonce":3377657133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6816","nonce":3377657133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6823","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6825","nonce":3377657133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6819","nonce":3377657133},{"type":"v1","addr":"172.21.15.53:6821","nonce":3377657133}]},"public_addr":"172.21.15.53:6812/3377657133","cluster_addr":"172.21.15.53:6816/3377657133","heartbeat_back_addr":"172.21.15.53:6825/3377657133","heartbeat_front_addr":"172.21.15.53:6821/3377657133","state":["exists","up"]},{"osd":4,"uuid":"71f66519-d49b-4f54-a914-0412fe375ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6801","nonce":2537824411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6803","nonce":2537824411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6807","nonce":2537824411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2537824411},{"type":"v1","addr":"172.21.15.146:6805","nonce":2537824411}]},"public_addr":"172.21.15.146:6801/2537824411","cluster_addr":"172.21.15.146:6803/2537824411","heartbeat_back_addr":"172.21.15.146:6807/2537824411","heartbeat_front_addr":"172.21.15.146:6805/2537824411","state":["exists","up"]},{"osd":5,"uuid":"166e6999-df74-407d-89ec-51c8ba8b7755","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6809","nonce":2662713833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6811","nonce":2662713833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6815","nonce":2662713833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2662713833},{"type":"v1","addr":"172.21.15.146:6813","nonce":2662713833}]},"public_addr":"172.21.15.146:6809/2662713833","cluster_addr":"172.21.15.146:6811/2662713833","heartbeat_back_addr":"172.21.15.146:6815/2662713833","heartbeat_front_addr":"172.21.15.146:6813/2662713833","state":["exists","up"]},{"osd":6,"uuid":"fc441dde-e4a9-4d73-8cf9-a06d73919aba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6825","nonce":3215046611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6827","nonce":3215046611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6831","nonce":3215046611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3215046611},{"type":"v1","addr":"172.21.15.146:6829","nonce":3215046611}]},"public_addr":"172.21.15.146:6825/3215046611","cluster_addr":"172.21.15.146:6827/3215046611","heartbeat_back_addr":"172.21.15.146:6831/3215046611","heartbeat_front_addr":"172.21.15.146:6829/3215046611","state":["exists","up"]},{"osd":7,"uuid":"0a2f1734-646e-45d8-8753-73d3a712b68c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6817","nonce":924786666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6819","nonce":924786666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6823","nonce":924786666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":924786666},{"type":"v1","addr":"172.21.15.146:6821","nonce":924786666}]},"public_addr":"172.21.15.146:6817/924786666","cluster_addr":"172.21.15.146:6819/924786666","heartbeat_back_addr":"172.21.15.146:6823/924786666","heartbeat_front_addr":"172.21.15.146:6821/924786666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.057788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.060137+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980274+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.968375+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.980068+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.116133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:07.581218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:54:08.005885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.10","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T21:27:23.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.101+0000 7fc64801a640 1 -- 172.21.15.53:0/1457120178 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc6240664c0 msgr2=0x7fc624068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.101+0000 7fc64801a640 1 --2- 172.21.15.53:0/1457120178 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc6240664c0 0x7fc624068980 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc6300ae000 tx=0x7fc630008040 comp rx=0 tx=0).stop 2023-12-08T21:27:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.101+0000 7fc64801a640 1 -- 172.21.15.53:0/1457120178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6400b1c80 msgr2=0x7fc640143bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.101+0000 7fc64801a640 1 --2- 172.21.15.53:0/1457120178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6400b1c80 0x7fc640143bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00e870 tx=0x7fc63c00ed30 comp rx=0 tx=0).stop 2023-12-08T21:27:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.101+0000 7fc64801a640 1 -- 172.21.15.53:0/1457120178 shutdown_connections 2023-12-08T21:27:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.101+0000 7fc64801a640 1 --2- 172.21.15.53:0/1457120178 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fc6240664c0 0x7fc624068980 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.101+0000 7fc64801a640 1 --2- 172.21.15.53:0/1457120178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6400c94b0 0x7fc6401f0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.101+0000 7fc64801a640 1 --2- 172.21.15.53:0/1457120178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6400c1110 0x7fc6400c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.101+0000 7fc64801a640 1 --2- 172.21.15.53:0/1457120178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6400b1c80 0x7fc640143bf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.101+0000 7fc64801a640 1 -- 172.21.15.53:0/1457120178 >> 172.21.15.53:0/1457120178 conn(0x7fc6400c8990 msgr2=0x7fc640070230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.101+0000 7fc64801a640 1 -- 172.21.15.53:0/1457120178 shutdown_connections 2023-12-08T21:27:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.101+0000 7fc64801a640 1 -- 172.21.15.53:0/1457120178 wait complete. 2023-12-08T21:27:23.127 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-08T21:27:23.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.257+0000 7f610a13d640 1 Processor -- start 2023-12-08T21:27:23.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.257+0000 7f610a13d640 1 -- start start 2023-12-08T21:27:23.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.257+0000 7f610a13d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f61040c52a0 0x7f610406b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.257+0000 7f610a13d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610415b510 con 0x7f6104157ef0 2023-12-08T21:27:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.257+0000 7f610a13d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610415b7f0 con 0x7f61040c4ec0 2023-12-08T21:27:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.257+0000 7f610a13d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61040c77c0 con 0x7f61040c52a0 2023-12-08T21:27:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.257+0000 7f6102ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f61040c52a0 0x7f610406b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:23.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.257+0000 7f6103fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6104157ef0 0x7f61041510d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39842/0 (socket says 172.21.15.53:39842) 2023-12-08T21:27:23.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.257+0000 7f6103fff640 1 -- 172.21.15.53:0/4247685271 learned_addr learned my addr 172.21.15.53:0/4247685271 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:27:23.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.261+0000 7f6102ffd640 1 -- 172.21.15.53:0/4247685271 >> v1:172.21.15.146:6789/0 conn(0x7f61040c4ec0 legacy=0x7f61041577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:23.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.261+0000 7f6102ffd640 1 -- 172.21.15.53:0/4247685271 >> v1:172.21.15.53:6789/0 conn(0x7f6104157ef0 legacy=0x7f61041510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:23.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.261+0000 7f6102ffd640 1 -- 172.21.15.53:0/4247685271 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610406f840 con 0x7f61040c52a0 2023-12-08T21:27:23.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.269+0000 7f6102ffd640 1 --2- 172.21.15.53:0/4247685271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61040c52a0 0x7f610406b6b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0097c0 tx=0x7f60ec01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07c45d27baa5d1a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:23.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.273+0000 7f61027fc640 1 -- 172.21.15.53:0/4247685271 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0a8970 con 0x7f61040c52a0 2023-12-08T21:27:23.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.273+0000 7f61027fc640 1 -- 172.21.15.53:0/4247685271 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f60ec0a8ad0 con 0x7f61040c52a0 2023-12-08T21:27:23.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.273+0000 7f61027fc640 1 -- 172.21.15.53:0/4247685271 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0a8e80 con 0x7f61040c52a0 2023-12-08T21:27:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.273+0000 7f610a13d640 1 -- 172.21.15.53:0/4247685271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61040c52a0 msgr2=0x7f610406b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.273+0000 7f610a13d640 1 --2- 172.21.15.53:0/4247685271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61040c52a0 0x7f610406b6b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0097c0 tx=0x7f60ec01ec70 comp rx=0 tx=0).stop 2023-12-08T21:27:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.273+0000 7f610a13d640 1 -- 172.21.15.53:0/4247685271 shutdown_connections 2023-12-08T21:27:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.273+0000 7f610a13d640 1 --2- 172.21.15.53:0/4247685271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61040c52a0 0x7f610406b6b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.273+0000 7f610a13d640 1 -- 172.21.15.53:0/4247685271 >> 172.21.15.53:0/4247685271 conn(0x7f61040cbb50 msgr2=0x7f610406f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.273+0000 7f610a13d640 1 -- 172.21.15.53:0/4247685271 shutdown_connections 2023-12-08T21:27:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.273+0000 7f610a13d640 1 -- 172.21.15.53:0/4247685271 wait complete. 2023-12-08T21:27:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.277+0000 7f610a13d640 1 Processor -- start 2023-12-08T21:27:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.277+0000 7f610a13d640 1 -- start start 2023-12-08T21:27:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.277+0000 7f610a13d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61040c4ec0 0x7f6104159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.277+0000 7f610a13d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61040c52a0 0x7f61041ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.277+0000 7f610a13d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6104157ef0 0x7f61041ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.277+0000 7f610a13d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61041ecd50 con 0x7f61040c52a0 2023-12-08T21:27:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.277+0000 7f610a13d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610414e590 con 0x7f6104157ef0 2023-12-08T21:27:23.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.277+0000 7f610a13d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6104152510 con 0x7f61040c4ec0 2023-12-08T21:27:23.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.277+0000 7f6102ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61040c52a0 0x7f61041ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:23.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.277+0000 7f6102ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61040c52a0 0x7f61041ed1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33748/0 (socket says 172.21.15.53:33748) 2023-12-08T21:27:23.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.277+0000 7f6102ffd640 1 -- 172.21.15.53:0/3719891472 learned_addr learned my addr 172.21.15.53:0/3719891472 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:23.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.277+0000 7f61037fe640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61040c4ec0 0x7f6104159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:23.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.281+0000 7f6103fff640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6104157ef0 0x7f61041ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.281+0000 7f6102ffd640 1 -- 172.21.15.53:0/3719891472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61040c4ec0 msgr2=0x7f6104159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.281+0000 7f6102ffd640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61040c4ec0 0x7f6104159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.281+0000 7f6102ffd640 1 -- 172.21.15.53:0/3719891472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6104157ef0 msgr2=0x7f61041ed6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.281+0000 7f6102ffd640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6104157ef0 0x7f61041ed6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.281+0000 7f6102ffd640 1 -- 172.21.15.53:0/3719891472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec009420 con 0x7f61040c52a0 2023-12-08T21:27:23.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.285+0000 7f6102ffd640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61040c52a0 0x7f61041ed1a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f60ec01b880 tx=0x7f60ec01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:23.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.289+0000 7f60fbfff640 1 -- 172.21.15.53:0/3719891472 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0b9610 con 0x7f61040c52a0 2023-12-08T21:27:23.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.289+0000 7f60fbfff640 1 -- 172.21.15.53:0/3719891472 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f60ec0b97b0 con 0x7f61040c52a0 2023-12-08T21:27:23.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.289+0000 7f60fbfff640 1 -- 172.21.15.53:0/3719891472 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0b9b80 con 0x7f61040c52a0 2023-12-08T21:27:23.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.289+0000 7f610a13d640 1 -- 172.21.15.53:0/3719891472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61041527f0 con 0x7f61040c52a0 2023-12-08T21:27:23.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.289+0000 7f610a13d640 1 -- 172.21.15.53:0/3719891472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6104152db0 con 0x7f61040c52a0 2023-12-08T21:27:23.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.293+0000 7f610a13d640 1 -- 172.21.15.53:0/3719891472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6104074190 con 0x7f61040c52a0 2023-12-08T21:27:23.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.313+0000 7f60fbfff640 1 -- 172.21.15.53:0/3719891472 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f60ec0b7040 con 0x7f61040c52a0 2023-12-08T21:27:23.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.313+0000 7f60fbfff640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f60e80664c0 0x7f60e8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:23.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.313+0000 7f61037fe640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f60e80664c0 0x7f60e8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:23.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.313+0000 7f61037fe640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f60e80664c0 0x7f60e8068980 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f60f4001ea0 tx=0x7f60f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:23.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.317+0000 7f60fbfff640 1 -- 172.21.15.53:0/3719891472 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f60ec0b1e40 con 0x7f61040c52a0 2023-12-08T21:27:23.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.665+0000 7f60fbfff640 1 -- 172.21.15.53:0/3719891472 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60ec0efef0 con 0x7f61040c52a0 2023-12-08T21:27:23.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:23.873+0000 7f610a13d640 1 -- 172.21.15.53:0/3719891472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6104157c50 con 0x7f61040c52a0 2023-12-08T21:27:24.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f60fbfff640 1 -- 172.21.15.53:0/3719891472 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7f60ec0b5030 con 0x7f61040c52a0 2023-12-08T21:27:24.457 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T21:27:24.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f610a13d640 1 -- 172.21.15.53:0/3719891472 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f60e80664c0 msgr2=0x7f60e8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:24.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f610a13d640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f60e80664c0 0x7f60e8068980 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f60f4001ea0 tx=0x7f60f4009040 comp rx=0 tx=0).stop 2023-12-08T21:27:24.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f610a13d640 1 -- 172.21.15.53:0/3719891472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61040c52a0 msgr2=0x7f61041ed1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:24.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f610a13d640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61040c52a0 0x7f61041ed1a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f60ec01b880 tx=0x7f60ec01ba10 comp rx=0 tx=0).stop 2023-12-08T21:27:24.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f610a13d640 1 -- 172.21.15.53:0/3719891472 shutdown_connections 2023-12-08T21:27:24.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f610a13d640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f60e80664c0 0x7f60e8068980 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:24.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f610a13d640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6104157ef0 0x7f61041ed6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:24.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f610a13d640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61040c52a0 0x7f61041ed1a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:24.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f610a13d640 1 --2- 172.21.15.53:0/3719891472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61040c4ec0 0x7f6104159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:24.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f610a13d640 1 -- 172.21.15.53:0/3719891472 >> 172.21.15.53:0/3719891472 conn(0x7f61040cbb50 msgr2=0x7f61040c9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:24.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f610a13d640 1 -- 172.21.15.53:0/3719891472 shutdown_connections 2023-12-08T21:27:24.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.457+0000 7f610a13d640 1 -- 172.21.15.53:0/3719891472 wait complete. 2023-12-08T21:27:24.485 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-08T21:27:24.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.625+0000 7f4bf9fcd640 1 Processor -- start 2023-12-08T21:27:24.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.625+0000 7f4bf9fcd640 1 -- start start 2023-12-08T21:27:24.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.625+0000 7f4bf9fcd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf415d640 0x7f4bf4164f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:24.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.625+0000 7f4bf9fcd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf40c7590 con 0x7f4bf406afc0 2023-12-08T21:27:24.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.625+0000 7f4bf9fcd640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf415a560 con 0x7f4bf41538b0 2023-12-08T21:27:24.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.625+0000 7f4bf9fcd640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4159720 con 0x7f4bf415d640 2023-12-08T21:27:24.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.625+0000 7f4bebfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4bf406afc0 0x7f4bf415cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39854/0 (socket says 172.21.15.53:39854) 2023-12-08T21:27:24.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.625+0000 7f4bebfff640 1 -- 172.21.15.53:0/1523369485 learned_addr learned my addr 172.21.15.53:0/1523369485 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:27:24.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.625+0000 7f4bf3fff640 1 --2- 172.21.15.53:0/1523369485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf415d640 0x7f4bf4164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:24.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.629+0000 7f4bf2ffd640 1 -- 172.21.15.53:0/1523369485 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154871939 0 0) 0x7f4bf40c7590 con 0x7f4bf406afc0 2023-12-08T21:27:24.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.629+0000 7f4bf2ffd640 1 -- 172.21.15.53:0/1523369485 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be0003530 con 0x7f4bf406afc0 2023-12-08T21:27:24.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.633+0000 7f4bf3fff640 1 -- 172.21.15.53:0/1523369485 >> v1:172.21.15.146:6789/0 conn(0x7f4bf41538b0 legacy=0x7f4bf40c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:24.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.633+0000 7f4bf3fff640 1 -- 172.21.15.53:0/1523369485 >> v1:172.21.15.53:6789/0 conn(0x7f4bf406afc0 legacy=0x7f4bf415cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:24.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.633+0000 7f4bf3fff640 1 -- 172.21.15.53:0/1523369485 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf41599e0 con 0x7f4bf415d640 2023-12-08T21:27:24.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.637+0000 7f4bf3fff640 1 --2- 172.21.15.53:0/1523369485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf415d640 0x7f4bf4164f60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009dc0 tx=0x7f4bec01c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c792c5e84bb64a43 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:24.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.645+0000 7f4bf2ffd640 1 -- 172.21.15.53:0/1523369485 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0a58e0 con 0x7f4bf415d640 2023-12-08T21:27:24.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.645+0000 7f4bf2ffd640 1 -- 172.21.15.53:0/1523369485 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4bec0a5a40 con 0x7f4bf415d640 2023-12-08T21:27:24.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.645+0000 7f4bf2ffd640 1 -- 172.21.15.53:0/1523369485 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0a5df0 con 0x7f4bf415d640 2023-12-08T21:27:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.645+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/1523369485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf415d640 msgr2=0x7f4bf4164f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.645+0000 7f4bf9fcd640 1 --2- 172.21.15.53:0/1523369485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf415d640 0x7f4bf4164f60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009dc0 tx=0x7f4bec01c930 comp rx=0 tx=0).stop 2023-12-08T21:27:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.645+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/1523369485 shutdown_connections 2023-12-08T21:27:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.645+0000 7f4bf9fcd640 1 --2- 172.21.15.53:0/1523369485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf415d640 0x7f4bf4164f60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.645+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/1523369485 >> 172.21.15.53:0/1523369485 conn(0x7f4bf40cbfe0 msgr2=0x7f4bf40cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.645+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/1523369485 shutdown_connections 2023-12-08T21:27:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.645+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/1523369485 wait complete. 2023-12-08T21:27:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.649+0000 7f4bf9fcd640 1 Processor -- start 2023-12-08T21:27:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.649+0000 7f4bf9fcd640 1 -- start start 2023-12-08T21:27:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.649+0000 7f4bf9fcd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf406afc0 0x7f4bf4142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.649+0000 7f4bf9fcd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf41538b0 0x7f4bf40ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.649+0000 7f4bf9fcd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bf415d640 0x7f4bf40ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.649+0000 7f4bf9fcd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf40c6450 con 0x7f4bf406afc0 2023-12-08T21:27:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.649+0000 7f4bf9fcd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4143240 con 0x7f4bf415d640 2023-12-08T21:27:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.649+0000 7f4bf9fcd640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4142870 con 0x7f4bf41538b0 2023-12-08T21:27:24.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.649+0000 7f4bebfff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf41538b0 0x7f4bf40ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:24.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.649+0000 7f4bebfff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf41538b0 0x7f4bf40ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.53:55252/0 (socket says 172.21.15.53:55252) 2023-12-08T21:27:24.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.649+0000 7f4bebfff640 1 -- 172.21.15.53:0/4026330 learned_addr learned my addr 172.21.15.53:0/4026330 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:24.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.657+0000 7f4bebfff640 1 -- 172.21.15.53:0/4026330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bf415d640 msgr2=0x7f4bf40ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:24.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.657+0000 7f4bebfff640 1 --2- 172.21.15.53:0/4026330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bf415d640 0x7f4bf40ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:24.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.657+0000 7f4bebfff640 1 -- 172.21.15.53:0/4026330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf406afc0 msgr2=0x7f4bf4142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:24.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.657+0000 7f4bebfff640 1 --2- 172.21.15.53:0/4026330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf406afc0 0x7f4bf4142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:24.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.657+0000 7f4bebfff640 1 -- 172.21.15.53:0/4026330 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec009a70 con 0x7f4bf41538b0 2023-12-08T21:27:24.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.661+0000 7f4bebfff640 1 --2- 172.21.15.53:0/4026330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf41538b0 0x7f4bf40ca330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00c4d0 tx=0x7f4bdc00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.669+0000 7f4bf0ff9640 1 -- 172.21.15.53:0/4026330 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc005cf0 con 0x7f4bf41538b0 2023-12-08T21:27:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.669+0000 7f4bf0ff9640 1 -- 172.21.15.53:0/4026330 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4bdc005e50 con 0x7f4bf41538b0 2023-12-08T21:27:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.669+0000 7f4bf0ff9640 1 -- 172.21.15.53:0/4026330 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc007270 con 0x7f4bf41538b0 2023-12-08T21:27:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.669+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/4026330 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf4152630 con 0x7f4bf41538b0 2023-12-08T21:27:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.669+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/4026330 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf4142220 con 0x7f4bf41538b0 2023-12-08T21:27:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:24.673+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/4026330 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf4074190 con 0x7f4bf41538b0 2023-12-08T21:27:25.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:25.005+0000 7f4bf0ff9640 1 -- 172.21.15.53:0/4026330 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4bdc0073d0 con 0x7f4bf41538b0 2023-12-08T21:27:25.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:25.005+0000 7f4bf0ff9640 1 --2- 172.21.15.53:0/4026330 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4bd40664f0 0x7f4bd40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:25.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:25.009+0000 7f4bf37fe640 1 --2- 172.21.15.53:0/4026330 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4bd40664f0 0x7f4bd40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:25.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:25.009+0000 7f4bf37fe640 1 --2- 172.21.15.53:0/4026330 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4bd40664f0 0x7f4bd40689b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4be4007fd0 tx=0x7f4be40079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:25.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:25.009+0000 7f4bf0ff9640 1 -- 172.21.15.53:0/4026330 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6604+0+0 (secure 0 0 0) 0x7f4bdc01de70 con 0x7f4bf41538b0 2023-12-08T21:27:25.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:25.021+0000 7f4bf0ff9640 1 -- 172.21.15.53:0/4026330 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4bdc050dc0 con 0x7f4bf41538b0 2023-12-08T21:27:25.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:25.297+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/4026330 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4bf406ebe0 con 0x7f4bf41538b0 2023-12-08T21:27:26.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.749+0000 7f4bf0ff9640 1 -- 172.21.15.53:0/4026330 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4bdc0210a0 con 0x7f4bf41538b0 2023-12-08T21:27:26.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.753+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/4026330 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4bd40664f0 msgr2=0x7f4bd40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:26.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.753+0000 7f4bf9fcd640 1 --2- 172.21.15.53:0/4026330 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4bd40664f0 0x7f4bd40689b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4be4007fd0 tx=0x7f4be40079a0 comp rx=0 tx=0).stop 2023-12-08T21:27:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.753+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/4026330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf41538b0 msgr2=0x7f4bf40ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.753+0000 7f4bf9fcd640 1 --2- 172.21.15.53:0/4026330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf41538b0 0x7f4bf40ca330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00c4d0 tx=0x7f4bdc00c990 comp rx=0 tx=0).stop 2023-12-08T21:27:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.753+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/4026330 shutdown_connections 2023-12-08T21:27:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.753+0000 7f4bf9fcd640 1 --2- 172.21.15.53:0/4026330 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f4bd40664f0 0x7f4bd40689b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.753+0000 7f4bf9fcd640 1 --2- 172.21.15.53:0/4026330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bf415d640 0x7f4bf40ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.753+0000 7f4bf9fcd640 1 --2- 172.21.15.53:0/4026330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bf41538b0 0x7f4bf40ca330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.753+0000 7f4bf9fcd640 1 --2- 172.21.15.53:0/4026330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf406afc0 0x7f4bf4142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.753+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/4026330 >> 172.21.15.53:0/4026330 conn(0x7f4bf40cbfe0 msgr2=0x7f4bf40c2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.753+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/4026330 shutdown_connections 2023-12-08T21:27:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.753+0000 7f4bf9fcd640 1 -- 172.21.15.53:0/4026330 wait complete. 2023-12-08T21:27:26.784 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-08T21:27:26.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.917+0000 7f600974b640 1 Processor -- start 2023-12-08T21:27:26.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.917+0000 7f600974b640 1 -- start start 2023-12-08T21:27:26.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.917+0000 7f600974b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60041537f0 0x7f60040cc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:26.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.917+0000 7f600974b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6004153bd0 0x7f60040c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:26.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.917+0000 7f600974b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600415d6e0 con 0x7f60040cc580 2023-12-08T21:27:26.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.917+0000 7f600974b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600415d9c0 con 0x7f6004153bd0 2023-12-08T21:27:26.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.917+0000 7f600974b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60040cb560 con 0x7f60041537f0 2023-12-08T21:27:26.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.917+0000 7f60037fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6004153bd0 0x7f60040c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:26.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.917+0000 7f60027fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f60040cc580 0x7f600415cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39868/0 (socket says 172.21.15.53:39868) 2023-12-08T21:27:26.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.917+0000 7f60027fc640 1 -- 172.21.15.53:0/4015959017 learned_addr learned my addr 172.21.15.53:0/4015959017 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:27:26.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.917+0000 7f6002ffd640 1 --2- 172.21.15.53:0/4015959017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60041537f0 0x7f60040cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:26.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.921+0000 7f60037fe640 1 -- 172.21.15.53:0/4015959017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60041537f0 msgr2=0x7f60040cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:26.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.921+0000 7f60037fe640 1 --2- 172.21.15.53:0/4015959017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60041537f0 0x7f60040cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:26.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.921+0000 7f60037fe640 1 -- 172.21.15.53:0/4015959017 >> v1:172.21.15.53:6789/0 conn(0x7f60040cc580 legacy=0x7f600415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:26.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.921+0000 7f60037fe640 1 -- 172.21.15.53:0/4015959017 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60040cb840 con 0x7f6004153bd0 2023-12-08T21:27:26.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.925+0000 7f60037fe640 1 --2- 172.21.15.53:0/4015959017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6004153bd0 0x7f60040c9e70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009d90 tx=0x7f5ffc01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66227ee72d15eb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:26.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f6001ffb640 1 -- 172.21.15.53:0/4015959017 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0af600 con 0x7f6004153bd0 2023-12-08T21:27:26.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f6001ffb640 1 -- 172.21.15.53:0/4015959017 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5ffc0ab050 con 0x7f6004153bd0 2023-12-08T21:27:26.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f6001ffb640 1 -- 172.21.15.53:0/4015959017 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0af9a0 con 0x7f6004153bd0 2023-12-08T21:27:26.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 -- 172.21.15.53:0/4015959017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6004153bd0 msgr2=0x7f60040c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:26.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 --2- 172.21.15.53:0/4015959017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6004153bd0 0x7f60040c9e70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009d90 tx=0x7f5ffc01f130 comp rx=0 tx=0).stop 2023-12-08T21:27:26.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 -- 172.21.15.53:0/4015959017 shutdown_connections 2023-12-08T21:27:26.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 --2- 172.21.15.53:0/4015959017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6004153bd0 0x7f60040c9e70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:26.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 --2- 172.21.15.53:0/4015959017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60041537f0 0x7f60040cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:26.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 -- 172.21.15.53:0/4015959017 >> 172.21.15.53:0/4015959017 conn(0x7f600406bab0 msgr2=0x7f600406bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:26.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 -- 172.21.15.53:0/4015959017 shutdown_connections 2023-12-08T21:27:26.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 -- 172.21.15.53:0/4015959017 wait complete. 2023-12-08T21:27:26.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 Processor -- start 2023-12-08T21:27:26.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 -- start start 2023-12-08T21:27:26.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60040cc580 0x7f60040ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:26.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60041537f0 0x7f60041f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:26.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6004153bd0 0x7f6004149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:26.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60040c6d90 con 0x7f60040cc580 2023-12-08T21:27:26.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600415c650 con 0x7f60041537f0 2023-12-08T21:27:26.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.933+0000 7f600974b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600415c930 con 0x7f6004153bd0 2023-12-08T21:27:26.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.937+0000 7f6002ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60040cc580 0x7f60040ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:26.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.937+0000 7f6002ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60040cc580 0x7f60040ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33786/0 (socket says 172.21.15.53:33786) 2023-12-08T21:27:26.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.937+0000 7f6002ffd640 1 -- 172.21.15.53:0/4165930659 learned_addr learned my addr 172.21.15.53:0/4165930659 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:26.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.937+0000 7f60037fe640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6004153bd0 0x7f6004149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:26.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.937+0000 7f60027fc640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60041537f0 0x7f60041f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:26.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.941+0000 7f6002ffd640 1 -- 172.21.15.53:0/4165930659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6004153bd0 msgr2=0x7f6004149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:26.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.941+0000 7f6002ffd640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6004153bd0 0x7f6004149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:26.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.941+0000 7f6002ffd640 1 -- 172.21.15.53:0/4165930659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60041537f0 msgr2=0x7f60041f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:26.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.941+0000 7f6002ffd640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60041537f0 0x7f60041f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:26.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.941+0000 7f6002ffd640 1 -- 172.21.15.53:0/4165930659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc009a70 con 0x7f60040cc580 2023-12-08T21:27:26.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.941+0000 7f6002ffd640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60040cc580 0x7f60040ce640 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00e930 tx=0x7f5fec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:26.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.945+0000 7f5ffb7fe640 1 -- 172.21.15.53:0/4165930659 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec009690 con 0x7f60040cc580 2023-12-08T21:27:26.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.945+0000 7f5ffb7fe640 1 -- 172.21.15.53:0/4165930659 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5fec00ca00 con 0x7f60040cc580 2023-12-08T21:27:26.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.945+0000 7f5ffb7fe640 1 -- 172.21.15.53:0/4165930659 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec00cd90 con 0x7f60040cc580 2023-12-08T21:27:26.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.945+0000 7f600974b640 1 -- 172.21.15.53:0/4165930659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600415cc10 con 0x7f60040cc580 2023-12-08T21:27:26.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.945+0000 7f600974b640 1 -- 172.21.15.53:0/4165930659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60041f2720 con 0x7f60040cc580 2023-12-08T21:27:26.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:26.945+0000 7f600974b640 1 -- 172.21.15.53:0/4165930659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6004067620 con 0x7f60040cc580 2023-12-08T21:27:27.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.241+0000 7f5ffb7fe640 1 -- 172.21.15.53:0/4165930659 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5fec013470 con 0x7f60040cc580 2023-12-08T21:27:27.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.241+0000 7f5ffb7fe640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5fe80664c0 0x7f5fe8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:27.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.241+0000 7f60027fc640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5fe80664c0 0x7f5fe8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:27.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.245+0000 7f60027fc640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5fe80664c0 0x7f5fe8068980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f600414f810 tx=0x7f5ff4007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:27.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.273+0000 7f5ffb7fe640 1 -- 172.21.15.53:0/4165930659 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6604+0+0 (secure 0 0 0) 0x7f5fec055ac0 con 0x7f60040cc580 2023-12-08T21:27:27.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.273+0000 7f5ffb7fe640 1 -- 172.21.15.53:0/4165930659 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5fec051e00 con 0x7f60040cc580 2023-12-08T21:27:27.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.449+0000 7f600974b640 1 -- 172.21.15.53:0/4165930659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f600415cf10 con 0x7f60040cc580 2023-12-08T21:27:27.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.825+0000 7f5ffb7fe640 1 -- 172.21.15.53:0/4165930659 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5fec021070 con 0x7f60040cc580 2023-12-08T21:27:27.826 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-12-08T21:27:27.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.829+0000 7f600974b640 1 -- 172.21.15.53:0/4165930659 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5fe80664c0 msgr2=0x7f5fe8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:27.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.829+0000 7f600974b640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5fe80664c0 0x7f5fe8068980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f600414f810 tx=0x7f5ff4007e90 comp rx=0 tx=0).stop 2023-12-08T21:27:27.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.829+0000 7f600974b640 1 -- 172.21.15.53:0/4165930659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60040cc580 msgr2=0x7f60040ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:27.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.829+0000 7f600974b640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60040cc580 0x7f60040ce640 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00e930 tx=0x7f5fec00edf0 comp rx=0 tx=0).stop 2023-12-08T21:27:27.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.829+0000 7f600974b640 1 -- 172.21.15.53:0/4165930659 shutdown_connections 2023-12-08T21:27:27.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.829+0000 7f600974b640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f5fe80664c0 0x7f5fe8068980 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:27.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.829+0000 7f600974b640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6004153bd0 0x7f6004149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:27.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.829+0000 7f600974b640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60041537f0 0x7f60041f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:27.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.829+0000 7f600974b640 1 --2- 172.21.15.53:0/4165930659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60040cc580 0x7f60040ce640 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:27.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.829+0000 7f600974b640 1 -- 172.21.15.53:0/4165930659 >> 172.21.15.53:0/4165930659 conn(0x7f600406bab0 msgr2=0x7f600414e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:27.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.829+0000 7f600974b640 1 -- 172.21.15.53:0/4165930659 shutdown_connections 2023-12-08T21:27:27.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:27.829+0000 7f600974b640 1 -- 172.21.15.53:0/4165930659 wait complete. 2023-12-08T21:27:27.858 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-08T21:27:28.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.001+0000 7fb58b3a0640 1 Processor -- start 2023-12-08T21:27:28.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.001+0000 7fb58b3a0640 1 -- start start 2023-12-08T21:27:28.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.005+0000 7fb58b3a0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb5840c4d10 0x7fb58406f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:28.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.005+0000 7fb58b3a0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb58406fa50 0x7fb5840c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:28.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.005+0000 7fb58b3a0640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58415b650 con 0x7fb58413d050 2023-12-08T21:27:28.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.005+0000 7fb58b3a0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58406a830 con 0x7fb5840c4d10 2023-12-08T21:27:28.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.005+0000 7fb58b3a0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58415a7f0 con 0x7fb58406fa50 2023-12-08T21:27:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.017+0000 7fb58893b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb5840c4d10 0x7fb58406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.017+0000 7fb58893b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb5840c4d10 0x7fb58406f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33800/0 (socket says 172.21.15.53:33800) 2023-12-08T21:27:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.017+0000 7fb58893b640 1 -- 172.21.15.53:0/3739772898 learned_addr learned my addr 172.21.15.53:0/3739772898 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:28.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.021+0000 7fb58893b640 1 -- 172.21.15.53:0/3739772898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb58406fa50 msgr2=0x7fb5840c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:28.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.021+0000 7fb58893b640 1 --2- 172.21.15.53:0/3739772898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb58406fa50 0x7fb5840c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:28.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.021+0000 7fb58893b640 1 -- 172.21.15.53:0/3739772898 >> v1:172.21.15.146:6789/0 conn(0x7fb58413d050 legacy=0x7fb584157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:28.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.021+0000 7fb58893b640 1 -- 172.21.15.53:0/3739772898 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58415aa40 con 0x7fb5840c4d10 2023-12-08T21:27:28.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.025+0000 7fb58893b640 1 --2- 172.21.15.53:0/3739772898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5840c4d10 0x7fb58406f510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb574009870 tx=0x7fb57401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd62de05964dd4e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:28.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.029+0000 7fb57bfff640 1 -- 172.21.15.53:0/3739772898 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740aa5f0 con 0x7fb5840c4d10 2023-12-08T21:27:28.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.029+0000 7fb57bfff640 1 -- 172.21.15.53:0/3739772898 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb5740aa750 con 0x7fb5840c4d10 2023-12-08T21:27:28.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.029+0000 7fb57bfff640 1 -- 172.21.15.53:0/3739772898 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740aab00 con 0x7fb5840c4d10 2023-12-08T21:27:28.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.029+0000 7fb58b3a0640 1 -- 172.21.15.53:0/3739772898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5840c4d10 msgr2=0x7fb58406f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:28.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.029+0000 7fb58b3a0640 1 --2- 172.21.15.53:0/3739772898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5840c4d10 0x7fb58406f510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb574009870 tx=0x7fb57401c4d0 comp rx=0 tx=0).stop 2023-12-08T21:27:28.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.029+0000 7fb58b3a0640 1 -- 172.21.15.53:0/3739772898 shutdown_connections 2023-12-08T21:27:28.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.029+0000 7fb58b3a0640 1 --2- 172.21.15.53:0/3739772898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb58406fa50 0x7fb5840c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:28.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.029+0000 7fb58b3a0640 1 --2- 172.21.15.53:0/3739772898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5840c4d10 0x7fb58406f510 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:28.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.029+0000 7fb58b3a0640 1 -- 172.21.15.53:0/3739772898 >> 172.21.15.53:0/3739772898 conn(0x7fb5840cb8e0 msgr2=0x7fb5840cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:28.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58b3a0640 1 -- 172.21.15.53:0/3739772898 shutdown_connections 2023-12-08T21:27:28.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58b3a0640 1 -- 172.21.15.53:0/3739772898 wait complete. 2023-12-08T21:27:28.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58b3a0640 1 Processor -- start 2023-12-08T21:27:28.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58b3a0640 1 -- start start 2023-12-08T21:27:28.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58b3a0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb58406fa50 0x7fb5841583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:28.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58b3a0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5840c4d10 0x7fb58414f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:28.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58b3a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb58413d050 0x7fb5840c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:28.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58b3a0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb584158c50 con 0x7fb58413d050 2023-12-08T21:27:28.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58b3a0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5841f04a0 con 0x7fb58406fa50 2023-12-08T21:27:28.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58b3a0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5841f0760 con 0x7fb5840c4d10 2023-12-08T21:27:28.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58993d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb58413d050 0x7fb5840c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:28.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58993d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb58413d050 0x7fb5840c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33816/0 (socket says 172.21.15.53:33816) 2023-12-08T21:27:28.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.033+0000 7fb58993d640 1 -- 172.21.15.53:0/992737176 learned_addr learned my addr 172.21.15.53:0/992737176 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:28.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.037+0000 7fb58913c640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb58406fa50 0x7fb5841583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:28.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.037+0000 7fb58993d640 1 -- 172.21.15.53:0/992737176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5840c4d10 msgr2=0x7fb58414f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:28.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.037+0000 7fb58993d640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5840c4d10 0x7fb58414f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:28.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.037+0000 7fb58993d640 1 -- 172.21.15.53:0/992737176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb58406fa50 msgr2=0x7fb5841583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:28.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.037+0000 7fb58993d640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb58406fa50 0x7fb5841583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:28.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.037+0000 7fb58993d640 1 -- 172.21.15.53:0/992737176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740094d0 con 0x7fb58413d050 2023-12-08T21:27:28.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.041+0000 7fb58993d640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb58413d050 0x7fb5840c93e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00b970 tx=0x7fb57c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:28.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.045+0000 7fb579ffb640 1 -- 172.21.15.53:0/992737176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c00cb40 con 0x7fb58413d050 2023-12-08T21:27:28.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.045+0000 7fb579ffb640 1 -- 172.21.15.53:0/992737176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb57c00ccc0 con 0x7fb58413d050 2023-12-08T21:27:28.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.045+0000 7fb579ffb640 1 -- 172.21.15.53:0/992737176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0146a0 con 0x7fb58413d050 2023-12-08T21:27:28.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.045+0000 7fb58b3a0640 1 -- 172.21.15.53:0/992737176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5841f0a40 con 0x7fb58413d050 2023-12-08T21:27:28.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.045+0000 7fb58b3a0640 1 -- 172.21.15.53:0/992737176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5841f1000 con 0x7fb58413d050 2023-12-08T21:27:28.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.045+0000 7fb58b3a0640 1 -- 172.21.15.53:0/992737176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5840cb350 con 0x7fb58413d050 2023-12-08T21:27:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.069+0000 7fb579ffb640 1 -- 172.21.15.53:0/992737176 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb57c01d3b0 con 0x7fb58413d050 2023-12-08T21:27:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.069+0000 7fb579ffb640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb5680664c0 0x7fb568068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.069+0000 7fb58913c640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb5680664c0 0x7fb568068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.069+0000 7fb58913c640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb5680664c0 0x7fb568068980 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb580007fd0 tx=0x7fb580009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.073+0000 7fb579ffb640 1 -- 172.21.15.53:0/992737176 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6166+0+0 (secure 0 0 0) 0x7fb57c00ce30 con 0x7fb58413d050 2023-12-08T21:27:28.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.361+0000 7fb579ffb640 1 -- 172.21.15.53:0/992737176 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb57c051770 con 0x7fb58413d050 2023-12-08T21:27:28.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:28.533+0000 7fb58b3a0640 1 -- 172.21.15.53:0/992737176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb5841f1220 con 0x7fb58413d050 2023-12-08T21:27:29.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.237+0000 7fb579ffb640 1 -- 172.21.15.53:0/992737176 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb57c019070 con 0x7fb58413d050 2023-12-08T21:27:29.239 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-12-08T21:27:29.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.241+0000 7fb58b3a0640 1 -- 172.21.15.53:0/992737176 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb5680664c0 msgr2=0x7fb568068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:29.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.241+0000 7fb58b3a0640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb5680664c0 0x7fb568068980 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb580007fd0 tx=0x7fb580009040 comp rx=0 tx=0).stop 2023-12-08T21:27:29.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.241+0000 7fb58b3a0640 1 -- 172.21.15.53:0/992737176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb58413d050 msgr2=0x7fb5840c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:29.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.241+0000 7fb58b3a0640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb58413d050 0x7fb5840c93e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00b970 tx=0x7fb57c00be30 comp rx=0 tx=0).stop 2023-12-08T21:27:29.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.241+0000 7fb58b3a0640 1 -- 172.21.15.53:0/992737176 shutdown_connections 2023-12-08T21:27:29.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.241+0000 7fb58b3a0640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7fb5680664c0 0x7fb568068980 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:29.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.241+0000 7fb58b3a0640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb58413d050 0x7fb5840c93e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:29.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.241+0000 7fb58b3a0640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5840c4d10 0x7fb58414f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:29.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.241+0000 7fb58b3a0640 1 --2- 172.21.15.53:0/992737176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb58406fa50 0x7fb5841583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:29.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.241+0000 7fb58b3a0640 1 -- 172.21.15.53:0/992737176 >> 172.21.15.53:0/992737176 conn(0x7fb5840cb8e0 msgr2=0x7fb584157270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:29.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.241+0000 7fb58b3a0640 1 -- 172.21.15.53:0/992737176 shutdown_connections 2023-12-08T21:27:29.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.241+0000 7fb58b3a0640 1 -- 172.21.15.53:0/992737176 wait complete. 2023-12-08T21:27:29.268 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-08T21:27:29.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.413+0000 7f7b47dcc640 1 Processor -- start 2023-12-08T21:27:29.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.413+0000 7f7b47dcc640 1 -- start start 2023-12-08T21:27:29.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.413+0000 7f7b47dcc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b40151440 0x7f7b401571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:29.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.413+0000 7f7b47dcc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7b400b1fe0 0x7f7b400c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:29.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.413+0000 7f7b47dcc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4015ac80 con 0x7f7b4006fdb0 2023-12-08T21:27:29.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.413+0000 7f7b47dcc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b40158190 con 0x7f7b40151440 2023-12-08T21:27:29.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.413+0000 7f7b47dcc640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b401578f0 con 0x7f7b400b1fe0 2023-12-08T21:27:29.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.413+0000 7f7b45b68640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b40151440 0x7f7b401571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:29.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.413+0000 7f7b45367640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7b4006fdb0 0x7f7b4015b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39878/0 (socket says 172.21.15.53:39878) 2023-12-08T21:27:29.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.413+0000 7f7b45367640 1 -- 172.21.15.53:0/1451632593 learned_addr learned my addr 172.21.15.53:0/1451632593 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-12-08T21:27:29.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.413+0000 7f7b46369640 1 --2- 172.21.15.53:0/1451632593 >> v2:172.21.15.146:3300/0 conn(0x7f7b400b1fe0 0x7f7b400c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:29.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.417+0000 7f7b45b68640 1 -- 172.21.15.53:0/1451632593 >> v2:172.21.15.146:3300/0 conn(0x7f7b400b1fe0 msgr2=0x7f7b400c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T21:27:29.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.417+0000 7f7b45b68640 1 --2- 172.21.15.53:0/1451632593 >> v2:172.21.15.146:3300/0 conn(0x7f7b400b1fe0 0x7f7b400c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:29.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.417+0000 7f7b45b68640 1 -- 172.21.15.53:0/1451632593 >> v1:172.21.15.53:6789/0 conn(0x7f7b4006fdb0 legacy=0x7f7b4015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:29.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.417+0000 7f7b45b68640 1 -- 172.21.15.53:0/1451632593 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40157bd0 con 0x7f7b40151440 2023-12-08T21:27:29.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.421+0000 7f7b45b68640 1 --2- 172.21.15.53:0/1451632593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b40151440 0x7f7b401571f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7b400707c0 tx=0x7f7b3401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d7b208c4746bb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:29.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.429+0000 7f7b44b66640 1 -- 172.21.15.53:0/1451632593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340ab600 con 0x7f7b40151440 2023-12-08T21:27:29.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.429+0000 7f7b44b66640 1 -- 172.21.15.53:0/1451632593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7b340a7050 con 0x7f7b40151440 2023-12-08T21:27:29.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.429+0000 7f7b44b66640 1 -- 172.21.15.53:0/1451632593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340ab9a0 con 0x7f7b40151440 2023-12-08T21:27:29.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.433+0000 7f7b47dcc640 1 -- 172.21.15.53:0/1451632593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b40151440 msgr2=0x7f7b401571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:29.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.433+0000 7f7b47dcc640 1 --2- 172.21.15.53:0/1451632593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b40151440 0x7f7b401571f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7b400707c0 tx=0x7f7b3401c340 comp rx=0 tx=0).stop 2023-12-08T21:27:29.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.433+0000 7f7b47dcc640 1 -- 172.21.15.53:0/1451632593 shutdown_connections 2023-12-08T21:27:29.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.433+0000 7f7b47dcc640 1 --2- 172.21.15.53:0/1451632593 >> v2:172.21.15.146:3300/0 conn(0x7f7b400b1fe0 0x7f7b400c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:29.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.433+0000 7f7b47dcc640 1 --2- 172.21.15.53:0/1451632593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b40151440 0x7f7b401571f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:29.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.433+0000 7f7b47dcc640 1 -- 172.21.15.53:0/1451632593 >> 172.21.15.53:0/1451632593 conn(0x7f7b40070c40 msgr2=0x7f7b40071050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:29.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.433+0000 7f7b47dcc640 1 -- 172.21.15.53:0/1451632593 shutdown_connections 2023-12-08T21:27:29.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.433+0000 7f7b47dcc640 1 -- 172.21.15.53:0/1451632593 wait complete. 2023-12-08T21:27:29.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.437+0000 7f7b47dcc640 1 Processor -- start 2023-12-08T21:27:29.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.437+0000 7f7b47dcc640 1 -- start start 2023-12-08T21:27:29.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.437+0000 7f7b47dcc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4006fdb0 0x7f7b401583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:29.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.437+0000 7f7b47dcc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b400b1fe0 0x7f7b40145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:29.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.437+0000 7f7b47dcc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7b40151440 0x7f7b401f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:29.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.437+0000 7f7b47dcc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b401f6a50 con 0x7f7b400b1fe0 2023-12-08T21:27:29.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.437+0000 7f7b47dcc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b401588f0 con 0x7f7b4006fdb0 2023-12-08T21:27:29.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.437+0000 7f7b47dcc640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b40154f50 con 0x7f7b40151440 2023-12-08T21:27:29.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.441+0000 7f7b45367640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b400b1fe0 0x7f7b40145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:29.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.441+0000 7f7b45367640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b400b1fe0 0x7f7b40145d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33826/0 (socket says 172.21.15.53:33826) 2023-12-08T21:27:29.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.441+0000 7f7b45367640 1 -- 172.21.15.53:0/3358883536 learned_addr learned my addr 172.21.15.53:0/3358883536 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-12-08T21:27:29.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.441+0000 7f7b45b68640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4006fdb0 0x7f7b401583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.445+0000 7f7b46369640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7b40151440 0x7f7b401f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.445+0000 7f7b45367640 1 -- 172.21.15.53:0/3358883536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7b40151440 msgr2=0x7f7b401f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.445+0000 7f7b45367640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7b40151440 0x7f7b401f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.445+0000 7f7b45367640 1 -- 172.21.15.53:0/3358883536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4006fdb0 msgr2=0x7f7b401583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.445+0000 7f7b45367640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4006fdb0 0x7f7b401583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.445+0000 7f7b45367640 1 -- 172.21.15.53:0/3358883536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34009420 con 0x7f7b400b1fe0 2023-12-08T21:27:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.449+0000 7f7b45367640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b400b1fe0 0x7f7b40145d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800ca70 tx=0x7f7b3800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.457+0000 7f7b327fc640 1 -- 172.21.15.53:0/3358883536 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800abd0 con 0x7f7b400b1fe0 2023-12-08T21:27:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.457+0000 7f7b327fc640 1 -- 172.21.15.53:0/3358883536 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7b3800ad30 con 0x7f7b400b1fe0 2023-12-08T21:27:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.457+0000 7f7b47dcc640 1 -- 172.21.15.53:0/3358883536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4006e920 con 0x7f7b400b1fe0 2023-12-08T21:27:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.457+0000 7f7b327fc640 1 -- 172.21.15.53:0/3358883536 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38012640 con 0x7f7b400b1fe0 2023-12-08T21:27:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.457+0000 7f7b47dcc640 1 -- 172.21.15.53:0/3358883536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b40155510 con 0x7f7b400b1fe0 2023-12-08T21:27:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.457+0000 7f7b47dcc640 1 -- 172.21.15.53:0/3358883536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b28005260 con 0x7f7b400b1fe0 2023-12-08T21:27:29.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.477+0000 7f7b327fc640 1 -- 172.21.15.53:0/3358883536 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b38007070 con 0x7f7b400b1fe0 2023-12-08T21:27:29.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.477+0000 7f7b327fc640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7b240664a0 0x7f7b24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T21:27:29.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.477+0000 7f7b45b68640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7b240664a0 0x7f7b24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T21:27:29.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.477+0000 7f7b45b68640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7b240664a0 0x7f7b24068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b340ad000 tx=0x7f7b340a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T21:27:29.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.793+0000 7f7b327fc640 1 -- 172.21.15.53:0/3358883536 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5723+0+0 (secure 0 0 0) 0x7f7b38055a10 con 0x7f7b400b1fe0 2023-12-08T21:27:29.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.793+0000 7f7b327fc640 1 -- 172.21.15.53:0/3358883536 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b380515c0 con 0x7f7b400b1fe0 2023-12-08T21:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:29.969+0000 7f7b47dcc640 1 -- 172.21.15.53:0/3358883536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7b280050d0 con 0x7f7b400b1fe0 2023-12-08T21:27:30.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.625+0000 7f7b327fc640 1 -- 172.21.15.53:0/3358883536 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7f7b38017030 con 0x7f7b400b1fe0 2023-12-08T21:27:30.628 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data_ec' removed 2023-12-08T21:27:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.629+0000 7f7b47dcc640 1 -- 172.21.15.53:0/3358883536 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7b240664a0 msgr2=0x7f7b24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.629+0000 7f7b47dcc640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7b240664a0 0x7f7b24068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b340ad000 tx=0x7f7b340a6000 comp rx=0 tx=0).stop 2023-12-08T21:27:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.629+0000 7f7b47dcc640 1 -- 172.21.15.53:0/3358883536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b400b1fe0 msgr2=0x7f7b40145d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T21:27:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.629+0000 7f7b47dcc640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b400b1fe0 0x7f7b40145d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800ca70 tx=0x7f7b3800cf30 comp rx=0 tx=0).stop 2023-12-08T21:27:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.629+0000 7f7b47dcc640 1 -- 172.21.15.53:0/3358883536 shutdown_connections 2023-12-08T21:27:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.629+0000 7f7b47dcc640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.53:6800/748035024,v1:172.21.15.53:6801/748035024] conn(0x7f7b240664a0 0x7f7b24068960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.629+0000 7f7b47dcc640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7b40151440 0x7f7b401f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.629+0000 7f7b47dcc640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b400b1fe0 0x7f7b40145d80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.629+0000 7f7b47dcc640 1 --2- 172.21.15.53:0/3358883536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4006fdb0 0x7f7b401583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T21:27:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.629+0000 7f7b47dcc640 1 -- 172.21.15.53:0/3358883536 >> 172.21.15.53:0/3358883536 conn(0x7f7b40070c40 msgr2=0x7f7b40160bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T21:27:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.633+0000 7f7b47dcc640 1 -- 172.21.15.53:0/3358883536 shutdown_connections 2023-12-08T21:27:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-12-08T21:27:30.633+0000 7f7b47dcc640 1 -- 172.21.15.53:0/3358883536 wait complete. 2023-12-08T21:27:30.660 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-08T21:27:30.661 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-08T21:27:30.661 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:27:30.661 INFO:tasks.ceph.mds.a:Stopped 2023-12-08T21:27:30.661 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-08T21:27:30.661 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:27:30.680 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-12-08T21:27:30.665+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 42185) UID: 0 2023-12-08T21:27:30.681 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-12-08T21:27:30.669+0000 b9ac640 -1 mds.c *** got signal Terminated *** 2023-12-08T21:27:33.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:27:33.843 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:27:36.763 INFO:tasks.ceph.mds.c:Stopped 2023-12-08T21:27:36.764 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-12-08T21:27:36.764 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:27:36.802 INFO:tasks.ceph.mds.e.smithi053.stderr:2023-12-08T21:27:36.773+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 42187) UID: 0 2023-12-08T21:27:36.804 INFO:tasks.ceph.mds.e.smithi053.stderr:2023-12-08T21:27:36.777+0000 b9ac640 -1 mds.e *** got signal Terminated *** 2023-12-08T21:27:42.866 INFO:tasks.ceph.mds.e:Stopped 2023-12-08T21:27:42.867 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-08T21:27:42.867 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:27:42.906 INFO:tasks.ceph.mds.b.smithi146.stderr:2023-12-08T21:27:42.875+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 42457) UID: 0 2023-12-08T21:27:42.907 INFO:tasks.ceph.mds.b.smithi146.stderr:2023-12-08T21:27:42.879+0000 b9ac640 -1 mds.b *** got signal Terminated *** 2023-12-08T21:27:44.983 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:34:13.778 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:27:45.124 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:34:13.919 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:27:45.140 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:34:13.863 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:27:45.145 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:34:13.868 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:27:45.153 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:34:13.875 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:27:45.258 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:34:13.981 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:27:45.355 INFO:tasks.ceph.mon.b.smithi146.stderr:==00:00:34:14.078 38448== Warning: unimplemented fcntl command: 1036 2023-12-08T21:27:45.405 INFO:tasks.ceph.mon.a.smithi053.stderr:==00:00:34:14.201 38352== Warning: unimplemented fcntl command: 1036 2023-12-08T21:27:45.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-08T21:27:45.493 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:34:14.215 38449== Warning: unimplemented fcntl command: 1036 2023-12-08T21:27:48.968 INFO:tasks.ceph.mds.b:Stopped 2023-12-08T21:27:48.969 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-08T21:27:48.969 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:27:48.991 INFO:tasks.ceph.mds.d.smithi146.stderr:2023-12-08T21:27:48.971+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 42459) UID: 0 2023-12-08T21:27:48.993 INFO:tasks.ceph.mds.d.smithi146.stderr:2023-12-08T21:27:48.975+0000 b9ac640 -1 mds.d *** got signal Terminated *** 2023-12-08T21:27:51.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-08T21:27:55.070 INFO:tasks.ceph.mds.d:Stopped 2023-12-08T21:27:55.070 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-12-08T21:27:55.070 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:27:55.108 INFO:tasks.ceph.mds.f.smithi146.stderr:2023-12-08T21:27:55.079+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 42461) UID: 0 2023-12-08T21:27:55.109 INFO:tasks.ceph.mds.f.smithi146.stderr:2023-12-08T21:27:55.083+0000 b9ac640 -1 mds.f *** got signal Terminated *** 2023-12-08T21:27:58.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2023-12-08T21:28:01.173 INFO:tasks.ceph.mds.f:Stopped 2023-12-08T21:28:01.173 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-08T21:28:01.173 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-08T21:28:01.173 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:28:01.174 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-12-08T21:28:01.173+0000 7efd137cd640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 38543) UID: 0 2023-12-08T21:28:01.175 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-12-08T21:28:01.173+0000 7efd137cd640 -1 osd.0 39 *** Got signal Terminated *** 2023-12-08T21:28:03.895 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:28:03.898 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:28:04.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-08T21:28:04.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2023-12-08T21:28:07.275 INFO:tasks.ceph.osd.0:Stopped 2023-12-08T21:28:07.275 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-08T21:28:07.275 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:28:07.276 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-12-08T21:28:07.277+0000 7f4e54d2b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 38545) UID: 0 2023-12-08T21:28:07.276 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-12-08T21:28:07.277+0000 7f4e54d2b640 -1 osd.1 40 *** Got signal Terminated *** 2023-12-08T21:28:10.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-12-08T21:28:10.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-12-08T21:28:13.377 INFO:tasks.ceph.osd.1:Stopped 2023-12-08T21:28:13.377 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-08T21:28:13.377 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:28:13.379 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-12-08T21:28:13.377+0000 7f5304f20640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 38547) UID: 0 2023-12-08T21:28:13.379 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-12-08T21:28:13.377+0000 7f5304f20640 -1 osd.2 42 *** Got signal Terminated *** 2023-12-08T21:28:16.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-12-08T21:28:16.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-12-08T21:28:19.479 INFO:tasks.ceph.osd.2:Stopped 2023-12-08T21:28:19.480 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-08T21:28:19.480 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:28:19.481 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-12-08T21:28:19.481+0000 7f825b1e0640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 38550) UID: 0 2023-12-08T21:28:19.481 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-12-08T21:28:19.481+0000 7f825b1e0640 -1 osd.3 43 *** Got signal Terminated *** 2023-12-08T21:28:22.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-12-08T21:28:22.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-12-08T21:28:25.581 INFO:tasks.ceph.osd.3:Stopped 2023-12-08T21:28:25.582 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-08T21:28:25.582 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:28:25.583 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-12-08T21:28:25.578+0000 7f73de798640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 38765) UID: 0 2023-12-08T21:28:25.583 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-12-08T21:28:25.578+0000 7f73de798640 -1 osd.4 44 *** Got signal Terminated *** 2023-12-08T21:28:28.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-12-08T21:28:28.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-12-08T21:28:31.684 INFO:tasks.ceph.osd.4:Stopped 2023-12-08T21:28:31.684 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-08T21:28:31.684 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:28:31.686 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-12-08T21:28:31.682+0000 7fe26306c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 38767) UID: 0 2023-12-08T21:28:31.686 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-12-08T21:28:31.682+0000 7fe26306c640 -1 osd.5 45 *** Got signal Terminated *** 2023-12-08T21:28:34.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:28:34.030 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:28:34.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-12-08T21:28:37.786 INFO:tasks.ceph.osd.5:Stopped 2023-12-08T21:28:37.787 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-08T21:28:37.787 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:28:37.788 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-12-08T21:28:37.782+0000 7f076d344640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 38768) UID: 0 2023-12-08T21:28:37.788 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-12-08T21:28:37.782+0000 7f076d344640 -1 osd.6 46 *** Got signal Terminated *** 2023-12-08T21:28:39.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-08T21:28:43.889 INFO:tasks.ceph.osd.6:Stopped 2023-12-08T21:28:43.890 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-08T21:28:43.890 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:28:43.891 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-12-08T21:28:43.890+0000 7f4f9afdb640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 38771) UID: 0 2023-12-08T21:28:43.891 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-12-08T21:28:43.890+0000 7f4f9afdb640 -1 osd.7 46 *** Got signal Terminated *** 2023-12-08T21:28:45.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-08T21:28:45.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-08T21:28:49.991 INFO:tasks.ceph.osd.7:Stopped 2023-12-08T21:28:49.992 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-08T21:28:49.992 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-08T21:28:49.992 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:28:50.022 INFO:tasks.ceph.mgr.y:Stopped 2023-12-08T21:28:50.023 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-08T21:28:50.023 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:28:50.050 INFO:tasks.ceph.mgr.x:Stopped 2023-12-08T21:28:50.051 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-08T21:28:50.051 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-08T21:28:50.051 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:28:50.142 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-12-08T21:28:50.112+0000 a347640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 38348) UID: 0 2023-12-08T21:28:50.143 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-12-08T21:28:50.116+0000 a347640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-08T21:28:50.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-08T21:28:55.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-12-08T21:28:56.153 INFO:tasks.ceph.mon.a:Stopped 2023-12-08T21:28:56.153 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-08T21:28:56.154 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T21:28:56.192 INFO:tasks.ceph.mon.b.smithi146.stderr:2023-12-08T21:28:56.158+0000 a347640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 38441) UID: 0 2023-12-08T21:28:56.193 INFO:tasks.ceph.mon.b.smithi146.stderr:2023-12-08T21:28:56.162+0000 a347640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-08T21:29:00.970 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-12-08T21:29:04.165 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:29:04.168 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:29:34.245 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:29:34.248 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:30:04.296 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:30:04.300 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:30:34.362 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:30:34.365 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:31:04.443 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:31:04.448 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:31:34.488 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:31:34.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:32:04.743 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:32:04.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:32:34.831 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:32:34.835 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:33:04.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:33:04.882 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:33:34.932 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:33:34.936 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:33:55.219 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-08T21:33:55.220 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-12-08T21:33:55.239 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T21:33:55.239 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-08T21:33:55.452 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T21:33:55.452 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-08T21:33:55.603 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T21:33:55.604 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-08T21:33:55.790 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T21:33:55.791 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-08T21:33:55.963 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi146.front.sepia.ceph.com 2023-12-08T21:33:55.963 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-08T21:33:56.148 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi146.front.sepia.ceph.com 2023-12-08T21:33:56.148 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-08T21:33:56.303 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi146.front.sepia.ceph.com 2023-12-08T21:33:56.303 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-08T21:33:56.437 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi146.front.sepia.ceph.com 2023-12-08T21:33:56.437 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-08T21:33:56.551 INFO:tasks.ceph:Archiving mon data... 2023-12-08T21:33:56.553 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218/data/mon.a.tgz 2023-12-08T21:33:56.553 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2023-12-08T21:33:56.559 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.zYECnKYt4p 2023-12-08T21:33:56.559 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.zYECnKYt4p 2023-12-08T21:33:56.681 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.zYECnKYt4p 2023-12-08T21:33:56.744 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.zYECnKYt4p is 339KB 2023-12-08T21:33:56.807 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.zYECnKYt4p 2023-12-08T21:33:56.812 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218/data/mon.b.tgz 2023-12-08T21:33:56.812 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-12-08T21:33:56.818 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.vKML1zIWZ3 2023-12-08T21:33:56.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.vKML1zIWZ3 2023-12-08T21:33:56.938 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.vKML1zIWZ3 2023-12-08T21:33:57.001 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.vKML1zIWZ3 is 348KB 2023-12-08T21:33:57.058 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.vKML1zIWZ3 2023-12-08T21:33:57.063 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218/data/mon.c.tgz 2023-12-08T21:33:57.063 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-12-08T21:33:57.108 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.i4dmpaoKOG 2023-12-08T21:33:57.109 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.i4dmpaoKOG 2023-12-08T21:33:57.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.i4dmpaoKOG 2023-12-08T21:33:57.292 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.i4dmpaoKOG is 349KB 2023-12-08T21:33:57.351 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.i4dmpaoKOG 2023-12-08T21:33:57.356 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-08T21:33:57.356 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-08T21:33:57.358 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-08T21:33:57.611 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2023-12-08T21:33:57.701 ERROR:teuthology.util.scanner:Premature end of data in tag valgrindoutput line 3, line 50, column 1 (, line 50) 2023-12-08T21:33:57.711 ERROR:teuthology.util.scanner:Premature end of data in tag valgrindoutput line 3, line 50, column 1 (, line 50) 2023-12-08T21:33:57.711 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-08T21:33:57.711 INFO:tasks.ceph:Archiving crash dumps... 2023-12-08T21:33:57.713 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218/remote/smithi053/crash 2023-12-08T21:33:57.714 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-08T21:33:57.729 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218/remote/smithi146/crash 2023-12-08T21:33:57.730 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-08T21:33:57.742 INFO:tasks.ceph:Shutting down logrotate 2023-12-08T21:33:57.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:33:57.774 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T21:33:57.826 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-08T21:33:57.864 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-08T21:33:57.880 INFO:tasks.ceph:Compressing logs... 2023-12-08T21:33:57.880 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-08T21:33:57.910 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-08T21:33:57.935 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44537.log 2023-12-08T21:33:57.936 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44754.log 2023-12-08T21:33:57.937 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43673.log 2023-12-08T21:33:57.937 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44537.log: /var/log/ceph/ceph-client.admin.44754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43672.log 2023-12-08T21:33:57.937 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44537.log.gz 2023-12-08T21:33:57.937 INFO:teuthology.orchestra.run.smithi053.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44754.log.gz 2023-12-08T21:33:57.937 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43673.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-08T21:33:57.954 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38664.log 2023-12-08T21:33:57.954 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-08T21:33:57.954 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38560.log 2023-12-08T21:33:57.954 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38664.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38664.log.gz 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38560.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38639.log 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.6.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38560.log.gz 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38639.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38639.log.gz 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph.log 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38584.log 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38714.log 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38584.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38584.log.gz 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38690.log 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38714.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38714.log.gz 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-08T21:33:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38690.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38690.log.gz 2023-12-08T21:33:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38615.log 2023-12-08T21:33:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.c.log: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-08T21:33:57.956 INFO:teuthology.orchestra.run.smithi146.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-12-08T21:33:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-08T21:33:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38615.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-08T21:33:57.956 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38615.log.gz 2023-12-08T21:33:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-12-08T21:33:57.963 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.d.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-08T21:33:57.963 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2023-12-08T21:33:57.963 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/valgrind/mon.c.log: 55.0% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-12-08T21:33:57.963 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2023-12-08T21:33:57.963 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/valgrind/mds.f.log: 57.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2023-12-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2023-12-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/valgrind/mds.b.log: 57.6% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2023-12-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-12-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/valgrind/mds.d.log: 57.6% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2023-12-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/valgrind/mon.b.log: 55.0% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-12-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.b.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-08T21:33:57.970 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43305.log 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43673.log.gz 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43672.log.gz 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46050.log 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46473.log 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43305.log.gz 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45510.log 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46050.log.gz 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45536.log 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45510.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46473.log.gz 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45841.log 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45510.log.gz 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46102.log 2023-12-08T21:33:57.971 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45536.log.gz 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42710.log 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46102.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45841.log.gz 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42221.log 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46102.log.gz 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44070.log 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42710.log.gz 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45273.log 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44070.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42221.log.gz 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43884.log 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44070.log.gz 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45273.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45273.log.gz 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46024.log 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.0.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43884.log.gz 2023-12-08T21:33:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45737.log 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42145.log 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46024.log.gz 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42575.log 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45737.log.gz 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38554.log 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42145.log.gz 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43201.log 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42575.log: /var/log/ceph/ceph-client.admin.38554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45920.log 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42575.log.gz 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38554.log.gz 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46265.log 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43201.log.gz 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45920.log.gz 2023-12-08T21:33:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45763.log 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44159.log 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46265.log.gz 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44066.log: /var/log/ceph/ceph-client.admin.45763.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz -5 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42083.log 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45763.log.gz 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46421.log 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42083.log: gzip -5 88.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44159.log.gz /var/log/ceph/ceph-client.admin.46343.log 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42083.log.gz 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46186.log 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46421.log.gz 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46447.log 2023-12-08T21:33:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46186.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46343.log.gz 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44483.log 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46186.log.gz 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46447.log: /var/log/ceph/ceph-client.admin.44483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43666.log 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44483.log.gz 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46447.log.gz 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43494.log 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43598.log 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43494.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43666.log.gz 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43669.log 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43598.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43494.log.gz 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43598.log.gz 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43096.log 2023-12-08T21:33:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43468.log 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.a.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43669.log.gz 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42736.log 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5%/var/log/ceph/ceph-client.admin.43468.log: -- replaced with /var/log/ceph/ceph-client.admin.43096.log.gz 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43122.log 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43468.log.gz 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45815.log 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42736.log.gz 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43018.log 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43122.log.gz 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44161.log 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45815.log.gz 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42838.log 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43018.log.gz 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42435.log 2023-12-08T21:33:57.976 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44161.log.gz 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46291.log 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42838.log.gz 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42632.log 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42435.log.gz 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43930.log 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46291.log.gz 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45789.log 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42632.log.gz 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42192.log 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43930.log.gz 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46213.log 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45789.log.gz 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42542.log 2023-12-08T21:33:57.977 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42192.log.gz 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45325.log 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42542.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46213.log.gz 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45685.log 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42542.log.gz 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42788.log 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45325.log.gz 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44248.log 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45685.log.gz 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42788.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44301.log 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44248.log.gz 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42788.log.gz 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.3.log: 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43070.log 2023-12-08T21:33:57.978 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42409.log 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42461.log 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44301.log.gz 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43070.log.gz 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42409.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42409.log.gz 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45632.log 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43416.log 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2%/var/log/ceph/ceph-client.admin.45632.log: -- replaced with /var/log/ceph/ceph-client.admin.42461.log.gz 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38355.log 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45632.log.gz 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43416.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43416.log.gz 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45562.log 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43338.log 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45562.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.38355.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45562.log.gz 2023-12-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43338.log: 2023-12-08T21:33:57.980 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43338.log.gz 2023-12-08T21:33:57.980 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43442.log 2023-12-08T21:33:57.980 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44431.log 2023-12-08T21:33:57.980 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44405.log 2023-12-08T21:33:57.980 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43442.log.gz/var/log/ceph/ceph-client.admin.44431.log: 2023-12-08T21:33:57.980 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44431.log.gz 2023-12-08T21:33:57.980 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45377.log 2023-12-08T21:33:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.b.log: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-08T21:33:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38738.log 2023-12-08T21:33:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.4.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-08T21:33:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38738.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38738.log.gz 2023-12-08T21:33:57.990 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43572.log 2023-12-08T21:33:57.990 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44405.log.gz/var/log/ceph/ceph-client.admin.45377.log: 2023-12-08T21:33:57.990 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45377.log.gz 2023-12-08T21:33:57.990 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45351.log 2023-12-08T21:33:57.990 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42487.log 2023-12-08T21:33:57.990 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43572.log.gz/var/log/ceph/ceph-client.admin.45351.log: 2023-12-08T21:33:57.990 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45351.log.gz 2023-12-08T21:33:57.990 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43148.log 2023-12-08T21:33:57.990 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44353.log 2023-12-08T21:33:57.990 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4%/var/log/ceph/ceph-client.admin.43148.log: -- replaced with /var/log/ceph/ceph-client.admin.42487.log.gz 2023-12-08T21:33:57.990 INFO:teuthology.orchestra.run.smithi053.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43148.log.gz 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44563.log 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46076.log 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44353.log.gz 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44563.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44563.log.gz 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43856.log 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44128.log 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0%/var/log/ceph/ceph-client.admin.43856.log: -- replaced with /var/log/ceph/ceph-client.admin.46076.log.gz 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43856.log.gz 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45711.log 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42684.log 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2%/var/log/ceph/ceph-client.admin.45711.log: -- replaced with /var/log/ceph/ceph-client.admin.44128.log.gz 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45711.log.gz 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45456.log 2023-12-08T21:33:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42658.log 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42684.log.gz/var/log/ceph/ceph-client.admin.45456.log: 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45456.log.gz 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44457.log 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42658.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4%/var/log/ceph/ceph-client.admin.44457.log: -- replaced with /var/log/ceph/ceph-client.admin.42658.log.gz 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44457.log.gz 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46241.log 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45946.log 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46241.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46241.log.gz 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44641.log 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45946.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45946.log.gz 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43678.log 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44641.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44641.log.gz 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-08T21:33:57.992 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45972.log 2023-12-08T21:33:57.993 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43678.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43678.log.gz 2023-12-08T21:33:57.993 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46395.log 2023-12-08T21:33:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44132.log 2023-12-08T21:33:57.996 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9%/var/log/ceph/ceph-client.admin.46395.log: -- replaced with /var/log/ceph/ceph-client.admin.45972.log.gz 2023-12-08T21:33:57.996 INFO:teuthology.orchestra.run.smithi053.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46395.log.gz 2023-12-08T21:33:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46128.log 2023-12-08T21:33:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43670.log 2023-12-08T21:33:57.996 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44132.log.gz 2023-12-08T21:33:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46128.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46128.log.gz 2023-12-08T21:33:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42513.log 2023-12-08T21:33:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45484.log 2023-12-08T21:33:57.996 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9%/var/log/ceph/ceph-client.admin.42513.log: -- replaced with /var/log/ceph/ceph-client.admin.43670.log.gz 2023-12-08T21:33:57.997 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42513.log.gz 2023-12-08T21:33:57.997 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43624.log 2023-12-08T21:33:57.997 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45998.log 2023-12-08T21:33:57.997 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43624.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45484.log.gz 2023-12-08T21:33:57.997 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43624.log.gz 2023-12-08T21:33:57.999 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43253.log 2023-12-08T21:33:57.999 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43677.log 2023-12-08T21:33:57.999 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5%/var/log/ceph/ceph-client.admin.43253.log: -- replaced with /var/log/ceph/ceph-client.admin.45998.log.gz 2023-12-08T21:33:57.999 INFO:teuthology.orchestra.run.smithi053.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43253.log.gz 2023-12-08T21:33:57.999 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-08T21:33:57.999 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43390.log 2023-12-08T21:33:57.999 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1%/var/log/ceph/ceph.audit.log: -- replaced with /var/log/ceph/ceph-client.admin.43677.log.gz 2023-12-08T21:33:58.000 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-08T21:33:58.000 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-08T21:33:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46317.log 2023-12-08T21:33:58.001 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2%/var/log/ceph/ceph-mds.c.log: -- replaced with /var/log/ceph/ceph-client.admin.43390.log.gz 2023-12-08T21:33:58.004 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33548.log 2023-12-08T21:33:58.005 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46317.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46317.log.gz 2023-12-08T21:33:58.005 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45659.log 2023-12-08T21:33:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.tmp-client.admin.33548.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33548.log.gz 2023-12-08T21:33:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-08T21:33:58.008 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45659.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45659.log.gz 2023-12-08T21:33:58.008 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42247.log 2023-12-08T21:33:58.009 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mds.a.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-08T21:33:58.012 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46369.log 2023-12-08T21:33:58.013 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42247.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42247.log.gz 2023-12-08T21:33:58.013 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44874.log 2023-12-08T21:33:58.014 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46369.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46369.log.gz 2023-12-08T21:33:58.015 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43044.log 2023-12-08T21:33:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.44874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44379.log 2023-12-08T21:33:58.029 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43044.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43044.log.gz 2023-12-08T21:33:58.029 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46156.log 2023-12-08T21:33:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44379.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44379.log.gz 2023-12-08T21:33:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44084.log 2023-12-08T21:33:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46156.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46156.log.gz 2023-12-08T21:33:58.052 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2023-12-08T21:33:58.053 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44084.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44084.log.gz 2023-12-08T21:33:58.060 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2023-12-08T21:33:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/valgrind/client.0.log: 77.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2023-12-08T21:33:58.076 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-12-08T21:33:58.080 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/valgrind/mds.a.log: 95.3% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2023-12-08T21:33:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2023-12-08T21:33:58.085 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/valgrind/mon.a.log: 93.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-12-08T21:33:58.092 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2023-12-08T21:33:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/valgrind/mds.c.log: 57.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2023-12-08T21:33:58.116 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43227.log 2023-12-08T21:33:58.117 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/valgrind/mds.e.log: 57.6% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2023-12-08T21:33:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44693.log 2023-12-08T21:33:58.129 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43227.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43227.log.gz 2023-12-08T21:33:58.144 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43175.log 2023-12-08T21:33:58.145 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44693.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.44693.log.gz 2023-12-08T21:33:58.162 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42383.log 2023-12-08T21:33:58.162 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43175.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43175.log.gz 2023-12-08T21:33:58.176 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44589.log 2023-12-08T21:33:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42383.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42383.log.gz 2023-12-08T21:33:58.188 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43846.log 2023-12-08T21:33:58.189 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44589.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44589.log.gz 2023-12-08T21:33:58.208 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44509.log 2023-12-08T21:33:58.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43846.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43846.log.gz 2023-12-08T21:33:58.232 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44274.log 2023-12-08T21:33:58.233 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44509.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44509.log.gz 2023-12-08T21:33:58.248 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43279.log 2023-12-08T21:33:58.249 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44274.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44274.log.gz 2023-12-08T21:33:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42762.log 2023-12-08T21:33:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43279.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43279.log.gz 2023-12-08T21:33:58.274 INFO:teuthology.orchestra.run.smithi053.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-08T21:33:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45430.log 2023-12-08T21:33:58.275 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42762.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42762.log.gz 2023-12-08T21:33:58.275 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45299.log 2023-12-08T21:33:58.277 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45430.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45430.log.gz 2023-12-08T21:33:58.277 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38673.log 2023-12-08T21:33:58.278 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45299.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45299.log.gz 2023-12-08T21:33:58.278 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42353.log 2023-12-08T21:33:58.279 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38673.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38673.log.gz 2023-12-08T21:33:58.279 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42327.log 2023-12-08T21:33:58.280 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42353.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42353.log.gz 2023-12-08T21:33:58.280 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43668.log 2023-12-08T21:33:58.281 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42327.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42327.log.gz 2023-12-08T21:33:58.281 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44327.log 2023-12-08T21:33:58.282 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43668.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43668.log.gz 2023-12-08T21:33:58.283 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43852.log 2023-12-08T21:33:58.283 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44327.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44327.log.gz 2023-12-08T21:33:58.284 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45894.log 2023-12-08T21:33:58.285 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43852.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43852.log.gz 2023-12-08T21:33:58.285 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42606.log 2023-12-08T21:33:58.286 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45894.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45894.log.gz 2023-12-08T21:33:58.287 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43520.log 2023-12-08T21:33:58.287 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42606.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42606.log.gz 2023-12-08T21:33:58.288 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43864.log 2023-12-08T21:33:58.288 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43520.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43520.log.gz 2023-12-08T21:33:58.289 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43546.log 2023-12-08T21:33:58.289 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43864.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43864.log.gz 2023-12-08T21:33:58.290 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43870.log 2023-12-08T21:33:58.291 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43546.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43546.log.gz 2023-12-08T21:33:58.291 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2023-12-08T21:33:58.292 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43870.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43870.log.gz 2023-12-08T21:33:58.292 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45403.log 2023-12-08T21:33:58.300 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mds.e.log: 92.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44667.log 2023-12-08T21:33:58.301 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45403.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45403.log.gz 2023-12-08T21:33:58.301 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2023-12-08T21:33:58.302 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45868.log 2023-12-08T21:33:58.302 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44667.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44667.log.gz 2023-12-08T21:33:58.303 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2023-12-08T21:33:58.304 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45868.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45868.log.gz 2023-12-08T21:33:58.304 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43364.log 2023-12-08T21:33:58.309 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42964.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2023-12-08T21:33:58.309 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44615.log 2023-12-08T21:33:58.310 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43364.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43364.log.gz 2023-12-08T21:33:58.310 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43934.log 2023-12-08T21:33:58.310 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44615.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44615.log.gz 2023-12-08T21:33:58.310 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45606.log 2023-12-08T21:33:58.310 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43934.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43934.log.gz 2023-12-08T21:33:58.311 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45606.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45606.log.gz 2023-12-08T21:33:58.513 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/ceph-mon.b.log: file size changed while zipping 2023-12-08T21:33:58.513 INFO:teuthology.orchestra.run.smithi146.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-08T21:33:58.550 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/ceph-mon.c.log: file size changed while zipping 2023-12-08T21:33:58.550 INFO:teuthology.orchestra.run.smithi146.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-08T21:33:59.495 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-08T21:34:00.109 INFO:teuthology.orchestra.run.smithi146.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-08T21:34:00.445 INFO:teuthology.orchestra.run.smithi053.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-08T21:34:00.542 INFO:teuthology.orchestra.run.smithi146.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-08T21:34:00.564 INFO:teuthology.orchestra.run.smithi146.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-08T21:34:00.597 INFO:teuthology.orchestra.run.smithi146.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-08T21:34:00.598 INFO:teuthology.orchestra.run.smithi146.stderr: 2023-12-08T21:34:00.598 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m2.675s 2023-12-08T21:34:00.598 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m10.927s 2023-12-08T21:34:00.598 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m0.331s 2023-12-08T21:34:00.736 INFO:teuthology.orchestra.run.smithi053.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-08T21:34:01.357 INFO:teuthology.orchestra.run.smithi053.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-08T21:34:01.826 INFO:teuthology.orchestra.run.smithi053.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-08T21:34:02.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-12-08T21:34:04.149 INFO:teuthology.orchestra.run.smithi053.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.44874.log.gz 2023-12-08T21:34:07.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2023-12-08T21:34:07.965 INFO:teuthology.orchestra.run.smithi053.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-08T21:34:07.967 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-12-08T21:34:07.967 INFO:teuthology.orchestra.run.smithi053.stderr:real 0m10.056s 2023-12-08T21:34:07.967 INFO:teuthology.orchestra.run.smithi053.stderr:user 0m29.807s 2023-12-08T21:34:07.968 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m0.906s 2023-12-08T21:34:07.968 INFO:tasks.ceph:Archiving logs... 2023-12-08T21:34:07.969 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218/remote/smithi053/log 2023-12-08T21:34:07.969 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-08T21:34:11.542 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218/remote/smithi146/log 2023-12-08T21:34:11.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-08T21:34:12.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~10s 2023-12-08T21:34:13.025 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2023-12-08T21:34:13.027 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-08T21:34:13.043 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2023-12-08T21:34:13.044 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-08T21:34:13.044 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-08T21:34:13.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-08T21:34:13.118 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-08T21:34:13.127 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-08T21:34:13.128 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T21:34:13.130 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T21:34:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: remote refid st t when poll reach delay offset jitter 2023-12-08T21:34:13.141 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================== 2023-12-08T21:34:13.141 INFO:teuthology.orchestra.run.smithi053.stdout:*hv01.front.sepi 44.4.53.2 2 u 54 128 377 0.188 -4.971 1.582 2023-12-08T21:34:13.141 INFO:teuthology.orchestra.run.smithi053.stdout:+hv02.front.sepi 63.231.80.2 3 u 61 128 377 0.173 -2.207 1.077 2023-12-08T21:34:13.141 INFO:teuthology.orchestra.run.smithi053.stdout:+hv03.front.sepi 74.6.168.72 3 u 59 128 377 0.168 -1.423 1.646 2023-12-08T21:34:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-12-08T21:34:13.143 INFO:teuthology.orchestra.run.smithi146.stdout: remote refid st t when poll reach delay offset jitter 2023-12-08T21:34:13.143 INFO:teuthology.orchestra.run.smithi146.stdout:============================================================================== 2023-12-08T21:34:13.143 INFO:teuthology.orchestra.run.smithi146.stdout:*hv01.front.sepi 44.4.53.2 2 u 1 128 377 0.181 -4.483 0.408 2023-12-08T21:34:13.143 INFO:teuthology.orchestra.run.smithi146.stdout:+hv02.front.sepi 63.231.80.2 3 u 123 128 377 0.171 -0.215 0.798 2023-12-08T21:34:13.143 INFO:teuthology.orchestra.run.smithi146.stdout:+hv03.front.sepi 74.6.168.72 3 u 13 128 377 0.173 -1.579 0.791 2023-12-08T21:34:13.144 INFO:teuthology.orchestra.run.smithi146.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-12-08T21:34:13.144 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-08T21:34:13.154 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-08T21:34:13.155 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-08T21:34:13.165 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-08T21:34:13.174 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-08T21:34:13.185 INFO:teuthology.task.internal:Duration was 3437.885382 seconds 2023-12-08T21:34:13.185 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-08T21:34:13.194 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-08T21:34:13.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-08T21:34:13.197 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-08T21:34:13.234 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-08T21:34:13.234 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2023-12-08T21:34:13.234 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-08T21:34:13.289 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2023-12-08T21:34:13.289 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-08T21:34:13.299 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-08T21:34:13.299 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-08T21:34:13.333 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-08T21:34:13.362 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-08T21:34:13.362 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-08T21:34:13.401 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-08T21:34:13.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-08T21:34:13.470 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-08T21:34:13.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-08T21:34:13.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-08T21:34:13.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-08T21:34:13.502 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-08T21:34:13.525 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-08T21:34:13.533 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2023-12-08T21:34:13.547 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2023-12-08T21:34:13.656 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-08T21:34:13.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T21:34:13.661 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-08T21:34:13.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T21:34:13.705 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-08T21:34:13.724 INFO:teuthology.task.internal:Transferring archived files... 2023-12-08T21:34:13.725 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218/remote/smithi053 2023-12-08T21:34:13.725 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-08T21:34:13.745 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218/remote/smithi146 2023-12-08T21:34:13.746 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-08T21:34:13.767 INFO:teuthology.task.internal:Removing archive directory... 2023-12-08T21:34:13.768 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-08T21:34:13.789 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-08T21:34:13.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-08T21:34:13.824 INFO:teuthology.task.internal:Not uploading archives. 2023-12-08T21:34:13.824 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-08T21:34:13.834 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-08T21:34:13.835 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-08T21:34:13.837 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-08T21:34:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 8 21:34 /home/ubuntu/cephtest 2023-12-08T21:34:13.861 INFO:teuthology.orchestra.run.smithi146.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 8 21:34 /home/ubuntu/cephtest 2023-12-08T21:34:13.862 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-08T21:34:13.873 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-08T21:34:13.883 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2023-12-08T21:34:13.883 INFO:teuthology.nuke:Checking targets against current locks 2023-12-08T21:34:13.908 DEBUG:teuthology.nuke:shortname: smithi053 2023-12-08T21:34:13.909 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T21:34:13.932 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 20:27:52.126276', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLmzGf8xlQcY+xSSHpacug3HfG5FA11wlSf4yTCF8X5ZvnF4jFbfZq6bM04t26vEes7oJ4pGuy2MG/0rDZu/sIA='} 2023-12-08T21:34:13.935 DEBUG:teuthology.nuke:shortname: smithi146 2023-12-08T21:34:13.936 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T21:34:13.957 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484218', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 20:27:52.128229', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCn5oXHiNIgqK8w2G01xEDfyPiEwwAF7BNao5zji20NzvVMxgvQ9zvWO97+kRZC6uewa+UdCb5B52A6aSEhpJD4='} 2023-12-08T21:34:13.989 INFO:teuthology.orchestra.console.smithi053:Power off 2023-12-08T21:34:13.989 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T21:34:14.012 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-12-08T21:34:14.013 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:34:14.029 INFO:teuthology.orchestra.console.smithi146:Power off 2023-12-08T21:34:14.029 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T21:34:14.040 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-12-08T21:34:14.054 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-12-08T21:34:14.055 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:34:14.085 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-12-08T21:34:17.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~15s 2023-12-08T21:34:17.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-12-08T21:34:18.041 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:34:18.085 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:34:18.151 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-12-08T21:34:18.196 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-12-08T21:34:22.154 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:34:22.197 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:34:22.266 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-12-08T21:34:22.308 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-12-08T21:34:22.409 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-12-08T21:34:22.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~20s 2023-12-08T21:34:22.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2023-12-08T21:34:26.270 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:34:26.380 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-12-08T21:34:26.481 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-12-08T21:34:26.585 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} duration: 3437.8853821754456 failure_reason: 'valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-12-08T21:34:26.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T21:34:26.662 INFO:teuthology.run:FAIL